org.apache.hadoop.mapred

Class UserLogCleaner

java.lang.Object

java.lang.Thread

org.apache.hadoop.mapred.UserLogCleaner

All Implemented Interfaces:

java.lang.Runnable

public class UserLogCleaner
extends java.lang.Thread

This is used only in UserLogManager, to manage cleanup of user logs.

Nested Class Summary

Nested classes/interfaces inherited from class java.lang.Thread

java.lang.Thread.State, java.lang.Thread.UncaughtExceptionHandler

Field Summary

Fields inherited from class java.lang.Thread

MAX_PRIORITY, MIN_PRIORITY, NORM_PRIORITY

Constructor Summary

Constructors

Constructor and Description
UserLogCleaner(UserLogManager userLogManager, org.apache.hadoop.conf.Configuration conf)

Method Summary

Methods

Modifier and Type	Method and Description
void	addOldUserLogsForDeletion(java.io.File loc, org.apache.hadoop.conf.Configuration conf) Adds the job log directories for deletion with default retain hours.
void	clearOldUserLogs(org.apache.hadoop.conf.Configuration conf) Clears all the logs in userlogs directory.
void	deleteJobLogs(JobID jobid)
void	markJobLogsForDeletion(long jobCompletionTime, int retainHours, JobID jobid) Adds job user-log directory to cleanup thread to delete logs after user-log retain hours.
void	run()
void	unmarkJobFromLogDeletion(JobID jobid) Remove job from user log deletion.

Methods inherited from class java.lang.Thread

activeCount, checkAccess, clone, countStackFrames, currentThread, destroy, dumpStack, enumerate, getAllStackTraces, getContextClassLoader, getDefaultUncaughtExceptionHandler, getId, getName, getPriority, getStackTrace, getState, getThreadGroup, getUncaughtExceptionHandler, holdsLock, interrupt, interrupted, isAlive, isDaemon, isInterrupted, join, join, join, resume, setContextClassLoader, setDaemon, setDefaultUncaughtExceptionHandler, setName, setPriority, setUncaughtExceptionHandler, sleep, sleep, start, stop, stop, suspend, toString, yield

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

UserLogCleaner

public UserLogCleaner(UserLogManager userLogManager,
              org.apache.hadoop.conf.Configuration conf)
               throws java.io.IOException

Throws:

java.io.IOException

Method Detail

run

public void run()

Specified by:

run in interface java.lang.Runnable

Overrides:

run in class java.lang.Thread

deleteJobLogs

public void deleteJobLogs(JobID jobid)
                   throws java.io.IOException

Throws:

java.io.IOException

addOldUserLogsForDeletion

public void addOldUserLogsForDeletion(java.io.File loc,
                             org.apache.hadoop.conf.Configuration conf)
                               throws java.io.IOException

Adds the job log directories for deletion with default retain hours. Deletes all other directories, if any.

Parameters:

loc - location of log directory

conf -

Throws:

java.io.IOException

clearOldUserLogs

public void clearOldUserLogs(org.apache.hadoop.conf.Configuration conf)
                      throws java.io.IOException

Clears all the logs in userlogs directory. This is usually called on reinit/restart of the TaskTracker.

Parameters:

conf -

Throws:

java.io.IOException

markJobLogsForDeletion

public void markJobLogsForDeletion(long jobCompletionTime,
                          int retainHours,
                          JobID jobid)

Adds job user-log directory to cleanup thread to delete logs after user-log retain hours.

Parameters:

jobCompletionTime - job completion time in millis

retainHours - the user-log retain hours for the job

jobid - JobID for which user logs should be deleted

unmarkJobFromLogDeletion

public void unmarkJobFromLogDeletion(JobID jobid)

Remove job from user log deletion.

Parameters:

jobid -