org.apache.hadoop.filecache

Class TaskDistributedCacheManager

java.lang.Object

org.apache.hadoop.filecache.TaskDistributedCacheManager

public class TaskDistributedCacheManager
extends java.lang.Object

Helper class of TrackerDistributedCacheManager that represents the cached files of a single job. This class is internal to Hadoop, and should not be treated as a public interface.

Method Summary

Methods

Modifier and Type	Method and Description
java.util.List<java.lang.String>	getClassPaths() Retrieves class paths (as local references) to add.
java.lang.ClassLoader	makeClassLoader(java.lang.ClassLoader parent) Creates a class loader that includes the designated files and archives.
void	release() Releases the cached files/archives, so that space can be reclaimed by the TrackerDistributedCacheManager.
void	setSizes(long[] sizes)
void	setupCache(org.apache.hadoop.conf.Configuration taskConf, java.lang.String publicCacheSubdir, java.lang.String privateCacheSubdir) Retrieve public distributed cache files into the local cache and updates the task configuration (which has been passed in via the constructor).

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

setupCache

public void setupCache(org.apache.hadoop.conf.Configuration taskConf,
              java.lang.String publicCacheSubdir,
              java.lang.String privateCacheSubdir)
                throws java.io.IOException

Retrieve public distributed cache files into the local cache and updates the task configuration (which has been passed in via the constructor). The private distributed cache is just looked at and the paths where the files/archives should go to is decided here. The actual localization is done by JobLocalizer. It is the caller's responsibility to re-write the task configuration XML file, if necessary.

Throws:

java.io.IOException

getClassPaths

public java.util.List<java.lang.String> getClassPaths()
                                               throws java.io.IOException

Retrieves class paths (as local references) to add. Should be called after setup().

Throws:

java.io.IOException

release

public void release()
             throws java.io.IOException

Releases the cached files/archives, so that space can be reclaimed by the TrackerDistributedCacheManager.

Throws:

java.io.IOException

setSizes

public void setSizes(long[] sizes)
              throws java.io.IOException

Throws:

java.io.IOException

makeClassLoader

public java.lang.ClassLoader makeClassLoader(java.lang.ClassLoader parent)
                                      throws java.net.MalformedURLException

Creates a class loader that includes the designated files and archives.

Throws:

java.net.MalformedURLException