org.apache.hadoop.mapreduce.lib.input

Class FileSplit

java.lang.Object

org.apache.hadoop.mapreduce.InputSplit

org.apache.hadoop.mapreduce.lib.input.FileSplit

All Implemented Interfaces:

org.apache.hadoop.io.Writable

public class FileSplit
extends InputSplit
implements org.apache.hadoop.io.Writable

A section of an input file. Returned by InputFormat.getSplits(JobContext) and passed to InputFormat.createRecordReader(InputSplit,TaskAttemptContext).

Constructor Summary

Constructors

Constructor and Description
FileSplit(org.apache.hadoop.fs.Path file, long start, long length, java.lang.String[] hosts) Constructs a split with host information

Method Summary

Methods

Modifier and Type	Method and Description
long	getLength() The number of bytes in the file to process.
java.lang.String[]	getLocations() Get the list of nodes by name where the data for the split would be local.
org.apache.hadoop.fs.Path	getPath() The file containing this split's data.
long	getStart() The position of the first byte in the file to process.
void	readFields(java.io.DataInput in)
java.lang.String	toString()
void	write(java.io.DataOutput out)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

FileSplit

public FileSplit(org.apache.hadoop.fs.Path file,
         long start,
         long length,
         java.lang.String[] hosts)

Constructs a split with host information

Parameters:

file - the file name

start - the position of the first byte in the file to process

length - the number of bytes in the file to process

hosts - the list of hosts containing the block, possibly null

Method Detail

getPath

public org.apache.hadoop.fs.Path getPath()

The file containing this split's data.

getStart

public long getStart()

The position of the first byte in the file to process.

getLength

public long getLength()

The number of bytes in the file to process.

Specified by:

getLength in class InputSplit

Returns:

the number of bytes in the split

toString

public java.lang.String toString()

Overrides:

toString in class java.lang.Object

write

public void write(java.io.DataOutput out)
           throws java.io.IOException

Specified by:

write in interface org.apache.hadoop.io.Writable

Throws:

java.io.IOException

readFields

public void readFields(java.io.DataInput in)
                throws java.io.IOException

Specified by:

readFields in interface org.apache.hadoop.io.Writable

Throws:

java.io.IOException

getLocations

public java.lang.String[] getLocations()
                                throws java.io.IOException

Description copied from class: InputSplit

Get the list of nodes by name where the data for the split would be local. The locations do not need to be serialized.

Specified by:

getLocations in class InputSplit

Returns:

a new array of the node nodes.

Throws:

java.io.IOException