org.apache.hadoop.mapred

Class LineRecordReader

java.lang.Object

org.apache.hadoop.mapred.LineRecordReader

All Implemented Interfaces:

RecordReader<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text>

public class LineRecordReader
extends java.lang.Object
implements RecordReader<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text>

Treats keys as offset in file and value as line.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	LineRecordReader.LineReader Deprecated. Use LineReader instead.

Constructor Summary

Constructors

Constructor and Description
LineRecordReader(org.apache.hadoop.conf.Configuration job, FileSplit split)
LineRecordReader(org.apache.hadoop.conf.Configuration job, FileSplit split, byte[] recordDelimiter)
LineRecordReader(java.io.InputStream in, long offset, long endOffset, org.apache.hadoop.conf.Configuration job)
LineRecordReader(java.io.InputStream in, long offset, long endOffset, org.apache.hadoop.conf.Configuration job, byte[] recordDelimiter)
LineRecordReader(java.io.InputStream in, long offset, long endOffset, int maxLineLength)
LineRecordReader(java.io.InputStream in, long offset, long endOffset, int maxLineLength, byte[] recordDelimiter)

Method Summary

Methods

Modifier and Type	Method and Description
void	close() Close this InputSplit to future operations.
org.apache.hadoop.io.LongWritable	createKey() Create an object of the appropriate type to be used as a key.
org.apache.hadoop.io.Text	createValue() Create an object of the appropriate type to be used as a value.
long	getPos() Returns the current position in the input.
float	getProgress() Get the progress within the split
boolean	next(org.apache.hadoop.io.LongWritable key, org.apache.hadoop.io.Text value) Read a line.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

LineRecordReader

public LineRecordReader(org.apache.hadoop.conf.Configuration job,
                FileSplit split)
                 throws java.io.IOException

Throws:

java.io.IOException

LineRecordReader

public LineRecordReader(org.apache.hadoop.conf.Configuration job,
                FileSplit split,
                byte[] recordDelimiter)
                 throws java.io.IOException

Throws:

java.io.IOException

LineRecordReader

public LineRecordReader(java.io.InputStream in,
                long offset,
                long endOffset,
                int maxLineLength)

LineRecordReader

public LineRecordReader(java.io.InputStream in,
                long offset,
                long endOffset,
                int maxLineLength,
                byte[] recordDelimiter)

LineRecordReader

public LineRecordReader(java.io.InputStream in,
                long offset,
                long endOffset,
                org.apache.hadoop.conf.Configuration job)
                 throws java.io.IOException

Throws:

java.io.IOException

LineRecordReader

public LineRecordReader(java.io.InputStream in,
                long offset,
                long endOffset,
                org.apache.hadoop.conf.Configuration job,
                byte[] recordDelimiter)
                 throws java.io.IOException

Throws:

java.io.IOException

Method Detail

createKey

public org.apache.hadoop.io.LongWritable createKey()

Description copied from interface: RecordReader

Create an object of the appropriate type to be used as a key.

Specified by:

createKey in interface RecordReader<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text>

Returns:

a new key object.

createValue

public org.apache.hadoop.io.Text createValue()

Description copied from interface: RecordReader

Create an object of the appropriate type to be used as a value.

Specified by:

createValue in interface RecordReader<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text>

Returns:

a new value object.

next

public boolean next(org.apache.hadoop.io.LongWritable key,
           org.apache.hadoop.io.Text value)
             throws java.io.IOException

Read a line.

Specified by:

next in interface RecordReader<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text>

Parameters:

key - the key to read data into

value - the value to read data into

Returns:

true iff a key/value was read, false if at EOF

Throws:

java.io.IOException

getProgress

public float getProgress()

Get the progress within the split

Specified by:

getProgress in interface RecordReader<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text>

Returns:

progress from 0.0 to 1.0.

getPos

public long getPos()
            throws java.io.IOException

Description copied from interface: RecordReader

Returns the current position in the input.

Specified by:

getPos in interface RecordReader<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text>

Returns:

the current position in the input.

Throws:

java.io.IOException

close

public void close()
           throws java.io.IOException

Description copied from interface: RecordReader

Close this InputSplit to future operations.

Specified by:

close in interface RecordReader<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text>

Throws:

java.io.IOException