org.apache.hadoop.examples

Class MultiFileWordCount.MyInputFormat

java.lang.Object

org.apache.hadoop.mapreduce.InputFormat<K,V>

org.apache.hadoop.mapreduce.lib.input.FileInputFormat<K,V>

org.apache.hadoop.mapreduce.lib.input.CombineFileInputFormat<MultiFileWordCount.WordOffset,org.apache.hadoop.io.Text>

org.apache.hadoop.examples.MultiFileWordCount.MyInputFormat

Enclosing class:

MultiFileWordCount

public static class MultiFileWordCount.MyInputFormat
extends CombineFileInputFormat<MultiFileWordCount.WordOffset,org.apache.hadoop.io.Text>

To use CombineFileInputFormat, one should extend it, to return a (custom) RecordReader. CombineFileInputFormat uses CombineFileSplits.

Constructor Summary

Constructors

Constructor and Description
MultiFileWordCount.MyInputFormat()

Method Summary

Methods

Modifier and Type	Method and Description
RecordReader<MultiFileWordCount.WordOffset,org.apache.hadoop.io.Text>	createRecordReader(InputSplit split, TaskAttemptContext context) This is not implemented yet.

Methods inherited from class org.apache.hadoop.mapreduce.lib.input.CombineFileInputFormat

createPool, createPool, getFileBlockLocations, getSplits, isSplitable, setMaxSplitSize, setMinSplitSizeNode, setMinSplitSizeRack

Methods inherited from class org.apache.hadoop.mapreduce.lib.input.FileInputFormat

addInputPath, addInputPaths, computeSplitSize, getBlockIndex, getFormatMinSplitSize, getInputPathFilter, getInputPaths, getMaxSplitSize, getMinSplitSize, listStatus, setInputPathFilter, setInputPaths, setInputPaths, setMaxInputSplitSize, setMinInputSplitSize

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

MultiFileWordCount.MyInputFormat

public MultiFileWordCount.MyInputFormat()

Method Detail

createRecordReader

public RecordReader<MultiFileWordCount.WordOffset,org.apache.hadoop.io.Text> createRecordReader(InputSplit split,
                                                                                       TaskAttemptContext context)
                                                                                         throws java.io.IOException

Description copied from class: CombineFileInputFormat

This is not implemented yet.

Specified by:

createRecordReader in class CombineFileInputFormat<MultiFileWordCount.WordOffset,org.apache.hadoop.io.Text>

Parameters:

split - the split to be read

context - the information about the task

Returns:

a new record reader

Throws:

java.io.IOException