org.apache.hadoop.examples.terasort

Class TeraOutputFormat

java.lang.Object

org.apache.hadoop.mapred.FileOutputFormat<K,V>

org.apache.hadoop.mapred.TextOutputFormat<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

org.apache.hadoop.examples.terasort.TeraOutputFormat

All Implemented Interfaces:

OutputFormat<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

public class TeraOutputFormat
extends TextOutputFormat<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

A streamlined text output format that writes key, value, and "\r\n".

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.mapred.TextOutputFormat

TextOutputFormat.LineRecordWriter<K,V>

Constructor Summary

Constructors

Constructor and Description
TeraOutputFormat()

Method Summary

Methods

Modifier and Type	Method and Description
static boolean	getFinalSync(JobConf conf) Does the user want a final sync at close?
RecordWriter<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>	getRecordWriter(org.apache.hadoop.fs.FileSystem ignored, JobConf job, java.lang.String name, org.apache.hadoop.util.Progressable progress) Get the RecordWriter for the given job.
static void	setFinalSync(JobConf conf, boolean newValue) Set the requirement for a final sync before the stream is closed.

Methods inherited from class org.apache.hadoop.mapred.FileOutputFormat

checkOutputSpecs, getCompressOutput, getOutputCompressorClass, getOutputPath, getPathForCustomFile, getTaskOutputPath, getUniqueName, getWorkOutputPath, setCompressOutput, setOutputCompressorClass, setOutputPath

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TeraOutputFormat

public TeraOutputFormat()

Method Detail

setFinalSync

public static void setFinalSync(JobConf conf,
                boolean newValue)

Set the requirement for a final sync before the stream is closed.

getFinalSync

public static boolean getFinalSync(JobConf conf)

Does the user want a final sync at close?

getRecordWriter

public RecordWriter<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text> getRecordWriter(org.apache.hadoop.fs.FileSystem ignored,
                                                                                JobConf job,
                                                                                java.lang.String name,
                                                                                org.apache.hadoop.util.Progressable progress)
                                                                                  throws java.io.IOException

Description copied from interface: OutputFormat

Get the RecordWriter for the given job.

Specified by:

getRecordWriter in interface OutputFormat<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

Overrides:

getRecordWriter in class TextOutputFormat<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

job - configuration for the job whose output is being written.

name - the unique name for this part of the output.

progress - mechanism for reporting progress while writing to file.

Returns:

a RecordWriter to write the output for the job.

Throws:

java.io.IOException