org.apache.hadoop.contrib.index.mapred

Class IntermediateForm

java.lang.Object

org.apache.hadoop.contrib.index.mapred.IntermediateForm

All Implemented Interfaces:

org.apache.hadoop.io.Writable

public class IntermediateForm
extends java.lang.Object
implements org.apache.hadoop.io.Writable

An intermediate form for one or more parsed Lucene documents and/or delete terms. It actually uses Lucene file format as the format for the intermediate form by using RAM dir files. Note: If process(*) is ever called, closeWriter() should be called. Otherwise, no need to call closeWriter().

Constructor Summary

Constructors

Constructor and Description
IntermediateForm() Constructor

Method Summary

Methods

Modifier and Type	Method and Description
void	closeWriter() Close the Lucene index writer associated with the intermediate form, if created.
void	configure(IndexUpdateConfiguration iconf) Configure using an index update configuration.
java.util.Iterator<org.apache.lucene.index.Term>	deleteTermIterator() Get an iterator for the delete terms in the intermediate form.
org.apache.lucene.store.Directory	getDirectory() Get the ram directory of the intermediate form.
void	process(DocumentAndOp doc, org.apache.lucene.analysis.Analyzer analyzer) This method is used by the index update mapper and process a document operation into the current intermediate form.
void	process(IntermediateForm form) This method is used by the index update combiner and process an intermediate form into the current intermediate form.
void	readFields(java.io.DataInput in)
java.lang.String	toString()
void	write(java.io.DataOutput out)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

IntermediateForm

public IntermediateForm()
                 throws java.io.IOException

Constructor

Throws:

java.io.IOException

Method Detail

configure

public void configure(IndexUpdateConfiguration iconf)

Configure using an index update configuration.

Parameters:

iconf - the index update configuration

getDirectory

public org.apache.lucene.store.Directory getDirectory()

Get the ram directory of the intermediate form.

Returns:

the ram directory

deleteTermIterator

public java.util.Iterator<org.apache.lucene.index.Term> deleteTermIterator()

Get an iterator for the delete terms in the intermediate form.

Returns:

an iterator for the delete terms

process

public void process(DocumentAndOp doc,
           org.apache.lucene.analysis.Analyzer analyzer)
             throws java.io.IOException

This method is used by the index update mapper and process a document operation into the current intermediate form.

Parameters:

doc - input document operation

analyzer - the analyzer

Throws:

java.io.IOException

process

public void process(IntermediateForm form)
             throws java.io.IOException

This method is used by the index update combiner and process an intermediate form into the current intermediate form. More specifically, the input intermediate forms are a single-document ram index and/or a single delete term.

Parameters:

form - the input intermediate form

Throws:

java.io.IOException

closeWriter

public void closeWriter()
                 throws java.io.IOException

Close the Lucene index writer associated with the intermediate form, if created. Do not close the ram directory. In fact, there is no need to close a ram directory.

Throws:

java.io.IOException

toString

public java.lang.String toString()

Overrides:

toString in class java.lang.Object

write

public void write(java.io.DataOutput out)
           throws java.io.IOException

Specified by:

write in interface org.apache.hadoop.io.Writable

Throws:

java.io.IOException

readFields

public void readFields(java.io.DataInput in)
                throws java.io.IOException

Specified by:

readFields in interface org.apache.hadoop.io.Writable

Throws:

java.io.IOException