|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Objectorg.apache.hadoop.mapreduce.InputFormat<K,V>
org.apache.hadoop.mapreduce.lib.input.FileInputFormat<K,V>
org.apache.hadoop.mapreduce.lib.input.CombineFileInputFormat<org.apache.hadoop.io.IntWritable,org.apache.hadoop.io.BytesWritable>
org.apache.mahout.text.MultipleTextFileInputFormat
public class MultipleTextFileInputFormat
Used in combining a large number of text files into one text input reader along with the WholeFileRecordReader class.
Nested Class Summary |
---|
Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.lib.input.FileInputFormat |
---|
org.apache.hadoop.mapreduce.lib.input.FileInputFormat.Counter |
Field Summary |
---|
Fields inherited from class org.apache.hadoop.mapreduce.lib.input.CombineFileInputFormat |
---|
SPLIT_MINSIZE_PERNODE, SPLIT_MINSIZE_PERRACK |
Constructor Summary | |
---|---|
MultipleTextFileInputFormat()
|
Method Summary | |
---|---|
org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.IntWritable,org.apache.hadoop.io.BytesWritable> |
createRecordReader(org.apache.hadoop.mapreduce.InputSplit inputSplit,
org.apache.hadoop.mapreduce.TaskAttemptContext taskAttemptContext)
|
Methods inherited from class org.apache.hadoop.mapreduce.lib.input.CombineFileInputFormat |
---|
createPool, createPool, getFileBlockLocations, getSplits, isSplitable, setMaxSplitSize, setMinSplitSizeNode, setMinSplitSizeRack |
Methods inherited from class org.apache.hadoop.mapreduce.lib.input.FileInputFormat |
---|
addInputPath, addInputPaths, computeSplitSize, getBlockIndex, getFormatMinSplitSize, getInputPathFilter, getInputPaths, getMaxSplitSize, getMinSplitSize, listStatus, setInputPathFilter, setInputPaths, setInputPaths, setMaxInputSplitSize, setMinInputSplitSize |
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Constructor Detail |
---|
public MultipleTextFileInputFormat()
Method Detail |
---|
public org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.IntWritable,org.apache.hadoop.io.BytesWritable> createRecordReader(org.apache.hadoop.mapreduce.InputSplit inputSplit, org.apache.hadoop.mapreduce.TaskAttemptContext taskAttemptContext) throws IOException
createRecordReader
in class org.apache.hadoop.mapreduce.lib.input.CombineFileInputFormat<org.apache.hadoop.io.IntWritable,org.apache.hadoop.io.BytesWritable>
IOException
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |