org.apache.mahout.common.iterator.sequencefile
Class SequenceFileDirValueIterator<V extends org.apache.hadoop.io.Writable>
java.lang.Object
com.google.common.collect.ForwardingObject
com.google.common.collect.ForwardingIterator<V>
org.apache.mahout.common.iterator.sequencefile.SequenceFileDirValueIterator<V>
- All Implemented Interfaces:
- Closeable, Iterator<V>
public final class SequenceFileDirValueIterator<V extends org.apache.hadoop.io.Writable>
- extends com.google.common.collect.ForwardingIterator<V>
- implements Closeable
Like SequenceFileValueIterator
, but iterates not just over one
sequence file, but many. The input path may be specified as a directory of
files to read, or as a glob pattern. The set of files may be optionally
restricted with a PathFilter
.
Constructor Summary |
SequenceFileDirValueIterator(org.apache.hadoop.fs.Path[] path,
Comparator<org.apache.hadoop.fs.FileStatus> ordering,
boolean reuseKeyValueInstances,
org.apache.hadoop.conf.Configuration conf)
Multifile sequence file iterator where files are specified explicitly by
path parameters. |
SequenceFileDirValueIterator(org.apache.hadoop.fs.Path path,
PathType pathType,
org.apache.hadoop.fs.PathFilter filter,
Comparator<org.apache.hadoop.fs.FileStatus> ordering,
boolean reuseKeyValueInstances,
org.apache.hadoop.conf.Configuration conf)
Constructor that uses either FileSystem.listStatus(Path) or
FileSystem.globStatus(Path) to obtain list of files to iterate over
(depending on pathType parameter). |
Methods inherited from class com.google.common.collect.ForwardingIterator |
hasNext, next, remove |
Methods inherited from class com.google.common.collect.ForwardingObject |
toString |
SequenceFileDirValueIterator
public SequenceFileDirValueIterator(org.apache.hadoop.fs.Path path,
PathType pathType,
org.apache.hadoop.fs.PathFilter filter,
Comparator<org.apache.hadoop.fs.FileStatus> ordering,
boolean reuseKeyValueInstances,
org.apache.hadoop.conf.Configuration conf)
throws IOException
- Constructor that uses either
FileSystem.listStatus(Path)
or
FileSystem.globStatus(Path)
to obtain list of files to iterate over
(depending on pathType parameter).
- Throws:
IOException
SequenceFileDirValueIterator
public SequenceFileDirValueIterator(org.apache.hadoop.fs.Path[] path,
Comparator<org.apache.hadoop.fs.FileStatus> ordering,
boolean reuseKeyValueInstances,
org.apache.hadoop.conf.Configuration conf)
throws IOException
- Multifile sequence file iterator where files are specified explicitly by
path parameters.
- Throws:
IOException
delegate
protected Iterator<V> delegate()
- Overrides:
delegate
in class com.google.common.collect.ForwardingIterator<V extends org.apache.hadoop.io.Writable>
close
public void close()
throws IOException
- Specified by:
close
in interface Closeable
- Throws:
IOException
Copyright © 2008–2014 The Apache Software Foundation. All rights reserved.