On Mon, Jan 09, 2006 at 05:00:00PM -0800, Doug Cutting wrote:
> To read sequence files directly outside of MapReduce, just use
> SequenceFile directly, e.g., something like:
> 
> MyKey key = new MyKey();
> MyValue value = new MyValue();
> 
> SequenceFile.Reader reader =
>   new SequenceFile.reader(NutchFileSystem.get("local"), "file");
> 
> while (reader.next(key, value)) {
>   ... process key/value pair ...
> }
> 
> Wouldn't that be simpler?

Who knows?  Maybe it would be. :)

With the approach that you just described, what's the easiest way to get
all of the files in a directory (the full output of a reduce)?

Thanks.

-- 
Andrew McNabb
http://www.mcnabbs.org/andrew/
PGP Fingerprint: 8A17 B57C 6879 1863 DE55  8012 AB4D 6098 8826 6868

Attachment: signature.asc
Description: Digital signature

Reply via email to