On Wed, 08 Nov 2006 01:03:23 +0100, David Pollak <[EMAIL PROTECTED]> wrote:
Howdy,
Is there a way to store "by-product" data someplace where it can be
read? For example, as I'm iterating over a collection of documents, I
want to generate some statistics about the collection, put those stats
"someplace" that can be accessed during future map-reduce cycles.
Should I simply run a "faux" map-reduce cycle to count the information
and store it in a known location in the DFS?
Well, yeah, but you don't have to use map-reduce to enter things into the
DFS. You can just as well use the command line too, or even access the DFS
directly from within another Java application.
[...]
--
Using Opera's revolutionary e-mail client: http://www.opera.com/mail/