Re: In memory Map Reduce

2008-06-08 Thread Martin Jaggi
being written to disk. But other than guessing like this, I couldn't actually say how it would turn out except that for very short jobs, moving jar files around and other startup costs can be the dominant cost. On Sun, Jun 1, 2008 at 5:05 AM, Martin Jaggi [EMAIL PROTECTED] wrote: So

Re: other implementations of TaskRunner

2008-06-01 Thread Martin Jaggi
in innumerable ways. On Sat, May 31, 2008 at 7:51 PM, Martin Jaggi [EMAIL PROTECTED] wrote: Concerning real-time Map Reduce within (and not only between) machines (multi-core GPU), e.g. the Phoenix and Mars frameworks: I'm really interested in very fast Map Reduce tasks, i.e. without

Realtime Map Reduce = Supercomputing for the Masses?

2008-05-31 Thread Martin Jaggi
Concerning real-time Map Reduce within (and not only between) machines (multi-core GPU), e.g. the Phoenix and Mars frameworks: I'm really interested in very fast Map Reduce tasks, i.e. without much disk access. With the rise of multi-core systems, this could get more and more interesting,