> > not disk-based.
So how do you want to archieve scalability without that? In order to process tasks independend of each other (not in parallel, but e.g. in small mini batches), you have to save the state. RAM is limited and can't store huge states (persistent in case of crashes). 2012/12/7 Suraj Menon <[email protected]> > On Thu, Dec 6, 2012 at 8:27 PM, Edward J. Yoon <[email protected] > >wrote: > > > I think large data processing capability is more important than fault > > tolerance at the moment. > > > > +1 >
