YARN + Spark sounds interesting indeed. Could I suggest this sounds like definitely a separate project vs yet another experiment in this code base? it's already spread unevenly enough.
On Mon, Mar 11, 2013 at 11:59 PM, Ted Dunning <[email protected]> wrote: > Yarn by itself won't fix this problem. Yarn + Spark would fix it. But, > then again, so would Mesos + Spark or AmigaOS + Spark. > > Should we open several additional modules which are parallel to core but > which depend on alternatives like Giraph or Spark instead? That would > allow experimentation to proceed.
