Re: Spark in-memory analytics in BigTop stack

2012-09-26 Thread Konstantin Boudnik
On Wed, Sep 26, 2012 at 04:06PM, Wing Yew Poon wrote: > Hi, > please correct me if I'm wrong, but I thought Spark runs on top of > Mesos. Does it not require Mesos to run? Yes, you are right. That's why Mesos library is a part of Spark's dependencies. Now, there are 'on top of Mesos' and 'on Meso

Re: Spark in-memory analytics in BigTop stack

2012-09-26 Thread Wing Yew Poon
Hi, please correct me if I'm wrong, but I thought Spark runs on top of Mesos. Does it not require Mesos to run? - Wing Yew On Wed, Sep 26, 2012 at 10:42 AM, MTG dev wrote: > Thanks Bruno! > > I have created BIGTOP-715 > > Cheers, > MTG dev > > On Wed, Sep 26, 2012 at 01:19AM, Bruno Mahé wrote:

Re: Spark in-memory analytics in BigTop stack

2012-09-26 Thread MTG dev
Thanks Bruno! I have created BIGTOP-715 Cheers, MTG dev On Wed, Sep 26, 2012 at 01:19AM, Bruno Mahé wrote: > zOn 09/25/2012 10:46 AM, MTG dev wrote: > >Hi there. > > > >Apparently, I am not in a position to say what role Spark can play in the > >Bigtop for I am not speaking for neither of t

Re: Spark in-memory analytics in BigTop stack

2012-09-26 Thread Bruno Mahé
zOn 09/25/2012 10:46 AM, MTG dev wrote: Hi there. Apparently, I am not in a position to say what role Spark can play in the Bigtop for I am not speaking for neither of those projects. However, I can tell that Spark provides a number of the advantages compare to a traditional MapReduce model: st

Re: Spark in-memory analytics in BigTop stack

2012-09-25 Thread MTG dev
Hi there. Apparently, I am not in a position to say what role Spark can play in the Bigtop for I am not speaking for neither of those projects. However, I can tell that Spark provides a number of the advantages compare to a traditional MapReduce model: stateful computational model with a need to

Re: Spark in-memory analytics in BigTop stack

2012-09-24 Thread Roman Shaposhnik
On Mon, Sep 24, 2012 at 8:52 PM, Anatoli Fomenko wrote: > Hi Alef, > > Great news! > > Spark developers are interested in developing Spark packages and > contributing them to open source. Since you already have them, > what would you think about contributing the source to BigTop? This is very, ve

Re: Spark in-memory analytics in BigTop stack

2012-09-24 Thread Anatoli Fomenko
Hi Alef, Great news! Spark developers are interested in developing Spark packages and contributing them to open source. Since you already have them, what would you think about contributing the source to BigTop? Thank you, Anatoli From: MTG dev To: bigtop-