Re: How production un-ready are Mesos Cassandra, Spark and Kafka Frameworks?

2015-10-17 Thread Sam Bessalah
Thats' really depends on what you're doing. I've been running Spark in production with Mesos for as far as Spark ever got open sourced. Earlier this year, we added Cassandra in the mix by running it through Docker and Marathon in host network mode with volume. Nothing fancy, since it was for non cr

Re: How production un-ready are Mesos Cassandra, Spark and Kafka Frameworks?

2015-10-13 Thread Chris Elsmore
Thanks for the replies, a few other people IRL have echoed Dicks comments. To take advantage of Cassandra and Spark data locality, I guess I could run Cassandra on a few Mesos agent machines outside of Mesos, and just label them such that spark jobs get assigned to those too via Mesos? > On

Re: How production un-ready are Mesos Cassandra, Spark and Kafka Frameworks?

2015-10-13 Thread craig w
So far the Kafka framework has worked well in production. We launch the framework using marathon, then execute a few command line statements to add and start the brokers. On Oct 12, 2015 1:38 PM, "Dick Davies" wrote: > Hi Chris > > > > Spark is a Mesos native, I'd have no hesitation running it o

Re: How production un-ready are Mesos Cassandra, Spark and Kafka Frameworks?

2015-10-12 Thread Dick Davies
Hi Chris Spark is a Mesos native, I'd have no hesitation running it on Mesos. Cassandra not so much - that's not to disparage the work people are putting in there, I think it's really interesting. But personally with complex beasts like Cassandra I want to be running as 'stock' as possible, as

How production un-ready are Mesos Cassandra, Spark and Kafka Frameworks?

2015-10-12 Thread Chris Elsmore
Hi all, Have just got back from a brilliant MesosCon Europe in Dublin, I learnt a huge amount and a big thank-you for putting on a great conference to all involved! I am looking to deploy a small (maybe 5 max) Cassandra & Spark cluster to do some data analysis at my current employer, and am a