cassandra and spark from cloudera distirbution

2015-04-22 Thread Serega Sheypak
Hi, are Cassandra and Spark from Cloudera compatible? Where can I find these compatilibity notes?

Re: cassandra and spark from cloudera distirbution

2015-04-22 Thread Jay Ken
There is a Enerprise Edition from Datastax; where they have Spark and Cassandra Integration. http://www.datastax.com/what-we-offer/products-services/datastax-enterprise Thanks, Jay On Wed, Apr 22, 2015 at 6:41 AM, Serega Sheypak serega.shey...@gmail.com wrote: Hi, are Cassandra and Spark from

Re: cassandra and spark from cloudera distirbution

2015-04-22 Thread Brian O'Neill
other than the intended recipient is strictly prohibited. From: Serega Sheypak serega.shey...@gmail.com Reply-To: user@cassandra.apache.org Date: Wednesday, April 22, 2015 at 1:48 PM To: user user@cassandra.apache.org Subject: Re: cassandra and spark from cloudera distirbution We already use

Re: cassandra and spark from cloudera distirbution

2015-04-22 Thread Serega Sheypak
What is embedded spark? Where can I read about it? Right now we just install spark 1.2 built fro hadoop 2.4 and use it to query data from cassandra. 2015-04-22 19:56 GMT+02:00 Sebastian Estevez sebastian.este...@datastax.com : There is no supported way to replace the embedded spark that comes

Re: cassandra and spark from cloudera distirbution

2015-04-22 Thread Serega Sheypak
We already use it. Would like to use Spark from cloudera distribution. Should it work? 2015-04-22 19:43 GMT+02:00 Jay Ken jaytechg...@gmail.com: There is a Enerprise Edition from Datastax; where they have Spark and Cassandra Integration.

Re: cassandra and spark from cloudera distirbution

2015-04-22 Thread Sebastian Estevez
There is no supported way to replace the embedded spark that comes in DSE with something else. However you could probably read or write from/to DSE / Cassandra from a cloudera spark cluster using the open source DataStax connector. Are you looking for a particular feature that is not available in

Re: cassandra and spark from cloudera distirbution

2015-04-22 Thread Serega Sheypak
we use vanilla spark right now. Here is an ansible script to install spark: https://github.com/seregasheypak/ansible-vagrant-dse-spark/blob/master/roles/spark_configuration/tasks/main.yml and cassandra dse:

Re: cassandra and spark from cloudera distirbution

2015-04-22 Thread Sebastian Estevez
Oh sorry Jay mentioned DSE and you said we already use it. I think the answer to your question is Brian's response. These are the dse docs if you want to read about it: http://docs.datastax.com/en/datastax_enterprise/4.6/datastax_enterprise/spark/sparkTOC.html On Apr 22, 2015 2:05 PM, Serega