Netflix/Astynax Client for Cassandra

2013-02-06 Thread Cassa L
Hi, Has anyone used Netflix/astynax java client library for Cassandra? I have used Hector before and would like to evaluate astynax. Not sure, how it is accepted in Cassandra community. Any issues with it or advantagest? API looks very clean and simple compare to Hector. Has anyone used it in

Re: Netflix/Astynax Client for Cassandra

2013-02-07 Thread Cassa L
Thank you all for the responses to this thread. I am planning to use Cassandra 1.1.9 with Astynax. Does anyone has Cassandra 1.x version running in production with astynax? Did you come across any show-stopper issues? Thanks LCassa On Thu, Feb 7, 2013 at 8:50 AM, Bartłomiej Romański

Gossiper question

2011-05-17 Thread Cassa L
this dead/up pattern is occurring at Gossip. Thanks in advance, Cassa L.

Multi DC setup

2011-10-10 Thread Cassa L
I am trying to understand multi DC setup for cassandra. As I understand, in this setup, replicas exists in same cluster ring, but physically nodes are distributed across DCs. Is this correct? I have two different cluster rings in two DCs, and want to replicate data bidirectionally. They both have

Re: Multi DC setup

2011-10-10 Thread Cassa L
to endure split-brain for a while. /*** sent from my android...please pardon occasional typos as I respond @ the speed of thought / On Oct 10, 2011 10:09 PM, Cassa L lcas...@gmail.com wrote: I am trying to understand multi DC setup for cassandra

Issue with protobuff and Spark cassandra connector

2015-11-16 Thread Cassa L
Hi, Has anyone used Protobuff with spark-cassandra connector? I am using protobuff-3.0-beta with spark-1.4 and cassandra-connector-2.10. I keep getting "Unable to find proto buffer class" in my code. I checked version of protobuff jar and it is loaded with 3.0-beta in classpath. Protobuff is

Spark Memory Error - Not enough space to cache broadcast

2016-06-13 Thread Cassa L
Hi, I'm using spark 1.5.1 version. I am reading data from Kafka into Spark and writing it into Cassandra after processing it. Spark job starts fine and runs all good for some time until I start getting below errors. Once these errors come, job start to lag behind and I see that job has scheduling

Re: Spark Memory Error - Not enough space to cache broadcast

2016-06-14 Thread Cassa L
Hi, I would appreciate any clue on this. It has become a bottleneck for our spark job. On Mon, Jun 13, 2016 at 2:56 PM, Cassa L <lcas...@gmail.com> wrote: > Hi, > > I'm using spark 1.5.1 version. I am reading data from Kafka into Spark and > writing it into Cassandra after pr

Re: Spark Memory Error - Not enough space to cache broadcast

2016-06-16 Thread Cassa L
Anything weird memory-related? >> >> How does your "I am reading data from Kafka into Spark and writing it >> into Cassandra after processing it." pipeline look like? >> >> Pozdrawiam, >> Jacek Laskowski >> >> https://medium.com

Re: Spark Memory Error - Not enough space to cache broadcast

2016-06-16 Thread Cassa L
ked and address > that as adjusting memoryFraction will only be a stopgap. both shuffle and > storage memoryFractions default to 0.6 > > I have set above parameters to 0.5. Does it need to increased? Thanks. > On Wed, Jun 15, 2016 at 9:37 PM, Cassa L <lcas...@gmail.com> wro

Re: Spark Memory Error - Not enough space to cache broadcast

2016-06-16 Thread Cassa L
://medium.com/@jaceklaskowski/ > Mastering Apache Spark http://bit.ly/mastering-apache-spark > Follow me at https://twitter.com/jaceklaskowski > > > On Mon, Jun 13, 2016 at 11:56 PM, Cassa L <lcas...@gmail.com> wrote: > > Hi, > > > > I'm using spark 1.5.1 ve

Re: Spark Memory Error - Not enough space to cache broadcast

2016-06-15 Thread Cassa L
). If it’s an option, >> probably worth a try. >> >> Cheers >> Ben >> >> On Wed, 15 Jun 2016 at 08:48 Cassa L <lcas...@gmail.com> wrote: >> >>> Hi, >>> I would appreciate any clue on this. It has become a bottleneck for our >>> spark

Re: Spark Memory Error - Not enough space to cache broadcast

2016-06-15 Thread Cassa L
s://issues.apache.org/jira/browse/SPARK-1). If it’s an option, >> probably worth a try. >> >> Cheers >> Ben >> >> On Wed, 15 Jun 2016 at 08:48 Cassa L <lcas...@gmail.com> wrote: >> >>> Hi, >>> I would appreciate any clue on

Re: Accessing Cassandra data from Spark Shell

2016-05-17 Thread Cassa L
ting started article on our support page will probably > give you a good steer to get started even if you’re not using Instaclustr: > https://support.instaclustr.com/hc/en-us/articles/213097877-Getting-Started-with-Instaclustr-Spark-Cassandra- > > > > Cheers > > Ben &g

Re: Accessing Cassandra data from Spark Shell

2016-05-18 Thread Cassa L
and cassandra connector with 1.4.x). The main trick is in > lining up all the versions and building an appropriate connector jar. > > > > Cheers > > Ben > > > > On Wed, 18 May 2016 at 15:40 Cassa L <lcas...@gmail.com> wrote: > > Hi, > > I followe

Accessing Cassandra data from Spark Shell

2016-05-09 Thread Cassa L
Hi, Has anyone tried accessing Cassandra data using SparkShell? How do you do it? Can you use HiveContext for Cassandra data? I'm using community version of Cassandra-3.0 Thanks, LCassa

Custom receiver for WebSocket in Spark not working

2016-11-02 Thread Cassa L
Hi, I am using spark 1.6. I wrote a custom receiver to read from WebSocket. But when I start my spark job, it connects to the WebSocket but doesn't get any message. Same code, if I write as separate scala class, it works and prints messages from WebSocket. Is anything missing in my Spark Code?

Re: Why don't I see my spark jobs running in parallel in Cassandra/Spark DSE cluster?

2017-10-27 Thread Cassa L
t; > On 27. Oct 2017, at 08:05, Cassa L <lcas...@gmail.com> wrote: > > Hi, > I have a spark job that has use case as below: > RRD1 and RDD2 read from Cassandra tables. These two RDDs then do some > transformation and after that I do a count on transformed data. >