Re: Why and How is Cassandra using all my ram ?

2018-07-23 Thread Dennis Lovely
you define the max size of your heap (-Xmx), but you do not define the max size of your offheap (MaxMetaspaceSize for jdk 8, PermSize for jdk7), so you could occupy all of the memory on the instance. your system killed the process to preserve itself. you should also take into account that the

Re: Question About Reaper

2018-05-24 Thread Dennis Lovely
looks like you're connecting to a service listening on SSL but you don't have the CA used in your truststore On Thu, May 24, 2018 at 1:58 PM, Surbhi Gupta wrote: > Getting below error: > > Caused by: sun.security.validator.ValidatorException: PKIX path building >

Re: Spark Cassandra Python Connector

2016-06-20 Thread Dennis Lovely
https://github.com/TargetHolding/pyspark-cassandra On Mon, Jun 20, 2016 at 1:47 PM, Joaquin Alzola wrote: > Hi List > > Is there a Spark Cassandra connector in python? Of course there is the one > for scala ... > > BR > > Joaquin > This email is confidential and may

Re: Backup strategy

2016-06-16 Thread Dennis Lovely
Snapshot would flush your memtable to disk and you could stream your sstables out. Incremental backups would be the differences that have occurred since your last snapshot as far as I'm aware. Since it's reasonably unfeasible to constantly stream out full snapshots (depending on the density of

Re: Backup strategy

2016-06-16 Thread Dennis Lovely
Periodic snapshots + incremental backups I think are pretty good in terms of restoring to point in time. But you must manage cleaning up your snapshots + incremental backups on your own. I believe that tablesnap ( https://github.com/JeremyGrosser/tablesnap) is a pretty decent approach in terms

Re: Spark Memory Error - Not enough space to cache broadcast

2016-06-16 Thread Dennis Lovely
-archive.com/user@spark.apache.org/msg44793.html More info on tuning shuffle behavior: https://spark.apache.org/docs/1.5.1/configuration.html#shuffle-behavior On Thu, Jun 16, 2016 at 1:57 PM, Cassa L <lcas...@gmail.com> wrote: > Hi Dennis, > > On Wed, Jun 15, 2016 at 11:39 PM, D

Re: Spark Memory Error - Not enough space to cache broadcast

2016-06-16 Thread Dennis Lovely
You could try tuning spark.shuffle.memoryFraction and spark.storage.memoryFraction (both of which have been deprecated in 1.6), but ultimately you need to find out where you are bottlenecked and address that as adjusting memoryFraction will only be a stopgap. both shuffle and storage

Re: Cassandra metrics Graphite

2014-12-17 Thread Dennis Lovely
Hi Nigel, I'm using Casssandra 2.0.7 and in Cassandra lib directory, I'm dropping in this reporter jar: http://search.maven.org/#artifactdetails|com.yammer.metrics|metrics-graphite|2.2.0|jar My cass metrics are flowing in properly into Graphite 0.9.10. Here's my metrics yaml: graphite: -