RE: Can SSTables overlap with SizeTieredCompactionStrategy?

2014-05-22 Thread Phil Luckhurst
Definitely no TTL and records are only written once with no deletions. Phil DuyHai Doan wrote Are you sure there is no TTL set on your data? It might explain the shrink in sstable size after compaction. -- View this message in context:

Change number of vnodes on an existing cluster

2014-05-22 Thread Phil Luckhurst
We have a 3 node 2.0.7 cluster with RF=3. At the moment these are configured to have the default 256 vnodes we'd like to try reducing that to see what effect it has on some of our CQL query times. It seems from CASSANDRA-7057 https://issues.apache.org/jira/browse/CASSANDRA-7057 that there is

Managing truststores with inter-node encryption

2014-05-22 Thread Jeremy Jongsma
The docs say that each node needs every other node's certificate in its local truststore: http://www.datastax.com/documentation/cassandra/1.2/cassandra/security/secureSSLCertificates_t.html This seems like a bit of a headache for adding nodes to a cluster. How do others deal with this? 1) If I

RE: Can SSTables overlap with SizeTieredCompactionStrategy?

2014-05-22 Thread Andreas Finke
Hi Phil, I found an interesting blog entry that may address your problem. http://www.datastax.com/dev/blog/optimizations-around-cold-sstables It seems that compaction is skipped for stables which so mit satisfy a certain read rate. Please check. Kind regards Andreas Finke Java Developer

Re: Change number of vnodes on an existing cluster

2014-05-22 Thread Robert Coli
On Thu, May 22, 2014 at 4:31 AM, Phil Luckhurst phil.luckhu...@powerassure.com wrote: We have a 3 node 2.0.7 cluster with RF=3. At the moment these are configured to have the default 256 vnodes we'd like to try reducing that to see what effect it has on some of our CQL query times. Because

Re: autoscaling cassandra cluster

2014-05-22 Thread Robert Coli
On Wed, May 21, 2014 at 4:35 AM, Jabbar Azam aja...@gmail.com wrote: Has anybody got a cassandra cluster which autoscales depending on load or times of the day? Netflix probably does, managed with Priam. In general I personally do not consider Cassandra's mechanisms for joining and parting

Re: Is the tarball for a given release in a Maven repository somewhere?

2014-05-22 Thread Chris Burroughs
Maven central has bin.tar.gz src.tar.gz downloads for the 'apache-cassandra' artifact. Does that work for your use case? http://search.maven.org/#search%7Cga%7C1%7Ca%3A%22apache-cassandra%22 On 05/20/2014 05:30 PM, Clint Kelly wrote: Hi all, I am using the maven assembly plugin to build a

Re: Cassandra pre 2.1 vs 2.1 counter implementation

2014-05-22 Thread Robert Coli
On Wed, May 21, 2014 at 1:15 PM, Localhost shell universal.localh...@gmail.com wrote: I am new to C* community. We are planning to use Datastax C* (pre 2.1) in production. We heavily use counters and it is mostly what we do apart from storing the few months raw logs in C*.

Re: How to enable a Cassandra node to participate in multiple cluster

2014-05-22 Thread Wojciech Meler
As far as I know nodes are identified by ip address and ports defined in yaml. If you carefully prepare configuraton you should be able to run multiple Cassandra processes on single box participating in different clusters. If you decide to use separate ip address and default ports it should be

Re: Is the tarball for a given release in a Maven repository somewhere?

2014-05-22 Thread Clint Kelly
Probably! I'll give that a try, thanks! On Thu, May 22, 2014 at 12:11 PM, Chris Burroughs chris.burrou...@gmail.com wrote: Maven central has bin.tar.gz src.tar.gz downloads for the 'apache-cassandra' artifact. Does that work for your use case?

Re: autoscaling cassandra cluster

2014-05-22 Thread Jabbar Azam
Netflix uses Scryer http://techblog.netflix.com/2013/11/scryer-netflixs-predictive-auto-scaling.htmlfor predictive and reactive autoscaling but they only refer to EC2 instances. They don't mention anything about cassandra scaling or adding and removing nodes. I've just looked at the priam wiki

Re: CassandraStorage loader generating 2x many record?

2014-05-22 Thread Robert Coli
On Tue, May 20, 2014 at 1:44 PM, Kevin Burton bur...@spinn3r.com wrote: This has to be a bug or either that or I'm insane. If it turns out you're not insane (;D) I suggest filing a JIRA ticket with your repro steps at : http://issues.apache.org =Rob

Re: Change number of vnodes on an existing cluster

2014-05-22 Thread Phil Luckhurst
Thanks Rob, I didn't realize that you could use the initial_token when using vnodes. I see what you mean now that with RF=N having multiple vnodes is not actually achieving anything unless we add further nodes, we hadn't really considered that when we initially installed with the default yaml

RE: Can SSTables overlap with SizeTieredCompactionStrategy?

2014-05-22 Thread Phil Luckhurst
Hi Andreas, So does that mean it can compact the 'hottest' partitions into a new sstable but the old sstables may not immediately be removed so the same data could be in more that one sstable? That would certainly explain the difference we see when we manually run nodetool compact. Thanks Phil

Re: Change number of vnodes on an existing cluster

2014-05-22 Thread Robert Coli
On Thu, May 22, 2014 at 2:16 PM, Phil Luckhurst phil.luckhu...@powerassure.com wrote: Thanks Rob, I didn't realize that you could use the initial_token when using vnodes. I am planning to write a blog post on the always-specify-initial_token best practice. It protects users in a variety of

Re: Memory issue

2014-05-22 Thread opensaf dev
Well Romain, I had tried restarting the VM as well but problem still remained. What I noticed is after sometime irrespective I run cassandra from other user or using the normal cassandra the problem still remains. As soon as it starts, the JVM is get killed because of memory issue. Is there some