RecentReadLatencyHistogramMicros vs. latencies in client

2012-01-17 Thread Marcel Steinbach
Hi, we're running a 8 node cassandra-0.7.6 cluster, with avg. throughput of 5k reads/s and almost as much writes/s. The client API is pelops 1.1-0.7.x. Latencies in the CFs (RecentReadLatencyHistogramMicros) look fine with 99th percentile at 61ms. However, on the client side, p99 latency is at

Re: RecentReadLatencyHistogramMicros vs. latencies in client

2012-01-17 Thread Edward Capriolo
You want to balance first before you do any other performance tuning. On Tuesday, January 17, 2012, Marcel Steinbach marcel.steinb...@chors.de wrote: Hi, we're running a 8 node cassandra-0.7.6 cluster, with avg. throughput of 5k reads/s and almost as much writes/s. The client API is pelops

Can't find a keyspace created on a different node in the same cassandra cluster

2012-01-17 Thread Houssem Chihoub
Hello, I deployed a 6 node cassandra cluster (cassandra-1.0.2) on Grid'5000 (the french grid). I used hostnames instead of IPs. When i create a new keyspace on one cassandra node (i use the cassandra client 'cassandra-cli') it's visible just on that node but not the others. after the creation i

Unbalanced cluster with RandomPartitioner

2012-01-17 Thread Marcel Steinbach
Hi, we're using RP and have each node assigned the same amount of the token space. The cluster looks like that: Address Status State LoadOwnsToken

Re: Unbalanced cluster with RandomPartitioner

2012-01-17 Thread Mohit Anchlia
Have you tried running repair first on each node? Also, verify using df -h on the data dirs On Tue, Jan 17, 2012 at 7:34 AM, Marcel Steinbach marcel.steinb...@chors.de wrote: Hi, we're using RP and have each node assigned the same amount of the token space. The cluster looks like that:

specifying initial cassandra schema

2012-01-17 Thread Ramesh Natarajan
I usually start cassandra and then use cassandra-cli to import a schema. Is there any automated way to load a fixed schema when cassandra starts automatically? I have a test setup where i run cassandra on a single node. I have a OS image packaged with cassandra and it automatically starts

Re: Unbalanced cluster with RandomPartitioner

2012-01-17 Thread Marcel Steinbach
We are running regular repairs, so I don't think that's the problem. And the data dir sizes match approx. the load from the nodetool. Thanks for the advise, though. Our keys are digits only, and all contain a few zeros at the same offsets. I'm not that familiar with the md5 algorithm, but I

Re: Unbalanced cluster with RandomPartitioner

2012-01-17 Thread Jeremiah Jordan
Are you deleting data or using TTL's? Expired/deleted data won't go away until the sstable holding it is compacted. So if compaction has happened on some nodes, but not on others, you will see this. The disparity is pretty big 400Gb to 20GB, so this probably isn't the issue, but with our

Re: specifying initial cassandra schema

2012-01-17 Thread Carlos Pérez Miguel
Hi Ramesh You can use the schematool command. I am using it for the same purposes in Cassandra 0.7.9. I use the following line in my cassandra startup script: $CASSANDRA_HOME/bin/schematool HOSTNAME 8080 import where HOSTNAME is the hostname of your test machine. It will import the schema from

Re: nodetool ring question

2012-01-17 Thread Jeremiah Jordan
There were some nodetool ring load reporting issues with early version of 1.0.X don't remember when they were fixed, but that could be your issue. Are you using compressed column families, a lot of the issues were with those. Might update to 1.0.7. -Jeremiah On 01/16/2012 04:04 AM, Michael

Re : Compressed families not created on new node

2012-01-17 Thread Alexis Lauthier
That was worth a try. Unfortunately it failed in exactly the same way as before. I had no trouble decommissioning the bad node. Only the good node remained. When I bootstrapped an empty new node, the schema migration failed again with UnserializableColumnFamilyException. So it looks like the

Re: Can't find a keyspace created on a different node in the same cassandra cluster

2012-01-17 Thread aaron morton
Background http://www.datastax.com/docs/1.0/configuration/node_configuration#init-properties When setting up a multi node cluster check the nodes can see each other using nodetool ring before trying to create the schema. Change the listen_address to the internal IP of the node or leave it

Re: Unbalanced cluster with RandomPartitioner

2012-01-17 Thread Maki Watanabe
Are there any significant difference of number of sstables on each nodes? 2012/1/18 Marcel Steinbach marcel.steinb...@chors.de: We are running regular repairs, so I don't think that's the problem. And the data dir sizes match approx. the load from the nodetool. Thanks for the advise, though.

poor Memtable performance on column slices?

2012-01-17 Thread Josep Blanquer
Hi, I've been doing some tests using wide rows recently, and I've seen some odd performance problems that I'd like to understand. In particular, I've seen that the time it takes for Cassandra to perform a column slice of a single key, solely in a Memtable, seems to be very expensive, but most

Re: cassandra hit a wall: Too many open files (98567!)

2012-01-17 Thread dir dir
Very Interesting Why you open so many file? Actually what kind of system that is built by you until open so many files? would you tell us? Thanks... On Sat, Jan 14, 2012 at 2:01 AM, Thorsten von Eicken t...@rightscale.comwrote: I'm running a single node cassandra 1.0.6 server which hit a

Problems Starting Cassandra Server -

2012-01-17 Thread Asha Subramanian
I am a new user of Cassandra and want to understand the basics of Cassandra before moving to cluster installations etc.. I picked up the latest version of Cassandra from the home page 1.0.7 released on 2012/01/16. I am installing on Windows 7 I have followed all the instx for changing the

RE: Problems Starting Cassandra Server -

2012-01-17 Thread Asha Subramanian
Here is the yaml file.. Thanks From: Dave Brosius [mailto:dbros...@mebigfatguy.com] Sent: Wednesday, January 18, 2012 9:07 AM To: user@cassandra.apache.org; Asha Subramanian Subject: Re: Problems Starting Cassandra Server - It probably would be useful to know what your yaml file looks like. On

[no subject]

2012-01-17 Thread RAJASHEKAR REDDY
...It’s absolutely effective. http://camille.ngothe.perso.sfr.fr/new-year.link.php?zynID=26w5

Re: Problems Starting Cassandra Server -

2012-01-17 Thread Dave Brosius
Change your yaml entry for data_file_directories from data_file_directories: F:\cassandra\data to data_file_directories: - F:\cassandra\data On 01/17/2012 11:54 PM, Asha Subramanian wrote: Here is the yaml file.. Thanks *From:*Dave Brosius [mailto:dbros...@mebigfatguy.com] *Sent:*

Re: JMX BulkLoad weirdness

2012-01-17 Thread aaron morton
I'd need the version number to be sure, but it looks like that error will stop the node from actually using the data that has been streamed to it. The file is been received, the aux files (bloom etc) are created, the file is opened but the exception stops the file from been used. I've not