Getting stats of keyspaces

2012-07-16 Thread Thierry Templier
Hello, I wonder if it's possible to get statistics for a keyspace like its size, size of each column family it contains. It's something I'd like from a request... Thanks very much for your help. Thierry

Cassandra occupy over 80% CPU when take a compaction

2012-07-16 Thread 黄荣桢
Hello, I find the compaction of my secondary index takes a long time and occupy a lot of CPU. INFO [CompactionExecutor:8] 2012-07-16 12:03:16,408 CompactionTask.java (line 213) Compacted to [XXX]. 71,018,346 to 9,020 (~0% of original) bytes for 3 keys at 0.22MB/s. Time: 397,602ms. The

Re: Enable CQL3 from Astyanax

2012-07-16 Thread Thierry Templier
Hello Aaron, I try to simulate a composition relationship within a single column family / table (for example, an entity and its fields). I dynamically add columns the contained elements. Let's take an example. Here is my table definition with CQL 3: CREATE TABLE Entity ( id varchar,

Re: High RecentWriteLatencyMicro

2012-07-16 Thread aaron morton
The write path for counters is different than non counter fields, for background http://www.datastax.com/wp-content/uploads/2011/07/cassandra_sf_counters.pdf The write is applied on the leader *and then* replicated to the other replicas. This was controlled by a config setting called

Re: How to come up with a predefined topology

2012-07-16 Thread aaron morton
Is the above understanding correct ? yes, sorry. Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 13/07/2012, at 4:24 PM, prasenjit mukherjee wrote: On Fri, Jul 13, 2012 at 4:04 AM, aaron morton aa...@thelastpickle.com wrote: The logic

Re: bootstrapping problem. 1.1.2 version

2012-07-16 Thread aaron morton
Check net stats a few times to look for progress, if there is none take a look at the logs on both sides for errors. Hope that helps. - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 14/07/2012, at 10:53 PM, Michael Cherkasov wrote: Hi all,

Re: bootstrapping problem. 1.1.2 version

2012-07-16 Thread Michael Cherkasov
I found this error: ERROR [Streaming to /192.168.36.25:10] 2012-07-16 16:26:25,206 AbstractCassandraDaemon.java (line 134) Exception in thread Thread[Streaming to /192.168.36.25:10,5,main] java.lang.IllegalStateException: target reports current file is

Bulk Loading with Composite Column Slow?

2012-07-16 Thread Brian Reynolds
Hi I'm using Cassandra 1.1.0 from Datastax and attempting to load a ColumnFamily with a single column with a Composite name. It seems to load ok, but is much slower than similar code without the composite column. I tried building the Composite outside the while loop and just copying it before

Re: Never ending manual repair after adding second DC

2012-07-16 Thread Bart Swedrowski
On 16 July 2012 11:25, aaron morton aa...@thelastpickle.com wrote: In the before time someone had problems with a switch/router that was dropping persistent but idle connections. Doubt this applies, and it would probably result in an error, just throwing it out there. Yes, been through them

Snapshot issue in Cassandra 0.8.1

2012-07-16 Thread Adeel Akbar
Hi, I have created snapshot with following command; #./nodetool -h localhost snapshot cassandra_01_bkup but the problem is, the snapshot is created on snapshot folder with different name (like 1342269988711) and I have no idea that if I used this command in script then how I gzip snapshot

Re: Never ending manual repair after adding second DC

2012-07-16 Thread Bill Au
I had ran into the same problem before: http://comments.gmane.org/gmane.comp.db.cassandra.user/25334 I have not fond any solutions yet. Bill On Mon, Jul 16, 2012 at 11:10 AM, Bart Swedrowski b...@timedout.org wrote: On 16 July 2012 11:25, aaron morton aa...@thelastpickle.com wrote: In

high i/o usage on one node

2012-07-16 Thread feedly team
I am having an issue where one node of a 2 node cluster seems to be using much more I/O than the other node. the cassandra read/write requests seem to be balanced, but iostat shows the data disk to be maxed at 100% utilization for one machine and 50% for the other. r/s to be about 3x greater on

Truncate failing with 1.0 client against 0.7 cluster

2012-07-16 Thread Guy Incognito
i'm doing an upgrade of Cassandra 0.7 to 1.0 at the moment, and as part of the preparation i'm upgrading to 1.0 client libraries (we use Hector 1.0-5) prior to upgrading the cluster itself. I'm seeing some of our integration tests against the dev 0.7 cluster fail as they get

Re: Cassandra occupy over 80% CPU when take a compaction

2012-07-16 Thread aaron morton
Are you able to put together a test case, maybe using the stress testing tool, that models your data layout? If so can you add it to https://issues.apache.org/jira/browse/CASSANDRA-3592 Thanks - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On

Re: bootstrapping problem. 1.1.2 version

2012-07-16 Thread aaron morton
DC located in different environments one on Win7 other on Linux. Running different operating systems is not supported. Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 17/07/2012, at 12:30 AM, Michael Cherkasov wrote: I found this

Re: Snapshot issue in Cassandra 0.8.1

2012-07-16 Thread aaron morton
#./nodetool -h localhost snapshot cassandra_01_bkup tells cassandra to snapshot the keyspace called cassandra_01_bkup To specify a name for the snapshot us the -t option snapshot [keyspaces...] -t [snapshotName] - Take a snapshot of the specified keyspaces using optional name snapshotName

Re: Never ending manual repair after adding second DC

2012-07-16 Thread aaron morton
Even if it is a network error it would be good to detect it. If you can run a small repair with those log settings I'll can take a look at the logs if you want. Cannot promise anything but another set of eyes may help. Ping me off list if you want to send me the logs. Cheers

Re: high i/o usage on one node

2012-07-16 Thread aaron morton
Is you client balancing between the two nodes ? Heavy writes at CL ONE could result in nodes dropping messages and having an unbalanced load. Are you sure there is nothing else running on the machines ? Just for fun have you turned off GC logging to see the impact ? Is there swapping going on

Re: Truncate failing with 1.0 client against 0.7 cluster

2012-07-16 Thread aaron morton
UnavailableException is a server side error, whats the full error message ? Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 17/07/2012, at 5:31 AM, Guy Incognito wrote: i'm doing an upgrade of Cassandra 0.7 to 1.0 at the moment, and as

2 nodes throwing exceptions trying to compact after upgrade to 1.1.2 from 1.1.0

2012-07-16 Thread Bryce Godfrey
This may not be directly related to the upgrade to 1.1.2, but I was running on 1.1.0 for a while with no issues, and I did the upgrade to 1.1.2 a few days ago. 2 of my nodes started throwing lots of promote exceptions, and then a lot of the beforeAppend exceptions from then on every few

Re: 2 nodes throwing exceptions trying to compact after upgrade to 1.1.2 from 1.1.0

2012-07-16 Thread Rudolf van der Leeden
See https://issues.apache.org/jira/browse/CASSANDRA-4411 The bug is related to LCS (leveled compaction) and has been fixed. On 16.07.2012, at 20:32, Bryce Godfrey wrote: This may not be directly related to the upgrade to 1.1.2, but I was running on 1.1.0 for a while with no issues, and

RE: 2 nodes throwing exceptions trying to compact after upgrade to 1.1.2 from 1.1.0

2012-07-16 Thread Bryce Godfrey
Thanks, is there a way around this for now or should I fall back to 1.1.0? From: Rudolf van der Leeden [mailto:rudolf.vanderlee...@scoreloop.com] Sent: Monday, July 16, 2012 12:55 PM To: user@cassandra.apache.org Cc: Rudolf van der Leeden Subject: Re: 2 nodes throwing exceptions trying to

Re: Truncate failing with 1.0 client against 0.7 cluster

2012-07-16 Thread Guy Incognito
sorry i don't have the exact text right now but it's along the lines of 'not enough replicas available to handle the requested consistency level'. i'm requesting quorum but i've tried with one, and any and it made no difference. On 16/07/2012 19:30, aaron morton wrote: UnavailableException

Cassandra Evaluation/ Benchmarking: Throughput not scaling as expected neither latency showing good numbers

2012-07-16 Thread Code Box
I am doing Cassandra Benchmarking using YCSB for evaluating the best performance for my application which will be both read and write intensive. I have set up a three cluster environment on EC2 and i am using YCSB in the same availability region as a client. I have tried various combinations of

Re: 2 nodes throwing exceptions trying to compact after upgrade to 1.1.2 from 1.1.0

2012-07-16 Thread Rudolf van der Leeden
Stay with 1.1.2 and create your CF with compaction_strategy_class='SizeTieredCompactionStrategy' On 16.07.2012, at 22:17, Bryce Godfrey wrote: Thanks, is there a way around this for now or should I fall back to 1.1.0? From: Rudolf van der Leeden