Pending tasks are not being processed.

2014-09-04 Thread Pavel Kogan
Hi all, Yesterday I put a lot of blobs into Cassandra and it created many, probably compaction, pending tasks (few hundreds according to Ops Center). On all nodes all pending tasks were eventually processed, but on one problematic, I see no related activity. Problematic node seems to be

Re: Pending tasks are not being processed.

2014-09-04 Thread Pavel Kogan
Should I experience any problems even if split versions vary only by minor digit? After another restart of node, it seems that the problem was solved somehow. Regards, Pavel On Thu, Sep 4, 2014 at 1:59 PM, Robert Coli rc...@eventbrite.com wrote: On Thu, Sep 4, 2014 at 8:09 AM, Pavel Kogan

system.peers table was not updated

2014-09-03 Thread Pavel Kogan
We use Cassandra 2.0.8. Probably after decommissioning nodes long time ago, but I am not sure. We are not using this cluster intensively. According to Jira, this problem was fixed in 2.0.5 https://issues.apache.org/jira/browse/CASSANDRA-6053 Anyway, I truncated peers table and restarted one node

Re: system.peers table was not updated

2014-09-03 Thread Pavel Kogan
I tried cqlsh command on other nodes and you are right! I had no idea that cqlsh results could be node dependent. Thanks, Pavel On Wed, Sep 3, 2014 at 10:54 AM, Tyler Hobbs ty...@datastax.com wrote: On Wed, Sep 3, 2014 at 6:44 AM, Pavel Kogan pavel.ko...@cortica.com wrote: Why peers

Re: Commitlog files are not being deleted

2014-08-29 Thread Pavel Kogan
Thanks Robert. On Thu, Aug 28, 2014 at 6:32 PM, Robert Coli rc...@eventbrite.com wrote: On Thu, Aug 28, 2014 at 3:31 PM, Pavel Kogan pavel.ko...@cortica.com wrote: Shouldn't all commitlog files be auto deleted after replaying, for example after node restart? Using Cassandra 2.0.8

Commitlog files are not being deleted

2014-08-28 Thread Pavel Kogan
Hi all, Shouldn't all commitlog files be auto deleted after replaying, for example after node restart? Using Cassandra 2.0.8 Thanks, Pavel

Re: C* 2.1-rc2 gets unstable after a 'DROP KEYSPACE' command ?

2014-07-10 Thread Pavel Kogan
It seems that memtable tries to flush itself to SSTable of not existing keyspace. I don't know why it is happens, but probably running nodetool flush before drop should prevent this issue. Pavel On Thu, Jul 10, 2014 at 4:09 AM, Fabrice Larcher fabrice.larc...@level5.fr wrote: ​Hello, I am

Re: Size-tiered Compaction runs out of memory

2014-07-10 Thread Pavel Kogan
Moving to Leveled compaction resolved same problem for us. As Robert mentioned, use it carefully. Size tiered compaction requires having 50% free disk space (also according to datastax documentation). Pavel On Wed, Jul 9, 2014 at 8:39 PM, Robert Coli rc...@eventbrite.com wrote: On Wed, Jul 9,

Merging keyspaces

2014-06-27 Thread Pavel Kogan
Hi all, I want to merge one keyspace (A) data into another (B) with exactly same scheme. The partition keys of all records are unique in both keyspaces. Can I just copy all files under keyspace A column families into keyspace B column families folders, after running nodetool flush? Is filenames

Re: Merging keyspaces

2014-06-27 Thread Pavel Kogan
can select any number? Regards, Pavel On Fri, Jun 27, 2014 at 1:35 PM, Robert Coli rc...@eventbrite.com wrote: On Fri, Jun 27, 2014 at 8:28 AM, Pavel Kogan pavel.ko...@cortica.com wrote: I want to merge one keyspace (A) data into another (B) with exactly same scheme. The partition keys

Re: Merging keyspaces

2014-06-27 Thread Pavel Kogan
Thanks Robert. On Fri, Jun 27, 2014 at 2:21 PM, Robert Coli rc...@eventbrite.com wrote: On Fri, Jun 27, 2014 at 10:57 AM, Pavel Kogan pavel.ko...@cortica.com wrote: So basically when I rename all files during merge of keyspaces, I will substitute dest keyspace, column family is the same

Re: Storing values of mixed types in a list

2014-06-24 Thread Pavel Kogan
1) You can use list of strings which are serialized JSONs, or use ByteBuffer with your own serialization as Jeremy suggested. 2) Use Cassandra 2.1 (not officially released yet) were there is new feature of user defined types. Pavel On Tue, Jun 24, 2014 at 9:18 AM, Jeremy Jongsma

Re: Using Cassandra as cache

2014-06-23 Thread Pavel Kogan
sn...@snazy.de wrote: Am 21.06.2014 um 00:37 schrieb Pavel Kogan pavel.ko...@cortica.com: Thanks, Is there any code way to know when the scheme finished to settle down? Yep - take a look at com.datastax.driver.core.ControlConnection#waitForSchemaAgreement in the Java Driver source

Re: Batch of prepared statements exceeding specified threshold

2014-06-20 Thread Pavel Kogan
Valle marc...@s1mbi0se.com.br wrote: Pavel, Out of curiosity, did it start to happen before some update? Which version of Cassandra are you using? []s 2014-06-19 16:10 GMT-03:00 Pavel Kogan pavel.ko...@cortica.com: What a coincidence! Today happened in my cluster of 7 nodes as well

Re: Batch of prepared statements exceeding specified threshold

2014-06-20 Thread Pavel Kogan
? Is it taking much more time to run each time it runs? I am no Cassandra expert, but I would try these things first and post the results here. Maybe other people in the list have more ideas. Best regards, Marcelo. 2014-06-20 8:50 GMT-03:00 Pavel Kogan pavel.ko...@cortica.com: The cluster

Re: Batch of prepared statements exceeding specified threshold

2014-06-20 Thread Pavel Kogan
the heap. Anyone else? But did you check the logs for the GCInspector? In my case, nodes are falling because of the heap, in your case, maybe it's something else. Do you see increased times when looking for GCInspector in the logs? []s 2014-06-20 14:51 GMT-03:00 Pavel Kogan pavel.ko

Re: Batch of prepared statements exceeding specified threshold

2014-06-20 Thread Pavel Kogan
atomicity, resolved the issue for me. http://mail-archives.apache.org/mod_mbox/cassandra-commits/201404.mbox/%3ceee5dd5bc4794ef0b5c5153fdb583...@git.apache.org%3E On Fri, Jun 20, 2014 at 3:55 PM, Pavel Kogan pavel.ko...@cortica.com wrote: Logged batch. On Fri, Jun 20, 2014 at 2:13 PM, DuyHai Doan

Using Cassandra as cache

2014-06-20 Thread Pavel Kogan
Hi, In our project, many distributed modules sending each other binary blobs, up to 100-200kb each in average. Small JSONs are being sent over message queue, while Cassandra is being used as temporary storage for blobs. We are using Cassandra instead of in memory distributed cache like Couch due

Re: Using Cassandra as cache

2014-06-20 Thread Pavel Kogan
, but not folders? Correct? Pavel On Fri, Jun 20, 2014 at 6:01 PM, Robert Coli rc...@eventbrite.com wrote: On Fri, Jun 20, 2014 at 2:48 PM, Pavel Kogan pavel.ko...@cortica.com wrote: So what we did is creating every hour new keyspace named _MM_dd_HH and when disk becomes full, script running

Re: Using Cassandra as cache

2014-06-20 Thread Pavel Kogan
On Fri, Jun 20, 2014 at 6:01 PM, Robert Stupp sn...@snazy.de wrote: Am 20.06.2014 um 23:48 schrieb Pavel Kogan pavel.ko...@cortica.com: 1) When new keyspace with its columnfamilies is being just created (every round hour), sometimes other modules failed to read/write data, and we lose

Re: Batch of prepared statements exceeding specified threshold

2014-06-19 Thread Pavel Kogan
What a coincidence! Today happened in my cluster of 7 nodes as well. Regards, Pavel On Wed, Jun 18, 2014 at 11:13 AM, Marcelo Elias Del Valle marc...@s1mbi0se.com.br wrote: I have a 10 node cluster with cassandra 2.0.8. I am taking this exceptions in the log when I run my code. What my