Compaction: pending tasks are stuck

2013-07-08 Thread Steffen Rusitschka
Hi cassandra list, we are having in issue in one of our Cassandra clusters where all 3 nodes with RF 3 have 22 pending tasks (nodetool compactionstats) since mid of April that are never be executed. Even after a restart they show up. It started with Cassandra 1.1.10 and on Friday we've

Purpose of BLOB datatype

2013-07-08 Thread Pavel Kirienko
Hi all, I am curious why there is BLOB datatype that accepts HEX strings only. HEX encoding requires twice as much space as original data, thus it is rather ineffective. Instead, base64 encoding with ASCII datatype seems more effective in terms of space, and I believe it doesn't impose

Re: Compaction: pending tasks are stuck

2013-07-08 Thread Radim Kolar
Without manual flush the CPU goes mad after a couple of hours on each instance. increase heap size

Re: Compaction: pending tasks are stuck

2013-07-08 Thread Steffen Rusitschka
The heap size is 3GB and the GC has to run only every 30 minutes... I'm pretty sure increasing heap won't help. Am 08.07.2013 11:15, schrieb Radim Kolar: Without manual flush the CPU goes mad after a couple of hours on each instance. increase heap size -- Steffen Rusitschka CTO MegaZebra

Re: Purpose of BLOB datatype

2013-07-08 Thread Sylvain Lebresne
If you do have blobs, the preferred way is to not encode them in strings at all, but rather to use prepared statement (which don't involve a conversion to string). -- Sylvain On Mon, Jul 8, 2013 at 11:07 AM, Pavel Kirienko pavel.kirienko.l...@gmail.com wrote: Hi all, I am curious why there

Re: Purpose of BLOB datatype

2013-07-08 Thread Pavel Kirienko
If you do have blobs, the preferred way is to not encode them in strings at all, but rather to use prepared statement (which don't involve a conversion to string). Awesome. Thanks. On Mon, Jul 8, 2013 at 1:44 PM, Sylvain Lebresne sylv...@datastax.comwrote: If you do have blobs, the

Re: CQL and IN

2013-07-08 Thread Oleksandr Petrov
Hi Tony, you can check out a guide here: http://clojurecassandra.info/articles/kv.html which explains pretty most of things you need to know about queries for starters. It includes CQL code examples, just disregard Clojure ones, there's nothing strictly Clojure-driver specific in that guide. On

Working with libcql

2013-07-08 Thread Shubham Mittal
Hi, I found out that there exist a C++ client libcql for cassandra but its github repository just provides the example on how to connect to cassandra. Is there anyone who has written some code using libcql to read and write data to a cassandra DB, kindly share it. Thanks

Re: CassandraDaemon - recent unsafe memory access operation in compiled Java code

2013-07-08 Thread Glyn Davies
Hi, Yes, this continues without the JNA jar. In fact, the only thing which cured it was a reboot (!) Some serious dark magic going on there, as there were no Java processes running and nothing held the cassandra files open. I found a couple of Java dump texts, and opened an Java bug with one

Re: unsubscribe

2013-07-08 Thread Robert Coli
On Sun, Jul 7, 2013 at 8:26 PM, casablinca126.com casabli...@126.comwrote: unsubscribe http://wiki.apache.org/cassandra/FAQ#unsubscribe =Rob

does anyone store large values in cassandra e.g. 100kb?

2013-07-08 Thread S Ahmed
I'm guessing that most people use cassandra to store relatively smaller payloads like 1-5kb in size. Is there anyone using it to store say 100kb (1/10 of a megabyte) and if so, was there any tweaking or gotchas that you ran into?

Re: does anyone store large values in cassandra e.g. 100kb?

2013-07-08 Thread Nate McCall
100kb should be fine. For larger values, there's been a lot of people doing file chunking for a while now. The Astyanax folks have a recipe for this: https://github.com/Netflix/astyanax/wiki/Chunked-Object-Store The DataStax Enterprise CassandraFileSystem impl works similarly. Your intuition is

Re: does anyone store large values in cassandra e.g. 100kb?

2013-07-08 Thread Peter Lin
I regularly store word and pdf docs in cassandra without any issues. On Mon, Jul 8, 2013 at 1:46 PM, S Ahmed sahmed1...@gmail.com wrote: I'm guessing that most people use cassandra to store relatively smaller payloads like 1-5kb in size. Is there anyone using it to store say 100kb (1/10

Re: does anyone store large values in cassandra e.g. 100kb?

2013-07-08 Thread S Ahmed
Hi Peter, Can you describe your environment, # of documents and what kind of usage pattern you have? On Mon, Jul 8, 2013 at 2:06 PM, Peter Lin wool...@gmail.com wrote: I regularly store word and pdf docs in cassandra without any issues. On Mon, Jul 8, 2013 at 1:46 PM, S Ahmed

playORM version 1.6 released

2013-07-08 Thread Hiller, Dean
Another new release is up in maven repos… - Astyanx is upgraded to 1.56.42 - Hbase support is almost done(barring those few test cases) - And following issues are fixed: Thanks to snazy and hsn10 :) https://github.com/deanhiller/playorm/issues/80 https://github.com/deanhiller/playorm/issues/81

Re: General doubts about bootstrap

2013-07-08 Thread Robert Coli
On Sat, Jul 6, 2013 at 1:50 PM, Rodrigo Felix rodrigofelixdealme...@gmail.com wrote: - Is it normal to take about 9 minutes to add a new node? Follows the log generated by a script to add a new node. Sure. - Is there a way to reduce the time to start cassandra? Not usually.

Re: Migrating data from 2 node cluster to a 3 node cluster

2013-07-08 Thread Robert Coli
On Fri, Jul 5, 2013 at 7:54 PM, srmore comom...@gmail.com wrote: RF of old and new cluster is the same RF=3. Keyspaces and schema info is also same. You have a cluster where RF=3 and N=2? Does it.. work? What are the tokens of old and new nodes? tokens for old cluster ( 2-node ) If RF=N

Re: Cassandra intermittant with query in 1.2.5...

2013-07-08 Thread Robert Coli
On Sat, Jul 6, 2013 at 10:57 PM, Tony Anecito adanec...@yahoo.com wrote: I better understand the issue now with secondary index query and Cassadra 1.2.5. not returnng rows. I did some more testng of the issue mentioned below and discovered a very repeatable sequence and it is as follows:

Re: Cassandra intermittant with query in 1.2.5...

2013-07-08 Thread Tony Anecito
Thanks Robert I will do that. I already filled out a question with the initial info via the forum seeing if I was doing something wrong. I did see a reference to the issue but it was not repeatable. I am thinking there is a very serious bug that would worry all Cassandra users if they read this

Re: Cassandra intermittant with query in 1.2.5...

2013-07-08 Thread Tony Anecito
I will try the pre-prod environment to see what happens.   I filed the issue in JIRA.   Thanks! From: Tony Anecito adanec...@yahoo.com To: Robert Coli rc...@eventbrite.com; user@cassandra.apache.org user@cassandra.apache.org Sent: Monday, July 8, 2013 3:18 PM Subject: Re: Cassandra intermittant

Re: Migrating data from 2 node cluster to a 3 node cluster

2013-07-08 Thread sankalp kohli
If RF=N or RFN, you can just copy all SStables to all nodes, watching out for name collision. This might work for user created keyspaces but might not work for system keyspace On Mon, Jul 8, 2013 at 2:07 PM, Robert Coli rc...@eventbrite.com wrote: On Fri, Jul 5, 2013 at 7:54 PM, srmore

Re: Cassandra intermittant with query in 1.2.5...

2013-07-08 Thread Robert Coli
On Mon, Jul 8, 2013 at 2:39 PM, Tony Anecito adanec...@yahoo.com wrote: I filed the issue in JIRA. For those playing along at home : https://issues.apache.org/jira/browse/CASSANDRA-5732 =Rob

Re: Migrating data from 2 node cluster to a 3 node cluster

2013-07-08 Thread aaron morton
This might work for user created keyspaces but might not work for system keyspace Leaving the system keyspaces behind is OK if you are not using vnodes. Cheers - Aaron Morton Freelance Cassandra Consultant New Zealand @aaronmorton http://www.thelastpickle.com On 9/07/2013,

Re: CassandraDaemon - recent unsafe memory access operation in compiled Java code

2013-07-08 Thread aaron morton
Glyn, For tracking purposes could you create an issue on https://issues.apache.org/jira/browse/CASSANDRA and link to the ticket your raised. Just incase something has to change when memmapping. Cheers - Aaron Morton Freelance Cassandra Consultant New

Re: Working with libcql

2013-07-08 Thread aaron morton
Did you see the demo app ? Seems to have a few examples of reading data. https://github.com/mstump/libcql/blob/master/demo/main.cpp#L85 Cheers - Aaron Morton Freelance Cassandra Consultant New Zealand @aaronmorton http://www.thelastpickle.com On 9/07/2013, at 1:14 AM,

Re: Compaction: pending tasks are stuck

2013-07-08 Thread aaron morton
It started with Cassandra 1.1.10 and on Friday we've migrated to 1.2.6 and now we have the issue that flushes are no longer executed automatically - we have to do them every hour by hand (nodetool flush) in order to keep the nodes on an acceptable utilizatzion level. Without manual flush

Re: Migrating data from 2 node cluster to a 3 node cluster

2013-07-08 Thread sankalp kohli
Leaving the system keyspaces behind is OK if you are not using vnodes. Why is it different for vnodes? On Mon, Jul 8, 2013 at 3:37 PM, aaron morton aa...@thelastpickle.comwrote: This might work for user created keyspaces but might not work for system keyspace Leaving the system keyspaces

Trying to write when at cassandra capacity

2013-07-08 Thread Faraaz Sareshwala
What does cassandra do when it is at its data capacity (disk drives and memtable is full) and writes continue to pour in? My intuition says that cassandra won't be able to handle the new writes (they will either get silently dropped or cassandra will hit an OOM -- does anyone know which one?). The

Node tokens / data move

2013-07-08 Thread Baskar Duraikannu
We have two clusters used by two different groups with vnodes enabled. Now there is a need to move some of the keyspaces from cluster 1 to cluster 2. Can I just copy data files for the required keyspaces, create schema manually and run repair? Anything else required? Please help. --

Re: Trying to write when at cassandra capacity

2013-07-08 Thread sankalp kohli
I dont know what exactly will happen. These are the things which might happen 1) Commit log on disk gets recycled so I am assuming it might keep working. 2) SStable wont be able to create new files so it will see an IO exception. On Mon, Jul 8, 2013 at 5:58 PM, Faraaz Sareshwala

Re: Migrating data from 2 node cluster to a 3 node cluster

2013-07-08 Thread aaron morton
Without vnodes the initial_token is stored in the yaml file, as well as the system LocationInfo CF. With vnodes the only place the tokens are stored is in the system KS. So moving a node without it's system KS will cause it to generate new ones which will mean data is moved around. Cheers