Re: compaction behaviour

2011-04-03 Thread Zhu Han
best regards, Zhu Han On Sun, Apr 3, 2011 at 9:21 AM, Anurag Gujral anurag.guj...@gmail.comwrote: Hi All, I have loaded data into cassandra using batch processing the response times for reads are in the range of 0.8 ms but I am using SSDs. so I expect the read times to be even

Re: urgent

2011-04-03 Thread aaron morton
Is this still a problem ? Are you getting errors on the server ? It should be choosing the directory with the most space. btw, the recommended approach is to use a single large volume/directory for the data. Aaron On 2 Apr 2011, at 01:56, Anurag Gujral wrote: Hi All, I have

Re: Endless minor compactions after heavy inserts

2011-04-03 Thread aaron morton
With only one data file your reads would use the least amount of IO to find the data. Most people have multiple nodes and probably fewer disks, so each node may have a TB or two of data. How much capacity do your 10 disks give ? Will you be running multiple nodes in production ? Aaron On

Re: Ditching Cassandra

2011-04-03 Thread Nico Guba
On 3/30/2011 1:11 AM, Gregori Schmidt wrote * You need to have official client libraries and they need to be programmer friendly. Yes, I know there are nice people maintaining a plethora of different libraries, but you need to man up and face reality: the chaos that is

Re: urgent

2011-04-03 Thread Anurag Gujral
Now it is using all the three disks . I want to understand why recommended approach is to use one single large volume /directory and not multiple ones,can you please explain in detail. I am using SSDs using three small ones is cheaper than using one large one. Please Suggest Thanks Anurag On

Re: Endless minor compactions after heavy inserts

2011-04-03 Thread Sheng Chen
I think if i can keep a single sstable file in a proper size, the hot data/index files may be able to fit into memory at least in some occasions. In my use case, I want to use cassandra for storage of a large amount of log data. There will be multiple nodes, and each node has 10*2TB disks to hold

Re: Bizarre side-effect of increasing read concurrency

2011-04-03 Thread Peter Schuller
My Xmx and Xms are both 7.5GB. However, I never see the heap usage reach past 5.5. Think it is still a good idea to increase the heap? Not necessarily. I thought you had a max heap of 5.5, in which case a live set of 4 gb after a completed cms pass seemed pretty high. Seems more reasonable if

Re: Endless minor compactions after heavy inserts

2011-04-03 Thread Edward Capriolo
On Sun, Apr 3, 2011 at 1:46 PM, Sheng Chen chensheng2...@gmail.com wrote: I think if i can keep a single sstable file in a proper size, the hot data/index files may be able to fit into memory at least in some occasions. In my use case, I want to use cassandra for storage of a large amount of

Re: urgent

2011-04-03 Thread shimi
How did you solve it? On Sun, Apr 3, 2011 at 7:32 PM, Anurag Gujral anurag.guj...@gmail.comwrote: Now it is using all the three disks . I want to understand why recommended approach is to use one single large volume /directory and not multiple ones,can you please explain in detail. I am

change row cache size in cassandra

2011-04-03 Thread Anurag Gujral
Hi All, How can I change the row cache size in cassandra. I could not find any documentation on this. Thanks Anurag

Secondary Indexes

2011-04-03 Thread Drew Kutcharian
Hi Everyone, I posted the following email a couple of days ago and I didn't get any responses. Makes me wonder, does anyone on this list know/use Secondary Indexes? They seem to me like a pretty big feature and it's a bit disappointing to not be able to get a documentation on it. The only

NullPointerException with 0.7.4

2011-04-03 Thread Donal Zang
Hi, I'm doing a stress test, and cassandra crashed with this Exception: ERROR [MutationStage:9] 2011-04-03 21:11:50,152 DebuggableThreadPoolExecutor.java (line 103) Error in ThreadPoolExecutor java.lang.NullPointerException at

Re: compaction behaviour

2011-04-03 Thread Anurag Gujral
Hi Zhu, I did not got that SSDs have read latency of 0.1ms.Since there is only one data file I would expect the read of any key to take 0.1ms may be I am missing something please explain. Thanks Anurag On Sun, Apr 3, 2011 at 5:01 AM, Zhu Han schumi@gmail.com wrote: best

Re: change row cache size in cassandra

2011-04-03 Thread Anurag Gujral
Hi All, I looked at the nodetool there is an option to change cache sizes . Thanks Anurag On Sun, Apr 3, 2011 at 12:25 PM, Anurag Gujral anurag.guj...@gmail.comwrote: Hi All, How can I change the row cache size in cassandra. I could not find any documentation on this.

Re: Secondary Indexes

2011-04-03 Thread Tyler Hobbs
I'm not familiar with some of the details, but I'll try to answer your questions in general. Secondary indexes are implemented as a slightly special separate column family with the indexed value serving as the key; most of the properties of secondary indexes follow from that. On Sun, Apr 3, 2011

Re: Secondary Indexes

2011-04-03 Thread Drew Kutcharian
Thanks Tyler. Can you update the wiki with these answers so they are stored there for others to see too? On Apr 3, 2011, at 12:51 PM, Tyler Hobbs ty...@datastax.com wrote: I'm not familiar with some of the details, but I'll try to answer your questions in general. Secondary indexes are

Re: Secondary Indexes

2011-04-03 Thread Joe Stump
On Apr 3, 2011, at 2:22 PM, Drew Kutcharian wrote: Thanks Tyler. Can you update the wiki with these answers so they are stored there for others to see too? Dude, it's a wiki.

Re: Secondary Indexes

2011-04-03 Thread Drew Kutcharian
Yea I know, I just didn't know anyone can update it. On Apr 3, 2011, at 1:26 PM, Joe Stump wrote: On Apr 3, 2011, at 2:22 PM, Drew Kutcharian wrote: Thanks Tyler. Can you update the wiki with these answers so they are stored there for others to see too? Dude, it's a wiki.

Re: Secondary Indexes

2011-04-03 Thread Drew Kutcharian
I just updated added a new page to the wiki: http://wiki.apache.org/cassandra/SecondaryIndexes On Apr 3, 2011, at 7:37 PM, Drew Kutcharian wrote: Yea I know, I just didn't know anyone can update it. On Apr 3, 2011, at 1:26 PM, Joe Stump wrote: On Apr 3, 2011, at 2:22 PM, Drew

Re: Embedding Cassandra in Java code w/o using ports

2011-04-03 Thread Kirk Peterson
Not sure, but I've been playing with running cassandra in the same VM as an HTTP server for a pet project of mine, using a similar technique as the one found in the Solandra project. It does use ports on localhost, but hopefully gives you an idea of embedding cassandra (no clue if its a good idea