Re: Images store in Cassandra

2009-12-13 Thread Mark Robson
2009/12/13 Tatu Saloranta tsalora...@gmail.com On Sat, Dec 12, 2009 at 3:08 PM, Ryan King r...@twitter.com wrote: On Sat, Dec 12, 2009 at 12:05 PM, Ran Tavory ran...@gmail.com wrote: As we're designing our systems for a move from mysql to Cassandra we're considering moving our file storage

RE: OOM Exception

2009-12-13 Thread Brian Burruss
another OOM exception. the only thing interesting about my testing is that there are 2 servers, RF=2, W=1, R=1 ... there is 248G of data on each server. I have -Xmx3G assigned to each server 2009-12-12 22:04:37,436 ERROR [pool-1-thread-309] [Cassandra.java:734] Internal error processing get

Re: OOM Exception

2009-12-13 Thread Dan Di Spaltro
What consistencyLevel are you inserting the elements? If you do ./bin/nodeprobe -host localhost tpstats on each machine do you see one metric that has a lot of pending items? On Sun, Dec 13, 2009 at 8:14 AM, Brian Burruss bburr...@real.com wrote: another OOM exception. the only thing

Re: OOM Exception

2009-12-13 Thread Stu Hood
PS: If this turns out to actually be the problem, I'll open a ticket for it. Thanks, Stu -Original Message- From: Stu Hood stuart.h...@rackspace.com Sent: Sunday, December 13, 2009 12:28pm To: cassandra-user@incubator.apache.org Subject: Re: OOM Exception With 248G per box, you probably

Re: OOM Exception

2009-12-13 Thread gabriele renzi
On Sun, Dec 13, 2009 at 7:28 PM, Stu Hood stuart.h...@rackspace.com wrote: With 248G per box, you probably have slightly more than 1/2 billion items? One current implementation detail in Cassandra is that it loads 128th of the index into memory for faster lookups. This means you might have

RE: OOM Exception

2009-12-13 Thread Brian Burruss
i don't have a problem increasing memory, just need a rough formula for how much to expect to use. anyone recommend a good heap walker? i can then tell you what is taking the memory. thx! Node 1 -- Pool NameActive Pending Completed FILEUTILS-DELETE-POOL

RE: read latency creaping up

2009-12-13 Thread Brian Burruss
if this isn't a known issue, lemme do some more investigating. my test client becomes more random with reads as time progresses, so possibly this is what causes the latency issue. however, all that being said, the performance really becomes bad after a while.

Re: Images store in Cassandra

2009-12-13 Thread Michael Koziarski
On Sun, Dec 13, 2009 at 9:05 AM, Ran Tavory ran...@gmail.com wrote: As we're designing our systems for a move from mysql to Cassandra we're considering moving our file storage to Cassandra as well. Is this wise? We're currently using mogilefs to store media items (images) of average size of

Exception on get_range_slice No idea !!

2009-12-13 Thread Richard Grossman
Hi, I've build a DB as I've made with 0.4.2 now with this code : final SliceRange sliceRange = new SliceRange(limitsChannel[0].getBytes(UTF-8), limitsChannel[1].getBytes(UTF-8), false, headendsChannelList.size()); SlicePredicate predicateKeys = new

Re: Exception on get_range_slice No idea !!

2009-12-13 Thread Richard Grossman
Ok Thanks I've see your post in JIRA it seems to be the saqme problem if I change final SliceRange sliceRange = new SliceRange(limitsChannel[0]. getBytes(UTF-8), limitsChannel[1].getBytes(UTF-8), false, headendsChannelList.size()); by final SliceRange sliceRange = new

Get_count method error?

2009-12-13 Thread JKnight JKnight
Dear all, I found method get_count still count deleted column. Is this an error? get_count - i32 get_count(keyspace, key, column_parent, consistency_level) Counts the columns present in column_parent. -- Best regards, JKnight