Re: Benchmarking Cassandra with YCSB

2011-02-19 Thread Markus Klems
Hi, we sorted out the performance problems and tuned the cluster. In particular, we identified the following weak spot in our setup: ConcurrentReads and ConcurrentWrites was set to the default values which were much too low for our setup. Now, we get some serious numbers. Thanks, Markus On

Re: Queries on secondary indexes

2011-02-19 Thread Rauan Maemirov
Hm, phpcassa works great, I guess that is the problem of cli. Now it doesn't return any rows at all. 2011/2/18 Rauan Maemirov ra...@maemirov.com With this schema: create column family Userstream with comparator=UTF8Type and rows_cached = 1 and keys_cached = 10 and

Re: simple erlang example

2011-02-19 Thread J T
HI Sasha, That was me that was going to try and put something on the wiki and I completely forgot about it. I'm tied up this weekend but I will endeavor to ping you an example asap. Jason On Fri, Feb 18, 2011 at 10:39 PM, Sasha Dolgy sdo...@gmail.com wrote: hi, does anyone have an erlang

Re: simple erlang example

2011-02-19 Thread J T
Hi Joshua, I can't speak for Sasha, but in my case I use both Riak and Cassandra since cassandra has ranges and build in secondary indexes whereas Riak does not. Actually I use others too as the different ones bring different qualities to the table. JT On Sat, Feb 19, 2011 at 7:18 AM, Joshua

Reading a bunch of rows pointed out by column names of columns in some row

2011-02-19 Thread Aklin_81
Is there a way to just ask for column names in a row to get just a column names list (and not the entire columnString,String). I am using Hector. I have a row of valueless columns (whose column names are keys to another set of rows) I wish to retrieve a list of those column names and send it in

Re: simple erlang example

2011-02-19 Thread Joshua Partogi
Hi, Would you like to share you use both database? Does this mean you have the same data in both database? Thanks for sharing. Kind regards, Joshua. On Sun, Feb 20, 2011 at 12:41 AM, J T jt4websi...@googlemail.com wrote: Hi Joshua, I can't speak for Sasha, but in my case I use both Riak and

Data model for activity feed

2011-02-19 Thread Rauan Maemirov
Hi, with the help of twissandra example, I tried to create a scheme for activity feed. Activities cf stores all activities: Activities: { '4d5fbfdf47878': { 'user': 'larry', 'activity_type': 'comment', ... activity info } } And userfeed cf stores each user's feed sorted by

0.7.2 slow memtables flushing

2011-02-19 Thread Ivan Georgiev
Hi, I am testing 0.7.2 on a Windows 2003 x64 system(one node) and I am having the following problem. My insertion speed is relatively slow, so the memtables do not get full and the actual flushing is triggered by memtable_flush_after_mins, this happens on the hour mark. My problem with 0.7.2

Re: managing a limited-length list as a value

2011-02-19 Thread Wangpei (Peter)
Maybe you can try this: use MAX-time as your column name, then get the first limit columns. -邮件原件- 发件人: Benson Margulies [mailto:bimargul...@gmail.com] 发送时间: 2011年2月19日 2:11 收件人: user@cassandra.apache.org 主题: managing a limited-length list as a value The following is derived from the

91% of memory usage right after startup when jna enabled

2011-02-19 Thread ruslan usifov
Hello I experiment with cassandra on vmvare. My work machine have 512M of memory if have enable jna for cassandra 0.7.2, and right after startup on clear enviroment cassandra took more then 90% of memory: root@cassandra1:/usr/local/apache-cassandra-0.7.2/bin# ps uax root 2404 10.5 91.7

Re: 0.7.2 slow memtables flushing

2011-02-19 Thread Jonathan Ellis
Flush code didn't change between 0.7.0 and 0.7.2. There must be some other variable here. Memory pressure maybe? On Sat, Feb 19, 2011 at 8:16 AM, Ivan Georgiev yngw...@bk.ru wrote: Hi, I am testing 0.7.2 on a Windows 2003 x64 system(one node) and I am having the following problem. My

Re: 91% of memory usage right after startup when jna enabled

2011-02-19 Thread Jonathan Ellis
conf/cassandra-env.sh, reduce the heap size On Sat, Feb 19, 2011 at 8:37 AM, ruslan usifov ruslan.usi...@gmail.com wrote: Hello I experiment with cassandra on vmvare. My work machine have 512M of memory if have enable jna for cassandra 0.7.2, and right after startup on clear enviroment

Re: Queries on secondary indexes

2011-02-19 Thread Jonathan Ellis
If your question is why are some of the values in hex, it's because you didn't specify a validation_class on the other columns. On Fri, Feb 18, 2011 at 6:46 AM, Rauan Maemirov ra...@maemirov.com wrote: With this schema: create column family Userstream with comparator=UTF8Type and rows_cached =

Re: 0.7.2 slow memtables flushing

2011-02-19 Thread Ivan Georgiev
On 19.2.2011 г. 16:43 ч., Jonathan Ellis wrote: Flush code didn't change between 0.7.0 and 0.7.2. There must be some other variable here. Memory pressure maybe? Cloud you please elaborate on that one ? The conditions are exactly the same for the test with 0.7.0 and 0.7.2. By the way, 0.7.1

Re: 0.7.2 slow memtables flushing

2011-02-19 Thread Jake Luciani
Are you running with JNA enabled? If so could you try disabling it? On Sat, Feb 19, 2011 at 11:32 AM, Ivan Georgiev yngw...@bk.ru wrote: On 19.2.2011 г. 16:43 ч., Jonathan Ellis wrote: Flush code didn't change between 0.7.0 and 0.7.2. There must be some other variable here. Memory pressure

Re: 0.7.2 slow memtables flushing

2011-02-19 Thread Ivan Georgiev
JNA is disabled and it is a windows box. Ivan On 19.2.2011 г. 19:23 ч., Jake Luciani wrote: Are you running with JNA enabled? If so could you try disabling it? On Sat, Feb 19, 2011 at 11:32 AM, Ivan Georgiev yngw...@bk.ru mailto:yngw...@bk.ru wrote: On 19.2.2011 г. 16:43 ч., Jonathan

RE: Benchmarking Cassandra with YCSB

2011-02-19 Thread Lior Golan
Can you share what numbers you are now getting? -Original Message- From: markuskl...@gmail.com [mailto:markuskl...@gmail.com] On Behalf Of Markus Klems Sent: Saturday, February 19, 2011 10:53 AM To: user@cassandra.apache.org Subject: Re: Benchmarking Cassandra with YCSB Hi, we sorted

Re: Benchmarking Cassandra with YCSB

2011-02-19 Thread Markus Klems
Sure will do. We are currently running a couple of benchmarks on differently configured EC2 landscapes. We will share our results in the next weeks. On Sat, Feb 19, 2011 at 6:53 PM, Lior Golan lio...@taboola.com wrote: Can you share what numbers you are now getting? -Original Message-

Re: simple erlang example

2011-02-19 Thread J T
Well I can't go in to too much detail I'm afraid but yes, in some cases there is duplication of data across the different database engines but then thats 'ok' in this new NOSQL world. On Sat, Feb 19, 2011 at 2:01 PM, Joshua Partogi joshua.j...@gmail.comwrote: Hi, Would you like to share you

Re: Reading a bunch of rows pointed out by column names of columns in some row

2011-02-19 Thread Aklin_81
anyone who can share what is the most recommended way of doing this On Sat, Feb 19, 2011 at 7:12 PM, Aklin_81 asdk...@gmail.com wrote: Is there a way to just ask for column names in a row to get just a column names list (and not the entire columnString,String). I am using Hector. I have a

Re: simple erlang example

2011-02-19 Thread J T
Hi Sasha, Below is some code from an old module I was working with a while back. It should give you an idea of the direction to go but really if you look at the files generated by thrift for cassandra it should help as well: * cassandra_thrift.erl * cassandra_thrift.hrl * cassandra_types.erl

cassandra-cli does not work

2011-02-19 Thread 橋本誠
Hello I am trying to run cassandra v0.7.2 on ubuntu 10.04. Cassandra works but in cassandra-cli any command such as help does not respond. $ ./cassandra -f INFO 10:08:43,618 Logging initialized INFO 10:08:43,634 Heap size: 1534066688/1535115264 INFO 10:08:43,648 JNA not found. Native methods

Re: cassandra-cli does not work

2011-02-19 Thread Brandon Williams
Add a semicolon. On Feb 19, 2011 7:11 PM, 橋本誠 tokomakoma...@auone.jp wrote: Hello I am trying to run cassandra v0.7.2 on ubuntu 10.04. Cassandra works but in cassandra-cli any command such as help does not respond. $ ./cassandra -f INFO 10:08:43,618 Logging initialized INFO 10:08:43,634 Heap

Re: cassandra-cli does not work

2011-02-19 Thread Tan Yeh Zheng
you need to append a ; at the end of your command. On Sun, 2011-02-20 at 10:10 +0900, 橋本誠 wrote: Hello I am trying to run cassandra v0.7.2 on ubuntu 10.04. Cassandra works but in cassandra-cli any command such as help does not respond. $ ./cassandra -f INFO 10:08:43,618 Logging

Re: 0.7.2 slow memtables flushing

2011-02-19 Thread Jonathan Ellis
I guess you'll need to binary search through the 0.7.1 changes to find what made the difference. I can't think of any obvious candidates. On Sat, Feb 19, 2011 at 10:32 AM, Ivan Georgiev yngw...@bk.ru wrote: On 19.2.2011 г. 16:43 ч., Jonathan Ellis wrote: Flush code didn't change between 0.7.0

Re: 0.7.2 slow memtables flushing

2011-02-19 Thread Ivan Georgiev
Is it possible that the changes to the BufferedRandomAccessFile.java could be causing the issue ? I think the most notable change there is using ByteBuffer instead of a byte[] for the buffer. I will run more tests and see what comes out of it. Ivan On 20.2.2011 г. 05:03 ч., Jonathan Ellis

Re: cassandra-cli does not work

2011-02-19 Thread tokoma
Hello Brandon and Tan, Thank you for giving me the resolution. I am a Cassandra 0.6 and cassandra-cli commands works without semi-colon. Now I know the difference between 0.6 and 0.7. Regards, MH

Re: Replacing Redis

2011-02-19 Thread Gaurav Sharma
Try Jedis or better-still JOhm if you would like to have automatic object mapping to Redis. You can select a connection pool of your choice even though we recommend you use Apache Commons Pool. Cassandra and Redis are very different beasts and work best at their respective scales. If you just