Re: avro + cassandra + ruby

2010-11-17 Thread Benjamin Black
Cassandra.new(keyspace, server, {:protocol = Thrift::BinaryProtocolAccelerated}) On Tue, Nov 16, 2010 at 5:13 PM, Ryan King r...@twitter.com wrote: On Tue, Nov 16, 2010 at 10:25 AM, Jonathan Ellis jbel...@gmail.com wrote: On Tue, Sep 28, 2010 at 6:35 PM, Ryan King r...@twitter.com wrote: One

Re: avro + cassandra + ruby

2010-09-30 Thread Gabor Torok
The server exception is: WARN 09:49:56,644 user error org.apache.cassandra.avro.KeyspaceNotDefinedException at org.apache.cassandra.avro.AvroValidation.validateKeyspace(AvroValidation.java:73) at

Re: avro + cassandra + ruby

2010-09-30 Thread Gabor Torok
I ran the python code like Gary suggested and it succeeded. (As an aside, it would be nice if I could run the python code for avro without having thrift installed.) Then I re-created my ruby example in python (essentially calling set_keyspace and then making a multiget_slice call) and it also

RE: avro + cassandra + ruby

2010-09-30 Thread Gabor Torok
The ruby code creates a new http connection for each call to transceive. Here is what I changed to make it work: gabor$ diff /usr/local/lib/ruby/gems/1.8/gems/avro-1.4.0/lib/avro/ipc.rb ~/avro-trunk/lang/ruby/lib/avro/ipc.rb 518d517 require net/http 525d523 @conn = Net::HTTP.start

Re: avro + cassandra + ruby

2010-09-30 Thread Aaron Morton
If you turn logging up to DEBUG do you see any lines such as thiswhen running your script.DEBUG [pool-1-thread-22] 2010-10-01 08:22:12,723 ClientState.java (line 107) logged out: #User allow_all groups=[]And out of interest, if you send two multiget_slice calls, do they both log from the same

Re: avro + cassandra + ruby

2010-09-30 Thread Ryan King
On Thu, Sep 30, 2010 at 1:08 PM, Gabor Torok gabor.to...@sunpowercorp.com wrote: I added a comment to an existing issue: https://issues.apache.org/jira/browse/AVRO-537 Cool. I'll work with Jeff (who sits about 10 feet from me) to get this fixed. :) -ryan

Re: avro + cassandra + ruby

2010-09-29 Thread Gary Dusbabek
We have a system test that tests this (in avro python). see test/system/test_avro_standard.py:TestStandardOperations.test_multiget_slice_simple. On Wed, Sep 29, 2010 at 01:06, Gabor Torok gabor.to...@sunpowercorp.com wrote: Hi, I'm attempting to use avro to talk to cassandra because the ruby

Re: avro + cassandra + ruby

2010-09-29 Thread Ryan King
On Tue, Sep 28, 2010 at 4:06 PM, Gabor Torok gabor.to...@sunpowercorp.com wrote: Hi, I'm attempting to use avro to talk to cassandra because the ruby thrift client's read performance is pretty bad (I measured 4x slower than java). However, I run into a problem when calling multiget_slice.

avro + cassandra + ruby

2010-09-28 Thread Gabor Torok
Hi, I'm attempting to use avro to talk to cassandra because the ruby thrift client's read performance is pretty bad (I measured 4x slower than java). However, I run into a problem when calling multiget_slice. The server gives a KeyspaceNotDefinedException because clientState.getKeyspace()

Re: avro + cassandra + ruby

2010-09-28 Thread Ryan King
On Tue, Sep 28, 2010 at 4:06 PM, Gabor Torok gabor.to...@sunpowercorp.com wrote: Hi, I'm attempting to use avro to talk to cassandra because the ruby thrift client's read performance is pretty bad (I measured 4x slower than java). Only 4x feels like a win. :) One thing you should try is to

Re: avro + cassandra + ruby

2010-09-28 Thread Gabor Torok
Thanks, that made things better by about 30%. Unfortunately for me that's still unacceptable... :-( I feel like I'm doing something wrong with avro (see my original post). Was anyone able to make it work?