Re: Grails Cassandra plugin

2010-03-12 Thread Ran Tavory
great, I'm happy you found Hector useful :) btw, in hector 0.5.0-8 I added some interesting performance JMX counters so may be worth to update yours from 0.5.0-6 to -8 when you have time. On Fri, Mar 12, 2010 at 11:55 PM, Ned Wolpert wrote: > Document updated > > > On Fri, Mar 12, 2010 at 2:50 PM

Re: Is Cassandra a document based DB?

2010-03-01 Thread Ran Tavory
Cassandra is a column oriented db, similar to bigtables data model and to hbase's data mode (although implementations differ) hbase, btw, isn't a map-reduce implementation, you probably meant hadoop In version 6 cassandra will add support for hadoop so it'll have mapr, but it's not the core of cass

Re: MapReduce in Cassandra 0.6

2010-02-27 Thread Ran Tavory
fwiw, I read the instructions at contrib/word_count/README and it has like 3 manual steps, so using an embedded cassandra instance may simplify this into one single step and let the program do all setup and teardown it requires. http://prettyprint.me/2010/02/14/running-cassandra-as-an-embedded-serv

Re: Hector - a Java Cassandra client

2010-02-23 Thread Ran Tavory
Grossman wrote: > Hi Ran, > > Is it support operation on super column ? > Thanks > > On Tue, Feb 23, 2010 at 4:13 PM, Ran Tavory wrote: > >> I've written a java library for cassandra I've been using internally, >> would love to get your feedback and hop

Hector - a Java Cassandra client

2010-02-23 Thread Ran Tavory
I've written a java library for cassandra I've been using internally, would love to get your feedback and hope you find it useful. Blog post: http://prettyprint.me/2010/02/23/hector-a-java-cassandra-client/ Source: http://github.com/rantav/hector High level features: o A high-level object oriente

Re: StackOverflowError on high load

2010-02-21 Thread Ran Tavory
nodes, the more behind on compactions they can get. We consider > this a bug, and CASSANDRA-685 will be exploring solutions so that your > client automatically backs off as a node becomes overloaded. > > Thanks, > Stu > > -Original Message- > From: "Ran Tav

Re: StackOverflowError on high load

2010-02-21 Thread Ran Tavory
CASSANDRA-804 is going to be a real fix. Thanks On Sat, Feb 20, 2010 at 9:36 PM, Jonathan Ellis wrote: > if OPP is configured w/ imbalanced ranges (or less balanced than RP) > then that would explain it. > > OPP is actually slightly faster in terms of raw speed. > > On

Re: StackOverflowError on high load

2010-02-20 Thread Ran Tavory
gt; though test1 is not completely dead yet. > > On Thu, Feb 18, 2010 at 1:16 AM, Ran Tavory wrote: > > I found another interesting graph, attached. > > I looked at the write-count and write-latency of the CF I'm writing to > and I > > see a few interesting things:

Re: StackOverflowError on high load

2010-02-17 Thread Ran Tavory
t to happen? Thanks On Wed, Feb 17, 2010 at 9:00 PM, Tatu Saloranta wrote: > On Wed, Feb 17, 2010 at 6:40 AM, Ran Tavory wrote: > > If it's the data directory, then I have a pretty big one. Maybe it's > > something else > > $ df -h /outbrain/cassandra/data

Re: StackOverflowError on high load

2010-02-17 Thread Ran Tavory
2010 at 4:34 PM, Jonathan Ellis wrote: > On Wed, Feb 17, 2010 at 8:19 AM, Ran Tavory wrote: > > Are we talking about the CommitLogDirectory that needs to be up 2x? > > no. data, not commitlog. > > > So it needs to be 2x of what? Did I miss this in the config file >

Re: StackOverflowError on high load

2010-02-17 Thread Ran Tavory
ot;disk too full" is almost certainly actually the > problem. > > created https://issues.apache.org/jira/browse/CASSANDRA-804 to fix this. > > On Wed, Feb 17, 2010 at 5:59 AM, Ran Tavory wrote: > > no, that's not it, disk isn't full. > > After restarting the

Re: StackOverflowError on high load

2010-02-17 Thread Ran Tavory
full > > 2010/2/17 Ran Tavory > > I'm running some high load writes on a pair of cassandra hosts using an >> OrderPresenrvingPartitioner and ran into the following error after which one >> of the hosts killed itself. >> Has anyone seen it and can advice? >&

StackOverflowError on high load

2010-02-17 Thread Ran Tavory
I'm running some high load writes on a pair of cassandra hosts using an OrderPresenrvingPartitioner and ran into the following error after which one of the hosts killed itself. Has anyone seen it and can advice? (cassandra v0.5.0) ERROR [HINTED-HANDOFF-POOL:1] 2010-02-17 04:50:09,602 CassandraDaem

Re: How to unit test my code calling Cassandra with Thift

2010-02-13 Thread Ran Tavory
to keep the server alive. > Thanks > > Richard > > On Sun, Jan 24, 2010 at 12:02 PM, Ran Tavory wrote: > >> Here's the code I've just written over the weekend and started using in >> test: >> >> >> package com.outbrain.data.cassandra.serv

Re: How to unit test my code calling Cassandra with Thift

2010-01-25 Thread Ran Tavory
yeah, it would. I was doing it under the assumption I don't want to change the source for cassandra but I'll work on putting it into contrib and add that c'tor as well. 2010/1/25 Ted Zlatanov > On Sun, 24 Jan 2010 13:56:07 +0200 Ran Tavory wrote: > > RT> On S

Re: How to unit test my code calling Cassandra with Thift

2010-01-24 Thread Ran Tavory
agreed on the System.getProperty("java.io.tmpdir") I can put this under contrib if you think it's useful. On Sun, Jan 24, 2010 at 1:16 PM, gabriele renzi wrote: > On Sun, Jan 24, 2010 at 11:02 AM, Ran Tavory wrote: > > Here's the code I've just written ove

Re: How to unit test my code calling Cassandra with Thift

2010-01-24 Thread Ran Tavory
long as this is the last thread alive, don't hang the app for it and quit. On Sun, Jan 24, 2010 at 12:20 PM, Richard Grossman wrote: > Great Ran, > > I think I've missed the .setDaemon to keep the server alive. > Thanks > > Richard > > On Sun, Jan 24, 2010 at 12:02

Re: How to unit test my code calling Cassandra with Thift

2010-01-24 Thread Ran Tavory
ens to the thrift interface. * Useful for unit testing, * * @author Ran Tavory (r...@outbain.com) * */ public class InProcessCassandraServer implements Runnable { private static final Logger log = LoggerFactory.getLogger(InProcessCassandraServer.class); CassandraDaemon cassandraDaemon;

Re: Cassandra guarantees reads and writes to be atomic within a single ColumnFamily.

2010-01-13 Thread Ran Tavory
> -Jonathan > > On Mon, Jan 11, 2010 at 3:01 PM, Ran Tavory wrote: > > The front page http://incubator.apache.org/cassandra/ states that > "Cassandra > > guarantees reads and writes to be atomic within a single ColumnFamily." > > What exactly does that mean,

Re: Cassandra guarantees reads and writes to be atomic within a single ColumnFamily.

2010-01-13 Thread Ran Tavory
rrect? On Mon, Jan 11, 2010 at 11:01 PM, Ran Tavory wrote: > The front page http://incubator.apache.org/cassandra/ states that > "Cassandra guarantees reads and writes to be atomic within a single > ColumnFamily." > What exactly does that mean, and where can I learn more

Cassandra guarantees reads and writes to be atomic within a single ColumnFamily.

2010-01-11 Thread Ran Tavory
The front page http://incubator.apache.org/cassandra/ states that "Cassandra guarantees reads and writes to be atomic within a single ColumnFamily." What exactly does that mean, and where can I learn more about this? It sounds like it means that batch_insert() and batch_mutate() for two different r

async calls in cassandra

2009-12-31 Thread Ran Tavory
Does cassandra/thrift support asynchronous IO calls? Is this planned for an upcoming release?

Re: MultiThread Client problem with thrift

2009-12-22 Thread Ran Tavory
22, 2009 at 9:10 AM, Ran Tavory wrote: > > Not at expert in this field, but I think what you want is use a > connection > > pool and NOT close the connections - reuse them. Only idle connections > are > > released after, say 1sec. Also, with a connection pool it's easy

Re: MultiThread Client problem with thrift

2009-12-22 Thread Ran Tavory
c... > > Thanks > > On Tue, Dec 22, 2009 at 2:55 PM, Ran Tavory wrote: > >> I don't have a 0.5.0-beta2 version, no. It's not too difficult to add it, >> but I haven't done so myself, I'm using 0.4.2 >> >> >> On Tue, Dec 22,

Re: MultiThread Client problem with thrift

2009-12-22 Thread Ran Tavory
I don't have a 0.5.0-beta2 version, no. It's not too difficult to add it, but I haven't done so myself, I'm using 0.4.2 On Tue, Dec 22, 2009 at 2:42 PM, Richard Grossman wrote: > Yes of course but do you have updated to cassandra 0.5.0-beta2 ? > > > On Tue, Dec

Re: MultiThread Client problem with thrift

2009-12-22 Thread Ran Tavory
Would connection pooling work for you? This Java client http://code.google.com/p/cassandra-java-client/ has connection pooling. I haven't put the client under stress yet so I can't testify, but this may be a good solution for you On Tue, Dec 22, 2009 at 2:22 PM, Richard Grossman wrote: > I agree

Images store in Cassandra

2009-12-12 Thread Ran Tavory
As we're designing our systems for a move from mysql to Cassandra we're considering moving our file storage to Cassandra as well. Is this wise? We're currently using mogilefs to store media items (images) of average size of 30Mb (400k images, and growing). Cassandra looks like a performance improv

Re: vector clocks?

2009-12-07 Thread Ran Tavory
then? On Mon, Dec 7, 2009 at 12:34 AM, Kelvin Kakugawa wrote: > Cassandra, right now, doesn't use vector clocks internally. However, > an implementation is being worked on, here: > https://issues.apache.org/jira/browse/CASSANDRA-580 > > -Kelvin > > On Sun, Dec 6,

vector clocks?

2009-12-06 Thread Ran Tavory
As a Cassandra newbe, after having read the Dynamo paper, I was wondering - how does Cassandra use timestamps? - Does it use them internally to resolve conflicts? - Does it expose vector clocks to clients when internal conflict resolution fails? Thanks