Re: other questions about // RE: batch_mutate

2013-04-11 Thread aaron morton
tion updates, if so the answer is no. Cheers - Aaron Morton Freelance Cassandra Consultant New Zealand @aaronmorton http://www.thelastpickle.com On 10/04/2013, at 3:26 AM, DE VITO Dominique wrote: > When the coordinator node receives a batch_mutate for __one__ row key >

Re: data modeling from batch_mutate point of view

2013-04-11 Thread aaron morton
> b) the "batch_mutate" advantages are better, for the communication > "client<=>coordinator node" __and__ for the communications "coordinator > node<=>replicas". Yes. A single row mutation can write to many CFs. > Is there any expe

RE: other questions about // RE: batch_mutate

2013-04-09 Thread DE VITO Dominique
When the coordinator node receives a batch_mutate for __one__ row key associated with different mutations for different CF : Is it true the coordinator node treats them as __independent__ communications/requests to replicas (even if in that case, the replicas are the same for every request

RE: data modeling from batch_mutate point of view

2013-04-09 Thread DE VITO Dominique
Thanks Aaron. It helped. Let's me rephrase a little bit my questions. It's about data modeling impact on "batch_mutate" advantages. I have one CF for storing data, and ~10 (all different) CF used for indexing that data. when adding a piece of data, I need to add indexes t

Re: data modeling from batch_mutate point of view

2013-04-09 Thread aaron morton
g CF could be: > rowkey = folder_id > colname = (indexed value, timestamp, file_id) > colvalue = "" > > Alternative design : > * pro: same rowkey for all indexing CF => **all** indexing CF could be > updated through one batch_mutate > * con: repeating &q

data modeling from batch_mutate point of view

2013-04-08 Thread DE VITO Dominique
e design for indexing CF could be: rowkey = folder_id colname = (indexed value, timestamp, file_id) colvalue = "" Alternative design : * pro: same rowkey for all indexing CF => **all** indexing CF could be updated through one batch_mutate * con: repeating "indexed value"

Re: other questions about // RE: batch_mutate

2013-03-26 Thread aaron morton
ives a batch_mutate with different N row keys > (for different CF) : > > a) does it treat them as N independent requests to replicas, or > > b) does the coordinator node split the the initial batch_mutate into M > batch_mutate (M <= N) according to rowkeys ? > > Thanks,

other questions about // RE: batch_mutate

2013-03-25 Thread DE VITO Dominique
When the coordinator node receives a batch_mutate with different N row keys (for different CF) : a) does it treat them as N independent requests to replicas, or b) does the coordinator node split the the initial batch_mutate into M batch_mutate (M <= N) according to rowkeys ? Tha

Re: batch_mutate and erlang

2012-09-23 Thread Tyler Hobbs
thub.com/pycassa/pycassa/blob/master/pycassa/batch.py#L113 >> >> >> On Sat, Sep 22, 2012 at 12:22 AM, Bradford Toney < >> bradford.to...@gmail.com> wrote: >> >>> I was using batch_mutate through the thrift interface and kept getting >>> supercol

Re: batch_mutate and erlang

2012-09-22 Thread Bradford Toney
t; > and in pycassa: > https://github.com/pycassa/pycassa/blob/master/pycassa/batch.py#L113 > > > On Sat, Sep 22, 2012 at 12:22 AM, Bradford Toney > wrote: > >> I was using batch_mutate through the thrift interface and kept getting >> supercolumn errors, I was won

Re: batch_mutate and erlang

2012-09-22 Thread Tyler Hobbs
cassa/Batch/Mutator.php#L53 and in pycassa: https://github.com/pycassa/pycassa/blob/master/pycassa/batch.py#L113 On Sat, Sep 22, 2012 at 12:22 AM, Bradford Toney wrote: > I was using batch_mutate through the thrift interface and kept getting > supercolumn errors, I was wondering if there are a

Re: Thrift batch_mutate erase previous data?

2012-08-20 Thread Cyril Auburtin
no right it's ok, it was a bug on my side 2012/8/11 Tyler Hobbs > > > On Thu, Aug 9, 2012 at 10:43 AM, Cyril Auburtin > wrote: > >> It seems the Thrift method *batch-mutate*, with Mutations, will not >> update the previous data with the mutation given, but clear and replace by >> it? right? >>

Re: Thrift batch_mutate erase previous data?

2012-08-11 Thread Tyler Hobbs
On Thu, Aug 9, 2012 at 10:43 AM, Cyril Auburtin wrote: > It seems the Thrift method *batch-mutate*, with Mutations, will not > update the previous data with the mutation given, but clear and replace by > it? right? > I'm not sure what you're asking. Writes in Cassandra are always blind overwrite

Thrift batch_mutate erase previous data?

2012-08-09 Thread Cyril Auburtin
Hello It seems the Thrift method *batch-mutate*, with Mutations, will not update the previous data with the mutation given, but clear and replace by it? right? thanks for answers How could I do if I have more than one field to update, I should send several thrft *insert*?

Re: Cassandra 1.0.6 nodetool drain gives lots of batch_mutate exceptions

2012-07-30 Thread Tamil selvan R.S
> particular node, that node accepting READ+WRITE request from the clients > and > giving below exceptions. > > 2012-07-30 23:08:18,169 ERROR [Cassandra$Processor] Internal error > processing batch_mutate > java.util.concurrent.RejectedExecutionException: ThreadPoolE

Cassandra 1.0.6 nodetool drain gives lots of batch_mutate exceptions

2012-07-29 Thread Roshan
] Internal error processing batch_mutate java.util.concurrent.RejectedExecutionException: ThreadPoolExecutor has shut down at org.apache.cassandra.concurrent.DebuggableThreadPoolExecutor$1.rejectedExecution(DebuggableThreadPoolExecutor.java:60) at

Re: batch_mutate

2012-07-05 Thread aaron morton
ursday, July 05, 2012 10:39 AM > To: 'user@cassandra.apache.org' > Subject: batch_mutate > > My current way of inserting rows one by one is too slow (I use cql3 prepared > statements) , so I want to try batch_mutate. > > Could anybody give me more details about t

RE: batch_mutate

2012-07-05 Thread Leonid Ilyevsky
update multiple column families using the same key? Shouldn't we design our space in such a way that those columns live in the same column family? From: Leonid Ilyevsky [mailto:lilyev...@mooncapital.com] Sent: Thursday, July 05, 2012 10:39 AM To: 'user@cassandra.apache.org' Subject: b

batch_mutate

2012-07-05 Thread Leonid Ilyevsky
My current way of inserting rows one by one is too slow (I use cql3 prepared statements) , so I want to try batch_mutate. Could anybody give me more details about the interface? In the javadoc it says: public void batch_mutate(java.util.Map>>> mut

RE: Internal error processing batch_mutate java.util.ConcurrentModificationException

2012-02-07 Thread Viktor Jevdokimov
message in error, please contact the sender immediately and irrevocably delete this message and any copies. From: aaron morton [mailto:aa...@thelastpickle.com] Sent: Monday, February 06, 2012 21:03 To: user@cassandra.apache.org Subject: Re: Internal error proce

Re: Internal error processing batch_mutate java.util.ConcurrentModificationException

2012-02-06 Thread aaron morton
Freelance Developer @aaronmorton http://www.thelastpickle.com On 4/02/2012, at 4:49 AM, Viktor Jevdokimov wrote: > What may be cause of the following exception in 1.0.7 Cassandra: > > ERROR [Thrift:134] 2012-02-03 15:51:02,800 Cassandra.java (line 3462) > Internal error processing

Internal error processing batch_mutate java.util.ConcurrentModificationException

2012-02-03 Thread Viktor Jevdokimov
What may be cause of the following exception in 1.0.7 Cassandra: ERROR [Thrift:134] 2012-02-03 15:51:02,800 Cassandra.java (line 3462) Internal error processing batch_mutate java.util.ConcurrentModificationException at java.util.AbstractList$Itr.checkForComodification(AbstractList.java

Re: Questions about TTL and batch_mutate

2011-08-21 Thread Joris van der Wel
ched is set >> to 1.0). I am wondering if TTL values also follow gc_grace? If they >> do, am I correct in thinking it would be best to set gc_grace really >> low in this case? (zero?) >> >> Another question: >> For a single key I have data in ColumnFamily "CF_A

Re: Questions about TTL and batch_mutate

2011-08-21 Thread aaron morton
"CF_A" and ColumnFamily > "CF_B". I set their data in one thrift "batch_mutate". > If I understood correctly, atomicity is then guaranteed (if one > mutation fails, they all fail). But isolation is not. However if for > example the following Mutation

Questions about TTL and batch_mutate

2011-08-21 Thread Joris van der Wel
case? (zero?) Another question: For a single key I have data in ColumnFamily "CF_A" and ColumnFamily "CF_B". I set their data in one thrift "batch_mutate". If I understood correctly, atomicity is then guaranteed (if one mutation fails, they all fail). But isolation is n

Re: RE: batch_mutate failed: out of sequence response

2011-04-18 Thread Dan Washusen
Sure is: scale7-pelops-1.1-0.7.x-20110418.225848-3.jar Cheers, -- Dan Washusen On Tuesday, 19 April 2011 at 3:58 PM, Héctor Izquierdo Seliva wrote: > Thanks Dan for fixing that! Is the change integrated in the latest maven > snapshot? > > El mar, 19-04-2011 a las 10:48 +1000, Dan Washusen escri

Re: RE: batch_mutate failed: out of sequence response

2011-04-18 Thread Héctor Izquierdo Seliva
Thanks Dan for fixing that! Is the change integrated in the latest maven snapshot? El mar, 19-04-2011 a las 10:48 +1000, Dan Washusen escribió: > An example scenario (that is now fixed in Pelops): > 1. Attempt to write a column with a null value > 2. Cassandra throws a TProtocolException

Re: RE: batch_mutate failed: out of sequence response

2011-04-18 Thread Dan Washusen
An example scenario (that is now fixed in Pelops): Attempt to write a column with a null value Cassandra throws a TProtocolException which renders the connection useless for future operations Pelops returns the corrupt connection to the pool A second read operation is attempted with the corrupt co

Re: RE: batch_mutate failed: out of sequence response

2011-04-18 Thread Jonathan Ellis
Any idea what's causing the original TPE? On Mon, Apr 18, 2011 at 6:22 PM, Dan Washusen wrote: > It turns out that once a TProtocolException is thrown from Cassandra the > connection is useless for future operations. Pelops was closing connections > when it detected TimedOutException, TTransportE

Re: RE: batch_mutate failed: out of sequence response

2011-04-18 Thread Dan Washusen
It turns out that once a TProtocolException is thrown from Cassandra the connection is useless for future operations. Pelops was closing connections when it detected TimedOutException, TTransportException and UnavailableException but not TProtocolException. We have now changed Pelops to close c

Re: RE: batch_mutate failed: out of sequence response

2011-04-14 Thread Dan Washusen
I've looked over the Pelops code again and I really can't see how it could be at fault here... -- Dan Washusen On Wednesday, 13 April 2011 at 3:20 AM, Stephen McKamey wrote: > [I wrote this Apr 10, 2011 at 12:09 but my message seems to have gotten lost > along the way.] > > I use Pelops (the

RE: batch_mutate failed: out of sequence response

2011-04-12 Thread Stephen McKamey
[I wrote this Apr 10, 2011 at 12:09 but my message seems to have gotten lost along the way.] I use Pelops (the 1.0-0.7.x build from the Github Maven repo) and have occasionally seen this message (under load or during GC). I have a test app running in two separate single-threaded processes doing a

Re: RE: batch_mutate failed: out of sequence response

2011-04-07 Thread Dan Washusen
Pelops uses a single connection per operation from a pool that is backed by Apache Commons Pool (assuming you're using Cassandra 0.7). I'm not saying it's perfect but it's NOT sharing a connection over multiple threads. Dan Hendry mentioned that he sees these errors. Is he also using Pelops? Fro

Re: RE: batch_mutate failed: out of sequence response

2011-04-07 Thread Héctor Izquierdo Seliva
El mié, 06-04-2011 a las 21:04 -0500, Jonathan Ellis escribió: > "out of sequence response" is thrift's way of saying "I got a response > for request Y when I expected request X." > > my money is on using a single connection from multiple threads. don't do > that. > I'm not using thrift direct

Re: RE: batch_mutate failed: out of sequence response

2011-04-07 Thread Héctor Izquierdo Seliva
El mié, 06-04-2011 a las 21:04 -0500, Jonathan Ellis escribió: > "out of sequence response" is thrift's way of saying "I got a response > for request Y when I expected request X." > > my money is on using a single connection from multiple threads. don't do > that. I'm not using thrift direc

Re: RE: batch_mutate failed: out of sequence response

2011-04-06 Thread Jonathan Ellis
vide more info please? > > org.scale7.cassandra.pelops.exceptions.ApplicationException: > batch_mutate failed: out of sequence response > > -- > Dan Washusen > Make big files fly > visit digitalpigeon.com > > On Tuesday, 5 April 2011 at 11:43 PM, Héctor Izquierdo Seliva wr

Re: RE: batch_mutate failed: out of sequence response

2011-04-06 Thread Dan Washusen
> org.scale7.cassandra.pelops.exceptions.ApplicationException: > batch_mutate failed: out of sequence response > > > -- > > Dan Washusen > > Make big files fly > > visit digitalpigeon.com > > > > On Tuesday, 5 April 2011 at 11:43 PM, Héctor Izquierdo Seliva wrote: > >

Re: Disable Swap? batch_mutate failed: out of sequence response

2011-04-06 Thread Héctor Izquierdo Seliva
El mié, 06-04-2011 a las 09:18 +0200, Héctor Izquierdo Seliva escribió: > I took a look at vmstats, and there was no swap. Also, our monitoring > tools showed no swap being used at all. It's running with mlockall and > all that. 8GB heap on a 16GB machine > I tried disabling swap completely, and

Re: RE: batch_mutate failed: out of sequence response

2011-04-06 Thread Héctor Izquierdo Seliva
El mié, 06-04-2011 a las 09:06 +1000, Dan Washusen escribió: > Pelops raises a RuntimeException? Can you provide more info please? > org.scale7.cassandra.pelops.exceptions.ApplicationException: batch_mutate failed: out of sequence response > -- > Dan Washusen > Make big fi

Re: Disable Swap? batch_mutate failed: out of sequence response

2011-04-06 Thread Héctor Izquierdo Seliva
I took a look at vmstats, and there was no swap. Also, our monitoring tools showed no swap being used at all. It's running with mlockall and all that. 8GB heap on a 16GB machine El mar, 05-04-2011 a las 21:24 +0200, Peter Schuller escribió: > > Would you recommend to disable system swap as a rule?

Re: RE: batch_mutate failed: out of sequence response

2011-04-05 Thread Dan Washusen
our response! > > Héctor > > > -Original Message- > > From: Héctor Izquierdo Seliva [mailto:izquie...@strands.com] > > Sent: April-05-11 8:30 > > To: user@cassandra.apache.org > > Subject: batch_mutate failed: out of sequence response > > > > Hi

Re: Disable Swap? batch_mutate failed: out of sequence response

2011-04-05 Thread Peter Schuller
> Would you recommend to disable system swap as a rule?   I'm running on Debian > 64bit and am seeing light swapping: I'm not Jonathan, but *yes*. I would go so far as to say that disabling swap is a good rule of thumb for *most* production systems that serve latency sensitive traffic. For a mach

Disable Swap? batch_mutate failed: out of sequence response

2011-04-05 Thread Jonathan Colby
round 5 seconds. I'm running cassandra with a heap of 8 GB. Should I tune >> this somehow? >> >> Is any of this wrong? >>> >>>>> -Original Message- >>>>> From: Héctor Izquierdo Seliva [mailto:izquie...@strands.com] >>>

Re: batch_mutate failed: out of sequence response

2011-04-05 Thread Jonathan Ellis
---Original Message- >> > > From: Héctor Izquierdo Seliva [mailto:izquie...@strands.com] >> > > Sent: April-05-11 8:30 >> > > To: user@cassandra.apache.org >> > > Subject: batch_mutate failed: out of sequence response >> > > >> > > Hi e

RE: batch_mutate failed: out of sequence response

2011-04-05 Thread Héctor Izquierdo Seliva
t: April-05-11 8:30 > > > To: user@cassandra.apache.org > > > Subject: batch_mutate failed: out of sequence response > > > > > > Hi everyone. I'm having trouble while inserting big amounts of data into > > > cassandra. I'm getting this exception: >

RE: batch_mutate failed: out of sequence response

2011-04-05 Thread Héctor Izquierdo Seliva
> -Original Message- > > From: Héctor Izquierdo Seliva [mailto:izquie...@strands.com] > > Sent: April-05-11 8:30 > > To: user@cassandra.apache.org > > Subject: batch_mutate failed: out of sequence response > > > > Hi everyone. I'm having trouble while

RE: batch_mutate failed: out of sequence response

2011-04-05 Thread Héctor Izquierdo Seliva
your response! Héctor > -Original Message- > From: Héctor Izquierdo Seliva [mailto:izquie...@strands.com] > Sent: April-05-11 8:30 > To: user@cassandra.apache.org > Subject: batch_mutate failed: out of sequence response > > Hi everyone. I'm having trouble while

RE: batch_mutate failed: out of sequence response

2011-04-05 Thread Dan Hendry
age/xc3tskhhvsf5awz7). What OS are you running? Dan -Original Message- From: Héctor Izquierdo Seliva [mailto:izquie...@strands.com] Sent: April-05-11 8:30 To: user@cassandra.apache.org Subject: batch_mutate failed: out of sequence response Hi everyone. I'm having trouble while inserting big am

batch_mutate failed: out of sequence response

2011-04-05 Thread Héctor Izquierdo Seliva
Hi everyone. I'm having trouble while inserting big amounts of data into cassandra. I'm getting this exception: batch_mutate failed: out of sequence response I'm gessing is due to very big mutates. I have made the batch mutates smaller and it seems to be behaving. Can somebody

Re: OOM during batch_mutate

2011-02-08 Thread Jonathan Ellis
No, on 0.6 copying settings for a 32GB machine to a 16GB machine would also be a great way to OOM. The difference is that you had to set memtable thresholds globally in the xml file in 0.6, instead of being able to do it per-columnfamily from the cli. On Tue, Feb 8, 2011 at 10:40 AM, Chris Burrou

Re: OOM during batch_mutate

2011-02-08 Thread Chris Burroughs
On 02/07/2011 06:05 PM, Jonathan Ellis wrote: > Sounds like the keyspace was created on the 32GB machine, so it > guessed memtable sizes that are too large when run on the 16GB one. > Use "update column family" from the cli to cut the throughput and > operations thresholds in half, or to 1/4 to be

Re: OOM during batch_mutate

2011-02-08 Thread Patrik Modesto
On Tue, Feb 8, 2011 at 00:05, Jonathan Ellis wrote: > Sounds like the keyspace was created on the 32GB machine, so it > guessed memtable sizes that are too large when run on the 16GB one. > Use "update column family" from the cli to cut the throughput and > operations thresholds in half, or to 1/4

Re: OOM during batch_mutate

2011-02-07 Thread Jonathan Ellis
Sounds like the keyspace was created on the 32GB machine, so it guessed memtable sizes that are too large when run on the 16GB one. Use "update column family" from the cli to cut the throughput and operations thresholds in half, or to 1/4 to be cautious. On Mon, Feb 7, 2011 at 9:00 AM, Patrik Mode

Re: OOM during batch_mutate

2011-02-07 Thread Patrik Modesto
On Mon, Feb 7, 2011 at 15:44, sridhar basam wrote: > Looks like you don't have a big enough working set from your GC logs, there > doesn't seem to be a lot being reclaimed in the GC process. The process is > reclaiming a few hundred MB and is running every few seconds. How big are > your caches? T

Re: OOM during batch_mutate

2011-02-07 Thread sridhar basam
Looks like you don't have a big enough working set from your GC logs, there doesn't seem to be a lot being reclaimed in the GC process. The process is reclaiming a few hundred MB and is running every few seconds. How big are your caches? The probable reason that it works the first couple times when

Re: OOM during batch_mutate

2011-02-07 Thread Patrik Modesto
Just tried current 0.7.1 from cassandra-0.7 branch and it does the same. OOM after three runs. -Xm* setting is computed by cassandra-env.sh like this: -Xms8022M -Xmx8022M -Xmn2005M What am I doing wrong? Thanks, Patrik On Mon, Feb 7, 2011 at 14:18, Patrik Modesto wrote: > I forgot to mention

Re: OOM during batch_mutate

2011-02-07 Thread Patrik Modesto
I forgot to mention I use 0.7.0 stable version. HTH, Patrik

OOM during batch_mutate

2011-02-07 Thread Patrik Modesto
Hi all! I'm running into OOM problem during batch_mutate. I've a test cluster of two servers, 32GB and 16GB RAM, real HW. I've one keyspace and one CF with 1,4mil rows, each 10 columns. A row is around 5k in size. I run Hadoop MR task that reads one column and generates Mutati

Re: Achieving isolation on single row modifications with batch_mutate

2010-11-30 Thread E S
I'm a little confused about #3. Hopefully this clarifying question won't turn the one maybe into a no :). I'm fine not reading the latest data, as long as on each individual read I see all or none of the operations that occurred for a single one row batch_mutate. My concern

Re: Achieving isolation on single row modifications with batch_mutate

2010-11-30 Thread Ed Anuff
It's hard to tell without knowing the the nature of the data you're writing, but you might want to think about whether you can embed any sort of version number and/or checksum into the column names of the chunk columns. That way, you could very easily determine that the data you wanted to retrieve

Re: Achieving isolation on single row modifications with batch_mutate

2010-11-30 Thread Jonathan Ellis
On Sat, Nov 27, 2010 at 10:12 AM, E S wrote: > I'm trying to figure out the best way to achieve single row modification > isolation for readers. I have a lot of No's for you. :) > As an example, I have 2 rows (1,2) with 2 columns (a,b).  If I modify both > rows, > I don't care if the user sees

Re: Achieving isolation on single row modifications with batch_mutate

2010-11-30 Thread E S
er 30, 2010 12:57:07 AM Subject: Re: Achieving isolation on single row modifications with batch_mutate In this case, it sounds like you should combine columns A and B if you are writing them both at the same time, reading them both at the same time, and need them to be consistent. Obviously, you

Re: Achieving isolation on single row modifications with batch_mutate

2010-11-29 Thread Tyler Hobbs
In this case, it sounds like you should combine columns A and B if you are writing them both at the same time, reading them both at the same time, and need them to be consistent. Obviously, you're probably dealing with more than two columns here, but there's generally not any value in splitting so

Re: batch_mutate vs number of write operations on CF

2010-11-29 Thread Tyler Hobbs
Using batch_mutate on a single row will count as 1 write operation, even if you mutate multiple columns. Using batch_mutate on N rows will count as N write operations. - Tyler On Mon, Nov 29, 2010 at 5:58 PM, Narendra Sharma wrote: > Hi, > > I am using Cassandra 0.7 beta3 and Hect

batch_mutate vs number of write operations on CF

2010-11-29 Thread Narendra Sharma
Hi, I am using Cassandra 0.7 beta3 and Hector. I create a mutation map. The mutation involves adding few columns for a given row. After that I use batch_mutate API to send the changes to Cassandra. Question: If there are multiple column writes on same row in a mutation_map, does Cassandra show

Achieving isolation on single row modifications with batch_mutate

2010-11-27 Thread E S
I'm trying to figure out the best way to achieve single row modification isolation for readers. As an example, I have 2 rows (1,2) with 2 columns (a,b). If I modify both rows, I don't care if the user sees the write operations completed on 1 and not on 2 for a short time period (seconds). I

RE: Question regarding support of batch_mutate + delete + slice predicate

2010-10-29 Thread Dwight Smith
Aaron This did the trick - thanks. From: aaron morton [mailto:aa...@thelastpickle.com] Sent: Thursday, October 28, 2010 3:23 AM To: user@cassandra.apache.org Subject: Re: Question regarding support of batch_mutate + delete + slice predicate I cannot see anything in jira scheduled for

Re: Question regarding support of batch_mutate + delete + slice predicate

2010-10-28 Thread Gary Dusbabek
The main difficulty is that row mutations are currently represented only in terms of individual columns. This has implications in the way the transaction is carried out and represented in the commit log. Introducing deletable slices is doable, but keeping it within the semantics of column family o

Re: Question regarding support of batch_mutate + delete + slice predicate

2010-10-28 Thread Jonathan Ellis
It's unscheduled (https://issues.apache.org/jira/browse/CASSANDRA-494, as you noted) because there's the obvious workaround of performing a slice and then deleting each column in the slice. It could happen during a 0.7 release since it wouldn't require API changes. 0.6 is basically bugfix-only at

Re: Question regarding support of batch_mutate + delete + slice predicate

2010-10-28 Thread aaron morton
I cannot see anything in jira scheduled for 0.7 or 0.8 . Gary may be able to shed some light on it. There is a comment at the bottom of CASSANDRA-293 "Range operations cannot be made to work with the existing implementation of hinted handoff. Further, they were a bad fit for the transactional u

Question regarding support of batch_mutate + delete + slice predicate

2010-10-27 Thread Dwight Smith
Investigation of this combination led to the following: http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/batch-m utate-deletion-slice-range-predicate-unsupported-td5048309.html Are there plans (6.x or 7) to support this? Thanks

Re: batch_mutate in 0.7

2010-10-25 Thread Chris Oei
Thanks Gary and Jonathan. Yeah, I'm planning on switching to Hector sometime soon; I started with Thrift mostly because I wanted to see what was going on underneath the hood before using a higher-level interface. I suppose now is as good a time to switch as any. Thanks, Chris On Mon, Oct 25, 2010

Re: batch_mutate in 0.7

2010-10-25 Thread Jonathan Ellis
t;   client.batch_mutate(keySpace, mutationMap, ConsistencyLevel.ONE); > But in 0.7, batch_mutate no longer has a keyspace argument, so I used: >   client.batch_mutate(mutationMap, ConsistencyLevel.ONE); > Not surprisingly, I got an error: >   InvalidRequestException(why:You have not set

Re: batch_mutate in 0.7

2010-10-25 Thread Gary Dusbabek
client.set_keyspace() On Mon, Oct 25, 2010 at 12:59, Chris Oei wrote: > So, I'm a bit puzzled about how to change my old 0.6 code to 0.7. > In 0.6, I used: >   client.batch_mutate(keySpace, mutationMap, ConsistencyLevel.ONE); > But in 0.7, batch_mutate no longer has a keyspa

batch_mutate in 0.7

2010-10-25 Thread Chris Oei
So, I'm a bit puzzled about how to change my old 0.6 code to 0.7. In 0.6, I used: client.batch_mutate(keySpace, mutationMap, ConsistencyLevel.ONE); But in 0.7, batch_mutate no longer has a keyspace argument, so I used: client.batch_mutate(mutationMap, ConsistencyLevel.ONE);

Re: batch_mutate silently failing in Cassandra

2010-09-07 Thread Jonathan Ellis
advise (both Jonathan and Aaron's) I was able to track the > problem down.  The issue was that running insert (also batch_mutate) and > using a consistencylevel of quorum on a cluster of 1 server with a > replication factor of 1 does not work.  Well, that is not accurate, let me > ex

Re: batch_mutate silently failing in Cassandra

2010-09-07 Thread Lucas Nodine
Partially Resolved... Taking your advise (both Jonathan and Aaron's) I was able to track the problem down. The issue was that running insert (also batch_mutate) and using a consistencylevel of quorum on a cluster of 1 server with a replication factor of 1 does not work. Well, that i

Re: batch_mutate silently failing in Cassandra

2010-09-07 Thread Lucas Nodine
would > also > > try the list. If you have any suggestions, please let me know > > > > I am working with Cassandra 0.6.5 using the thrift interface. I am trying > to > > use the batch_mutate method call, however, when I execute it, I receive > no > > error message

Re: batch_mutate silently failing in Cassandra

2010-09-07 Thread Aaron Morton
suggestions, please let me know I am working with Cassandra 0.6.5 using the thrift interface. I am trying to use the batch_mutate method call, however, when I execute it, I receive no error message. This leads me to believe it worked. When I check using the CLI, there is nothing there. Is there

Re: batch_mutate silently failing in Cassandra

2010-09-07 Thread Jonathan Ellis
osted the following to Stackoverflow, but thought that I would also > try the list.  If you have any suggestions, please let me know > > I am working with Cassandra 0.6.5 using the thrift interface. I am trying to > use the batch_mutate method call, however, when I execute it, I receive no

batch_mutate silently failing in Cassandra

2010-09-07 Thread Lucas Nodine
Hello all, I have posted the following to Stackoverflow, but thought that I would also try the list. If you have any suggestions, please let me know I am working with Cassandra 0.6.5 using the thrift interface. I am trying to use the batch_mutate method call, however, when I execute it, I

Re: order of mutations in batch_mutate

2010-09-01 Thread Jonathan Ellis
no On Wed, Sep 1, 2010 at 7:34 PM, Terje Marthinussen wrote: > Hi, > > Just a curiosity. I should probably read some code and write a test to make > sure, but not important enough right now for that :) > > void batch_mutate(string keyspace, map>> mutation_map, Consistenc

order of mutations in batch_mutate

2010-09-01 Thread Terje Marthinussen
Hi, Just a curiosity. I should probably read some code and write a test to make sure, but not important enough right now for that :) - void batch_mutate(string keyspace, map>> mutation_map, ConsistencyLevel consistency_level) Will performance of a batch_mutate be affected by the

Internal error processing batch_mutate

2010-08-27 Thread B. Todd Burruss
i got the latest code from tip of trunk this morning, but i'm seeing this. i recall a JIRA about this. maybe patch isn't on trunk? ERROR [pool-1-thread-61] 2010-08-27 15:55:36,429 Cassandra.java (line 2980) Internal error processing batch_mutate java.lang.NullPointerExcept

Re: batch_mutate atomicity

2010-08-09 Thread Peter Schuller
> I am using the familiar meanings from ACID: > > atomic means either the entire update will succeed or none of it. > > isolated means other threads will not see partial updates while it is > being applied. A related concern is whether there is a write *ordering* guarantee for mutations within a r

Re: batch_mutate atomicity

2010-08-07 Thread Benjamin Black
>> isolated means other threads will not see partial updates while it is >> being applied. > > yes, those terms are not new. > > it remains, that the answer with respect to isolation would be clearer were > it expressed in terms of cassandra's operations. given the t

Re: batch_mutate atomicity

2010-08-07 Thread james anderson
. it remains, that the answer with respect to isolation would be clearer were it expressed in terms of cassandra's operations. given the two-level map passed to batch_mutate, is it that another thread could see the effect of some mutation object in one entry of the inner key map, but no

Re: batch_mutate atomicity

2010-08-07 Thread Jonathan Ellis
at 02:45 , Jonathan Ellis wrote: > >> Everything in the same key of a batch_mutate is atomic.  (But not >> isolated.) >> > > what does the distinction mean in the context of cassandra? > is it that the execution of an operation with the same key could see the > ef

Re: batch_mutate atomicity

2010-08-06 Thread james anderson
good morning; On 2010-08-07, at 02:45 , Jonathan Ellis wrote: Everything in the same key of a batch_mutate is atomic. (But not isolated.) what does the distinction mean in the context of cassandra? is it that the execution of an operation with the same key could see the effect of the

Re: batch_mutate atomicity

2010-08-06 Thread Jonathan Ellis
Everything in the same key of a batch_mutate is atomic. (But not isolated.) On Fri, Aug 6, 2010 at 2:15 PM, B. Todd Burruss wrote: > ok i just saw the FAQ > (http://wiki.apache.org/cassandra/FAQ#batch_mutate_atomic) > > follow up question ... > > it states that "As a

Re: batch_mutate atomicity

2010-08-06 Thread B. Todd Burruss
in the same CF ... " so if i have several mutatations against a single key, but multiple column families i assume this is not atomic? thx On Fri, 2010-08-06 at 11:08 -0700, Todd Burruss wrote: > if i am using batch_mutate to update/insert two columns in the same CF > and same key, is this a

batch_mutate atomicity

2010-08-06 Thread B. Todd Burruss
if i am using batch_mutate to update/insert two columns in the same CF and same key, is this an atomic operation? i understand that an operation on a single key in a CF is atomic, but not sure if the above scenario boils down to two operations or considered one operation. thx

about use batch_mutate,can some one provide a example,i am using FluentCassandra

2010-06-28 Thread Medcl~
now i am confused about using the operation batch_mutate,when i follow the code from here:http://stackoverflow.com/questions/2783323/cassandra-batch-mutate/3137753#3137753 and it seems it has success inserted something,but when i use cassandra-cli to check it,it just return nothing, could

Re: Deletion and batch_mutate

2010-06-22 Thread Jonathan Ellis
right. in other words, you can delete entire rows w/ batch_mutate in 0.6.3 or trunk, but for 0.6.2 the best workaround is to issue multiple remove commands. On Tue, Jun 22, 2010 at 5:09 AM, Mishail wrote: > Take a look at > > https://issues.apache.org/jira/browse/CASSANDRA-494

Re: Deletion and batch_mutate

2010-06-22 Thread Mishail
. > I use Cassandra 0.6.2 and coding in Java, using the native Java Thrift API. > > The way my application works, I need to delete multiple rows at a time > (just like reads and writes). > Obviously, in terms of performance, I'd rather use batch_mutate and > delete several r

Deletion and batch_mutate

2010-06-22 Thread Ron
and writes). Obviously, in terms of performance, I'd rather use batch_mutate and delete several rows and not issue a remove command on each and every row. So far, all attempts doing so have failed. The following command configurations have been tested: 1. Deletion, without a Supercolumn or Sli

Re: batch_mutate atomic?

2010-06-14 Thread Gary Dusbabek
roundtrip of many update requests. > Some may fail and some may succeed > > On Mon, Jun 14, 2010 at 2:40 PM, Per Olesen wrote: >> >> Can I expect batch_mutate to work in what I would think of as an atomic >> operation? >> >> That either all the mutations in t

Re: batch_mutate atomic?

2010-06-14 Thread Ran Tavory
no, it's not atomic. it just shortens the roundtrip of many update requests. Some may fail and some may succeed On Mon, Jun 14, 2010 at 2:40 PM, Per Olesen wrote: > Can I expect batch_mutate to work in what I would think of as an atomic > operation? > > That either all the

batch_mutate atomic?

2010-06-14 Thread Per Olesen
Can I expect batch_mutate to work in what I would think of as an atomic operation? That either all the mutations in the batch_mutate call are executed or none of them are? Or can some of them fail while some of them succeeds?

Re: Batch_Mutate throws Uncaught exception

2010-05-28 Thread Moses Dinakaran
Hi, > > Just to clarify. Are you trying to insert a couple of columns with key > "cache_pages" in the ColumnFamily "Page"? > > Moses Dinakaran wrote: > i, > > > > > > > > I am trying to use batch_mutate() with PHP Thrift. I was getting the > > following error. > > > >

  1   2   >