Re: Problem with streaming data from Hadoop: DecoratedKey(-1, )

2013-05-24 Thread Michal Michalski
Sounds like a nasty heisenbug, can you replace or rebuild the machine? Heisenbug :D (never heard this name before :-) ) I thought so too, but I finally managed to reproduce it locally (it requires 3 nodes, one of them needs to have a specific token assigned), the rest just have to be present

Re: Problem with streaming data from Hadoop: DecoratedKey(-1, )

2013-05-24 Thread Michal Michalski
Hmmm... In general it seems that for some reason Cassandra reads invalid value when trying to get key length (it should be ~100-150, but it gets 2048), then basing on this value it reads too much data and when trying to read next key's length again it reads some garbage translating it to a

Re: column with TTL of 10 seconds lives very long...

2013-05-24 Thread Tamar Fraenkel
By it is still there I mean that when I do get request in Cassandra cli I get the column, as well as when I try to read the column using Hector. I don't think it is a matter of tombstone. I have the default gc_grace_seconds and I run repair weekly (will run on Sunday). Other columns for same CF

unsubscribe

2013-05-24 Thread Asha Subramanian
From: Michael Kjellman [mailto:mkjell...@barracuda.com] Sent: Thursday, January 17, 2013 12:13 AM To: user@cassandra.apache.org Subject: Re: unsubscribe Writing to the list user@cassandra.apache.org Subscription address user-subscr...@cassandra.apache.org Digest subscription address

Re: exception causes streaming to hang forever

2013-05-24 Thread Hiller, Dean
The exception on that node was just this ERROR [Thread-6056] 2013-05-22 14:47:59,416 CassandraDaemon.java (line 132) Exception in thread Thread[Thread-6056,5,main] java.lang.IndexOutOfBoundsException at sun.nio.ch.ChannelInputStream.read(ChannelInputStream.java:75) at

Usage of getKeyRange method

2013-05-24 Thread Renato Marroquín Mogrovejo
Hi all, I am trying to migrate some some Hector's RangeSlicesQuery to Astyanax, but the only method I have found is getKeyRange[1] which in turn has four parameters startKey,endKey, startToken, endToken, and count. The thing is that I am not sure what are the startToken and endToken parameters

Re: corrupt sstable

2013-05-24 Thread Edward Capriolo
Delete the data, and associated index/filter/etc files. (all the files with the same number). If you are reading at one, bring the node up and disable thrift then run repair. If you are reading at quorum or higher, not a big need to stop thrift. Just run repair. On Fri, May 24, 2013 at 10:07 AM,

pagination in cql3

2013-05-24 Thread Ondřej Černoš
Hi all, I need to support a legacy API where page offset and limit are on the input of the API call (it used to be mapped directly to offset and limit MySQL select options). The data are pretty small (like really small, some hundreds of thousands narrow rows maximum - I use Cassandra for its

Re: exception causes streaming to hang forever

2013-05-24 Thread Yuki Morishita
hmm, I only can say it may caused by corrupt SSTable... Stream hang on unexpected error was fixed in 1.2.5 (https://issues.apache.org/jira/browse/CASSANDRA-5229). On Fri, May 24, 2013 at 6:56 AM, Hiller, Dean dean.hil...@nrel.gov wrote: The exception on that node was just this ERROR

found the issue on bootstrap streaming hang

2013-05-24 Thread Hiller, Dean
For anyone else that might be interested, when the stream hangs, there is no exceptions around that time frame as to what exactly happened and why it hung(there is an exception just not informative at all). We did find other exceptions that we thought were unrelated though days before. We

Re: exception causes streaming to hang forever

2013-05-24 Thread Hiller, Dean
Lol, yup, I just found out that is the issue Thanks, Dean On 5/24/13 8:55 AM, Yuki Morishita mor.y...@gmail.com wrote: hmm, I only can say it may caused by corrupt SSTable... Stream hang on unexpected error was fixed in 1.2.5 (https://issues.apache.org/jira/browse/CASSANDRA-5229). On Fri,

Re: pagination in cql3

2013-05-24 Thread Sylvain Lebresne
The short answer is yes, you can rely on the ordering of keys being consistent. They will always be returned in partitioner order. This is pretty much implied by the existence of the token() function so it's not going to change (if only because changing it would break people). -- Sylvain On

changing ips on node replacement

2013-05-24 Thread Hiller, Dean
I seem to remember problems with ghost nodes, etc. and I seem to remember if you are replacing a node and you don’t use the same ip, this can cause issues. Is this correct? We would like the new node to keep the same token, and the same host name but are wondering if we can change the ip

Re: corrupt sstable

2013-05-24 Thread Robert Coli
On Fri, May 24, 2013 at 7:07 AM, Hiller, Dean dean.hil...@nrel.gov wrote: We have a corrupt sstable databus5-nreldata-ib-36763-Data.db. How do we safely blow this away? (and then we would run repair to make sure all data is still there)… Can we just move the file out from under cassandra?

Re: Cassandra read reapair

2013-05-24 Thread Kais Ahmed
Hi aaron an thanks, If you are reading and writing at CL QUOURM and getting inconsistent results that sounds like a bug. If you are mixing the CL levels such that R + W = N then it's expected behaviour. I think it's a bug, it concern only some keys (~200 over 120 000 keys) on one column family,

Re: changing ips on node replacement

2013-05-24 Thread Robert Coli
On Fri, May 24, 2013 at 9:01 AM, Hiller, Dean dean.hil...@nrel.gov wrote: I seem to remember problems with ghost nodes, etc. and I seem to remember if you are replacing a node and you don’t use the same ip, this can cause issues. Is this correct? If you don't use replace_token, this won't

Hector vs Astyanax dependency issue

2013-05-24 Thread Renato Marroquín Mogrovejo
Hi all, I am using Astyanax and Hector client within an application but right now I am hitting a dependency issue [1] related to Guava version being used by Hector and Astyanax which makes Maven headache. I have taken it out as exclusions within my poms but I still get the dependency issue. Do

Re: Usage of getKeyRange method

2013-05-24 Thread Andrey Ilinykh
you can specify startKey/endKey only if you use ByteOrederedPartitioner. In this case startToken/endToken are null. I guess (but not sure) with RandomPartitioner you have to specify startToken/endToken, keys are null then. Thank you, Andrey On Fri, May 24, 2013 at 6:53 AM, Renato Marroquín