Re: Counter value becomes incorrect after several dozen reads writes

2013-06-25 Thread Robert Coli
On Mon, Jun 24, 2013 at 6:42 PM, Josh Dzielak j...@keen.io wrote: There is only 1 thread running this sequence, and consistency levels are set to ALL. The behavior is fairly repeatable - the unexpectation mutation will happen at least 10% of the time I run this program, but at different points.

Re: Counter value becomes incorrect after several dozen reads writes

2013-06-25 Thread Andrew Bialecki
If you can reproduce the invalid behavior 10+% of the time with steps to repro that take 5-10s/iteration, that sounds extremely interesting for getting to the bottom of the invalid shard issue (if that's what the root cause ends up being). Would be very interested in the set up to see if the

Re: Counter value becomes incorrect after several dozen reads writes

2013-06-24 Thread Arthur Zubarev
Hi Josh, are you looking at the read counter produced by cfstats? If so it is not for a CF, but the entire KS and not tied to a specific operation, but rather per the entire lifetime of JVM. Just in case, some supporting info:

Re: Counter value becomes incorrect after several dozen reads writes

2013-06-24 Thread Josh Dzielak
Hi Arthur, This is actually for a column in a counter column family, i.e. CounterColumnType. Will check out that thread though, thanks. Best, Josh -- Josh Dzielak VP Engineering • Keen IO Twitter • @dzello (https://twitter.com/dzello) Mobile • 773-540-5264 On Monday, June 24, 2013 at