Missing table suffix in data directory directories

2016-10-09 Thread Jason Kania
Hello, In the data directory of my 3.0.9 installation, I have directories with both suffixes and without: periodicReading periodicReadingTemp-76eb7510096811e68a7421c8b9466352 The directories with and without suffixes are being updated and for those with a suffix, the suffix matches the output of

Re: Understanding cassandra data directory contents

2016-10-08 Thread Jason Kania
these unused directories? Thanks, Jason Kania From: Vladimir Yudovin <vla...@winguzone.com> To: user@cassandra.apache.org; Jason Kania <jason.ka...@ymail.com> Sent: Saturday, October 8, 2016 2:05 PM Subject: Re: Understanding cassandra data directory contents Each table h

Understanding cassandra data directory contents

2016-10-08 Thread Jason Kania
Hello, I am using Cassandra 3.0.9 and I have encountered an issue where the nodes in my 3 node cluster have vastly different amounts of data even though they should be roughly the same. When I looked through the data directory for my database on two of the nodes, I see a number of directories

Re: Nodetool repair inconsistencies

2016-06-08 Thread Jason Kania
com> To: user@cassandra.apache.org; Jason Kania <jason.ka...@ymail.com> Sent: Wednesday, June 8, 2016 12:55 PM Subject: Re: Nodetool repair inconsistencies Hi Jason - Did you run a major compaction after the repair completed? Do you have other reasons besides the number/size

Re: Nodetool repair inconsistencies

2016-06-08 Thread Jason Kania
compact error. Thanks, Jason From: Romain Hardouin <romainh...@yahoo.fr> To: "user@cassandra.apache.org" <user@cassandra.apache.org>; Jason Kania <jason.ka...@ymail.com> Sent: Wednesday, June 8, 2016 8:30 AM Subject: Re: Nodetool repair inconsistencies

Nodetool repair inconsistencies

2016-06-07 Thread Jason Kania
I am running a 3 node cluster of 3.0.6 instances and encountered an error when running nodetool compact. I then ran nodetool repair. No errors were returned. I then attempted to run nodetool compact again, but received the same error so the repair made no correction and reported no errors. After

Re: Inconsistent query results and node state

2016-03-31 Thread Jason Kania
rsion of Cassandra are you running? On Wed, Mar 30, 2016 at 9:59 AM, Kai Wang <dep...@gmail.com> wrote: Do you have NTP setup on all nodes? On Tue, Mar 29, 2016 at 11:48 PM, Jason Kania <jason.ka...@ymail.com> wrote: We have encountered a query inconsistency problem wherein the foll

Re: Inconsistent query results and node state

2016-03-31 Thread Jason Kania
Thanks for the response. All nodes are using NTP. Thanks, Jason From: Kai Wang <dep...@gmail.com> To: user@cassandra.apache.org; Jason Kania <jason.ka...@ymail.com> Sent: Wednesday, March 30, 2016 10:59 AM Subject: Re: Inconsistent query results and node state Do you ha

Inconsistent query results and node state

2016-03-29 Thread Jason Kania
We have encountered a query inconsistency problem wherein the following query returns different results sporadically with invalid values for a timestamp field looking like the field is uninitialized (a zero timestamp) in the query results. Attempts to repair and compact have not changed the

Re: Strategy for dividing wide rows beyond just adding to the partition key

2016-03-12 Thread Jason Kania
e more over the weekend. Also, these queries focus on raw, bulk retrieval of sensor data readings, but do you have reading-based queries, such as range of an actual sensor reading? -- Jack Krupansky On Fri, Mar 11, 2016 at 7:08 PM, Jason Kania <jason.ka...@ymail.com> wrote: The 5000 readin

Re: Strategy for dividing wide rows beyond just adding to the partition key

2016-03-12 Thread Jason Kania
jump to solutions until we have a firmer handle on the query side of the fence. -- Jack Krupansky On Fri, Mar 11, 2016 at 5:37 PM, Jason Kania <jason.ka...@ymail.com> wrote: Jack, Thanks for the response. We are targeting our database design to 1 sensor units and each sensor unit has

Re: Strategy for dividing wide rows beyond just adding to the partition key

2016-03-11 Thread Jason Kania
he probability of a timeout directly linked to a longer seek time in reading through a partition's contents? If that is the case, splitting the partition keys into a separate table would be straightforward. Regards, Jason From: Jack Krupansky <jack.krupan...@gmail.com> To: user@cassand

Re: Strategy for dividing wide rows beyond just adding to the partition key

2016-03-11 Thread Jason Kania
there really is a method to understanding all of this other stuff upfront. -- Jack Krupansky On Thu, Mar 10, 2016 at 12:39 PM, Jason Kania <jason.ka...@ymail.com> wrote: Jack, Thanks for the response. I don't think I provided enough information and used the wrong terminology as you

Re: Strategy for dividing wide rows beyond just adding to the partition key

2016-03-10 Thread Jason Kania
: user@cassandra.apache.org; Jason Kania <jason.ka...@ymail.com> Sent: Thursday, March 10, 2016 10:42 AM Subject: Re: Strategy for dividing wide rows beyond just adding to the partition key There is an effort underway to support wider rows:https://issues.apache.org/jira/browse/CASSANDRA-9754 This wo

Re: Strategy for dividing wide rows beyond just adding to the partition key

2016-03-10 Thread Jason Kania
be appreciated. Thanks, Jason From: Jonathan Haddad <j...@jonhaddad.com> To: user@cassandra.apache.org; Jason Kania <jason.ka...@ymail.com> Sent: Thursday, March 10, 2016 11:21 AM Subject: Re: Strategy for dividing wide rows beyond just adding to the partition key Have you consi

Strategy for dividing wide rows beyond just adding to the partition key

2016-03-10 Thread Jason Kania
Hi, We have sensor input that creates very wide rows and operations on these rows have started to timeout regulary. We have been trying to find a solution to dividing wide rows but keep hitting limitations that move the problem around instead of solving it. We have a partition key consisting of

Re: How to complete bootstrap with exception due to stream failure?

2016-02-28 Thread Jason Kania
I raised https://issues.apache.org/jira/browse/CASSANDRA-11273 with these details and the workaround that I found. From: Paulo Motta <pauloricard...@gmail.com> To: "user@cassandra.apache.org" <user@cassandra.apache.org>; Jason Kania <jason.ka...@ymail.com> Sen

Re: How to complete bootstrap with exception due to stream failure?

2016-02-27 Thread Jason Kania
-89f591237aca] Received null From: Sebastian Estevez <sebastian.este...@datastax.com> To: user@cassandra.apache.org; Jason Kania <jason.ka...@ymail.com> Sent: Saturday, February 27, 2016 8:24 PM Subject: Re: How to complete bootstrap with exception due to stream failure? progres

How to complete bootstrap with exception due to stream failure?

2016-02-27 Thread Jason Kania
Hello, I am trying to get a node bootstrapped in 3.0.3, but just at the point where the bootstrap process is to complete, a broken pipe exception occurs so the bootstrap process hangs. Once I kill the bootstrap process, I can execute "nodetool bootstrap resume" again and the same problem will

Migrating from single node to cluster

2016-02-25 Thread Jason Kania
Hi, I am wondering if there is any documentation on migrating from a single node cassandra instance to a multinode cluster? My searches have been unsuccessful so far and I have had no luck playing with tools due to terse output from the tools. I currently use a single node having data that

Re: Reenable data access after temporarily moving data out of data directory

2016-02-24 Thread Jason Kania
Thanks for the tool reference. That will help. The second part of my question was whether there is a way to actually perform data repair aside from copying data from a replica. Thanks, Jason From: Carlos Alonso <i...@mrcalonso.com> To: user@cassandra.apache.org; Jason Kania <

Reenable data access after temporarily moving data out of data directory

2016-02-23 Thread Jason Kania
Hi, I encountered an error in Cassandra or the latest Oracle JVM that causes the JVM to terminate during compaction in my situation (CASSANDRA 11200). In trying work around the problem and access the data , I moved the data eg ma-NNN-big-Filter.db, ma-367-big-Data.db etc. out of the data

Comprehensive documentation on Cassandra Data modelling

2014-12-16 Thread Jason Kania
Hi, I have been having a few exchanges with contributors to the project around what is possible with Cassandra and a common response that comes up when I describe functionality as broken or missing is that I am not modelling my data correctly. Unfortunately, I cannot seem to find comprehensive

Re: Comprehensive documentation on Cassandra Data modelling

2014-12-16 Thread Jason Kania
application requires a fundamental rethink of all the assumptions we've been taught for master/slave style databases. On Tue, Dec 16, 2014 at 10:46 AM, Jason Kania jason.ka...@ymail.com wrote: Hi, I have been having a few exchanges with contributors to the project around what is possible

Access to locally partitioned data

2014-12-14 Thread Jason Kania
Hello, I am wondering if there is a way to obtain results from a table where only the results from the local partition are returned in the query? To give some background, my application requires millions of timers and since queue-like implementations are a bad fit/anti-pattern for Cassandra, I