Re: Cqlsh hangs & closes automatically

2016-02-02 Thread Tyler Hobbs
The default page size in cqlsh is 100, so perhaps something is going on there? Try running cqlsh with --debug to see if there are any errors. On Tue, Feb 2, 2016 at 11:21 AM, Anuj Wadehra wrote: > My cqlsh prompt hangs and closes if I try to fetch just 100 rows using >

Re: Moving Away from Compact Storage

2016-02-02 Thread Anuj Wadehra
Will it be possible to read dynamic columns data from compact storage and trasform them as collection e.g. map in new table? ThanksAnuj Sent from Yahoo Mail on Android On Wed, 3 Feb, 2016 at 12:28 am, DuyHai Doan wrote: So there is no "static" (in the sense of CQL

Re: Moving Away from Compact Storage

2016-02-02 Thread Anuj Wadehra
Our old table looks like this from cqlsh: CREATE TABLE table table1 (  key text,  "Col1" blob,  "Col2" text,  "Col3" text,  "Col4" text,  PRIMARY KEY (key)) WITH COMPACT STORAGE AND … And it will have some dynamic text data which we are planning to add in collections.. Please let me know if you

Re: Moving Away from Compact Storage

2016-02-02 Thread DuyHai Doan
Can you give the CREATE TABLE script for you old compact storage table ? Or at least the cassandra-client creation script On Tue, Feb 2, 2016 at 3:48 PM, Anuj Wadehra wrote: > Thanks DuyHai !! We were also thinking to do it the "Spark" way but I was > not sure that its

Re: Moving Away from Compact Storage

2016-02-02 Thread DuyHai Doan
So there is no "static" (in the sense of CQL static) column in your legacy table. Just define a Scala case class to match this table and use Spark to dump the content to a new non compact CQL table On Tue, Feb 2, 2016 at 7:55 PM, Anuj Wadehra wrote: > Our old table

Re: Moving Away from Compact Storage

2016-02-02 Thread DuyHai Doan
You 'll need to do the transformation in Spark, although I don't understand what you mean by "dynamic columns". Given the CREATE TABLE script you gave earlier, there is nothing such as dynamic columns On Tue, Feb 2, 2016 at 8:01 PM, Anuj Wadehra wrote: > Will it be

Re : Possibility of using 2 different snitches in the Multi_DC cluster

2016-02-02 Thread sai krishnam raju potturi
hi; we have a multi-DC cluster spanning across our own private cloud and AWS. We are currently using Propertyfile snitch across our cluster. What is the possibility of using GossipingPropertFileSnitch on datacenters in our private cloud, and Ec2MultiRegionSnitch in AWS? Thanks in advance for

Re: Re : Possibility of using 2 different snitches in the Multi_DC cluster

2016-02-02 Thread Robert Coli
On Tue, Feb 2, 2016 at 1:23 PM, sai krishnam raju potturi < pskraj...@gmail.com> wrote: > What is the possibility of using GossipingPropertFileSnitch on datacenters > in our private cloud, and Ec2MultiRegionSnitch in AWS? > You should just use GPFS everywhere. This is also the reason why you

Re: cassandra-stress tool - InvalidQueryException: Batch too large

2016-02-02 Thread Ralf Steppacher
I have raised https://issues.apache.org/jira/browse/CASSANDRA-11105 . Thanks! Ralf > On 01.02.2016, at 15:01, Jake Luciani wrote: > > Yeah that looks like a bug. Can you open a JIRA and attach the full .yaml? > >

Clustering key values not distributed

2016-02-02 Thread Ralf Steppacher
I am trying to get the stress tool to generate random values for three clustering keys. I am trying to simulate collecting events per user id (text, partition key). Events have a session type (text), event type (text), and creation time (timestamp) (clustering keys, in that order). For testing

Re: Moving Away from Compact Storage

2016-02-02 Thread Anuj Wadehra
Thanks DuyHai !! We were also thinking to do it the "Spark" way but I was not sure that its would be so simple :) We have a compact storage cf with each row having some data in staticly defined columns while other data in dynamic columns. Is the approach mentioned in link adaptable to the

Re: automated CREATE TABLE just nuked my cluster after a 2.0 -> 2.1 upgrade....

2016-02-02 Thread Sebastian Estevez
Hi Ken, Earlier in this thread I posted a link to https://issues.apache.org/jira/browse/CASSANDRA-9424 That is the fix for these schema disagreement issues and as ay commented, the plan is to use CAS. Until then we have to treat schema delicately. all the best, Sebastián On Feb 2, 2016 9:48

Re: automated CREATE TABLE just nuked my cluster after a 2.0 -> 2.1 upgrade....

2016-02-02 Thread Ken Hancock
So this rings odd to me. If you can accomplish the same thing by using a CAS operation, why not fix create table if not exist so that if your are writing an application that creates the table on startup, that the application is safe to run on multiple nodes and uses CAS to safeguard multiple

How are timestamps selected for LWTs?

2016-02-02 Thread Nicholas Wilson
Hi, In the Cassandra docs I've read, it's not described how the timestamp is determined for LWTs. It's not possible to specify a timestamp with "USING TIMESTAMP ...", and my best guess is that in the "read" phase of the LWT (between propose and commit) the timestamp is selected based on the

Re: How are timestamps selected for LWTs?

2016-02-02 Thread Nicholas Wilson
Thanks, Sylvain. I missed it because I wasn't looking in the right place! In StorageProxy::cas, Commit::newProposal() unpacks the ballot's UUID into a timestamp. I think I understand how it works now, thank you. Regards, Nick From: Sylvain Lebresne

Re: How are timestamps selected for LWTs?

2016-02-02 Thread Sylvain Lebresne
On Tue, Feb 2, 2016 at 10:46 AM, Nicholas Wilson < nicholas.wil...@realvnc.com> wrote: > Hi, > > In the Cassandra docs I've read, it's not described how the timestamp is > determined for LWTs. It's not possible to specify a timestamp with "USING > TIMESTAMP ...", and my best guess is that in the

Re: Java Driver Question

2016-02-02 Thread Sylvain Lebresne
As a side note, if your email subject is "Java Driver Question", then this almost surely belong to the java driver mailing list. Please try to respect other subscribers by using the most appropriate mailing list when possible. On Tue, Feb 2, 2016 at 5:01 PM, Richard L. Burton III

Re: Java Driver Question

2016-02-02 Thread Richard L. Burton III
Awesome! I love that. :) On Tue, Feb 2, 2016 at 11:14 AM, Alex Popescu wrote: > > On Tue, Feb 2, 2016 at 8:12 AM, Richard L. Burton III > wrote: > >> is this behavior only related to the Java Drivers? > > > All DataStax drivers for Cassandra provide the

Re: Java Driver Question

2016-02-02 Thread Jack Krupansky
No need to restart. As per the doc for Node Discovery: "The driver discovers the nodes that constitute a cluster by querying the contact points used in building the cluster object. After this it is up to the cluster's load balancing policy to keep track of node events (that is add, down, remove,

Re: Java Driver Question

2016-02-02 Thread Richard L. Burton III
I wasn't aware there was another mailing list specifically for this. Another question, is this behavior only related to the Java Drivers? On Tue, Feb 2, 2016 at 11:05 AM, Sylvain Lebresne wrote: > As a side note, if your email subject is "Java Driver Question", then this >

Re: automated CREATE TABLE just nuked my cluster after a 2.0 -> 2.1 upgrade....

2016-02-02 Thread Ken Hancock
Just to close the loop on this, but am I correct that the IF NOT EXITS isn't the real problem? Even multiple calls to CREATE TABLE cause the same schema mismatch if done concurrently? Normally, a CREATE TABLE call will return an exception that the table already exists. On Tue, Feb 2, 2016 at

Re: Java Driver Question

2016-02-02 Thread Alex Popescu
On Tue, Feb 2, 2016 at 8:12 AM, Richard L. Burton III wrote: > is this behavior only related to the Java Drivers? All DataStax drivers for Cassandra provide the node discovery feature and are aware of the cluster topology. -- Bests, Alex Popescu | @al3xandru Sen.

Re: Cassandra's log is full of mesages reset by peers even without traffic

2016-02-02 Thread Anuj Wadehra
Hi Jean, As mentioned in the DataStax link, your TCP connections will be marked dead after 300+75*9 =975 seconds. Make sure that your firewall idle timeout is more than 975 seconds. Otherwise firewall will drop connections and you may face issues.You can also try setting all three values same

Cqlsh hangs & closes automatically

2016-02-02 Thread Anuj Wadehra
My cqlsh prompt hangs and closes if I try to fetch just 100 rows using select * query. Cassandra-cli does the job. Any solution? ThanksAnuj

Re: Java Driver Question

2016-02-02 Thread Richard L. Burton III
Very nice - Thanks Jack. I was looking at the docs and Contact Points but didn't see this. I'll use DNS records to manage the main contact points and update the DNS when those servers change. We should catch up again soon. Last time was a few years ago at the bar with Jake. On Tue, Feb 2, 2016

Re: automated CREATE TABLE just nuked my cluster after a 2.0 -> 2.1 upgrade....

2016-02-02 Thread Jack Krupansky
And CASSANDRA-10699 seems to be the sub-issue of CASSANDRA-9424 to do that: https://issues.apache.org/jira/browse/CASSANDRA-10699 -- Jack Krupansky On Tue, Feb 2, 2016 at 9:59 AM, Sebastian Estevez < sebastian.este...@datastax.com> wrote: > Hi Ken, > > Earlier in this thread I posted a link

Re: Java Driver Question

2016-02-02 Thread Sebastian Estevez
Yes, topology changes get pushed to the client via the control connection: https://github.com/datastax/java-driver/blob/2.1/driver-core/src/main/java/com/datastax/driver/core/Cluster.java#L61 all the best, Sebastián On Feb 2, 2016 10:47 AM, "Richard L. Burton III" wrote: >

Java Driver Question

2016-02-02 Thread Richard L. Burton III
In the case of adding more nodes to the cluster, would my application have to be restarted to detect the new nodes (as opposed to a node acting like a coordinator). e.g., Having the Java code connect using 3 known contact points and when a 4th and 5th node are added, the driver will become aware

Missing rows while scanning table using java driver

2016-02-02 Thread Priyanka Gugale
Hi, I am using Cassandra 2.2.0 and cassandra driver 2.1.8. I am trying to scan a table as per suggestions given here , On running the code to fetch records from table, it fetches different number of

Re: Missing rows while scanning table using java driver

2016-02-02 Thread DuyHai Doan
Why don't you use server-side paging feature instead of messing with tokens ? http://datastax.github.io/java-driver/manual/paging/ On Wed, Feb 3, 2016 at 7:36 AM, Priyanka Gugale wrote: > Hi, > > I am using Cassandra 2.2.0 and cassandra driver 2.1.8. I am trying to scan > a

Re: Missing rows while scanning table using java driver

2016-02-02 Thread priyanka gugale
Thanks DuyHai for revert. There are going to be pauses between fetching pages. For that they do seem to have an option to save page state. I will try that out. -Priyanka On Wed, Feb 3, 2016 at 12:14 PM, DuyHai Doan wrote: > Why don't you use server-side paging feature

Re: Moving Away from Compact Storage

2016-02-02 Thread Jack Krupansky
Dynamic columns are handled in CQL using either map collections or clustering columns or a combination of the two. -- Jack Krupansky On Tue, Feb 2, 2016 at 10:11 PM, Anuj Wadehra wrote: > By dynamic columns, I mean columns not defined in schema. In current > scenario,

Re: Moving Away from Compact Storage

2016-02-02 Thread Anuj Wadehra
By dynamic columns, I mean columns not defined in schema. In current scenario, every row has some data in columns which are defined in schema while rest of the data is in columns which are not defined in schema. We used Thrift for inserting data. In new schema, we want to create a collection

Re: Missing rows while scanning table using java driver

2016-02-02 Thread Ryan Svihla
Priyanka, This is a better question for the Cassandra user mailing list (cc’d above) which is where many experts in the use of Cassandra are subscribed, where as this list is more about improving or changing Cassandra itself. As to your issue, there can be many combined issues at once that are