Re: Better option to load data to cassandra

2014-11-13 Thread Robert Coli
On Wed, Nov 12, 2014 at 5:19 PM, cass savy casss...@gmail.com wrote: Sstableloader works well for large tables if you want to move data from Cassandra to Cassandra. This works if both C* are on the same version. Sstable2json and json2sstable is another alternative. This post is getting a bit

Re: Cassandra sort using updatable query

2014-11-13 Thread Chamila Wijayarathna
Hi Jonathan, Thank you very much, it worked this way. On Thu, Nov 13, 2014 at 12:07 AM, Jonathan Haddad j...@jonhaddad.com wrote: With Cassandra you're going to want to model tables to meet the requirements of your queries instead of like a relational database where you build tables in 3NF

Re: Better option to load data to cassandra

2014-11-13 Thread Jonathan Lacefield
Here's another post which is pretty comprehensive for this topic. http://informationsurvival.blogspot.com/2014/02/cassandra-cql3-integration.html [image: datastax_logo.png] Jonathan Lacefield Solution Architect | (404) 822 3487 | jlacefi...@datastax.com [image: linkedin.png]

Re: Programmatic Cassandra version detection/extraction

2014-11-13 Thread Chris Lohfink
There is a ReleaseVersion attribute in the org.apache.cassandra.db:StorageService bean --- Chris Lohfink On Wed, Nov 12, 2014 at 5:57 PM, Michael Shuler mich...@pbandjelly.org wrote: On 11/12/2014 04:58 PM, Michael Shuler wrote: On 11/12/2014 04:44 PM, Otis Gospodnetic wrote: Is there a

Re: Programmatic Cassandra version detection/extraction

2014-11-13 Thread Tim Dunphy
This is interesting. If I do a SELECT release_version from system.local; on my system it's telling me that I'm using 2.1.1 [root@beta-new:/usr/local/apache-cassandra-2.1.2] #cqlsh Connected to Jokefire Cluster at beta-new.jokefire.com:9042. [cqlsh 5.0.1 | Cassandra 2.1.1 | CQL spec 3.2.0 | Native

Re: Better option to load data to cassandra

2014-11-13 Thread Shane Hansen
So sstableloader is a cpu efficient online method of loading data if you already have sstables. An option you may not have considered is just using batch inserts. It was a surprise to me coming from another database system, but C*'s primary use case is shoving data to an append only log. Is there

Is it more performant to split data with the same schema into multiple keyspaces, as supposed to put all of them into the same keyspace?

2014-11-13 Thread Li, George
Hi, we use Cassandra to store some association type of data. For example, store user to course (course registrations) association and user to school (school enrollment) association data. The schema for these two types of associations are the same. So there are two options to store the data: 1. Put

Re: Is it more performant to split data with the same schema into multiple keyspaces, as supposed to put all of them into the same keyspace?

2014-11-13 Thread Jonathan Haddad
Performance will be the same. There's no performance benefit to using multiple keyspaces. On Thu Nov 13 2014 at 8:42:40 AM Li, George guangxing...@pearson.com wrote: Hi, we use Cassandra to store some association type of data. For example, store user to course (course registrations)

Re: Is it more performant to split data with the same schema into multiple keyspaces, as supposed to put all of them into the same keyspace?

2014-11-13 Thread Tyler Hobbs
That's not necessarily true. You don't need to split them into separate keyspaces, but separate tables may have some advantages. For example, in Cassandra 2.1, compaction and index summary management are optimized based on read rates for SSTables. If you have different read rates or patterns

Re: Is it more performant to split data with the same schema into multiple keyspaces, as supposed to put all of them into the same keyspace?

2014-11-13 Thread Jonathan Haddad
Tables, yes, but that wasn't the question. The question was around using different keyspaces. On Thu Nov 13 2014 at 9:17:30 AM Tyler Hobbs ty...@datastax.com wrote: That's not necessarily true. You don't need to split them into separate keyspaces, but separate tables may have some

Re: Programmatic Cassandra version detection/extraction

2014-11-13 Thread Alex Popescu
On Wed, Nov 12, 2014 at 2:44 PM, Otis Gospodnetic otis.gospodne...@gmail.com wrote: Hi, Is there a way to detect which version of Cassandra one is running? Is there an API for that, or a constant with this value, or maybe an MBean or some other way to get to this info? Here's the use

Cassandra communication between 2 datacenter

2014-11-13 Thread Adil
Hi, we have two datacenter with those inof: Cassandra version 2.1.0 DC1 with 5 nodes DC2 with 5 nodes we set the snitch to GossipingPropertyFileSnitch and in cassandra-rackdc.properties we put: in DC1: dc=DC1 rack=RAC1 in DC2: dc=DC2 rack=RAC1 and in every node's cassandra.yaml we define two

Re: Cassandra communication between 2 datacenter

2014-11-13 Thread Robert Coli
On Thu, Nov 13, 2014 at 10:26 AM, Adil adil.cha...@gmail.com wrote: Hi, we have two datacenter with those inof: Cassandra version 2.1.0 DC1 with 5 nodes DC2 with 5 nodes we set the snitch to GossipingPropertyFileSnitch and in cassandra-rackdc.properties we put: in DC1: dc=DC1

Re: Cassandra communication between 2 datacenter

2014-11-13 Thread Adil
yeh we started nodes one at timemy doubt is if we should configure alse cassandra-topology.properties or not? we leave it with default vlaues 2014-11-13 21:05 GMT+01:00 Robert Coli rc...@eventbrite.com: On Thu, Nov 13, 2014 at 10:26 AM, Adil adil.cha...@gmail.com wrote: Hi, we have two

Re: Cassandra communication between 2 datacenter

2014-11-13 Thread Eric Plowe
Are you sure that both DC's can communicate with each other over the necessary ports? On Thu, Nov 13, 2014 at 3:46 PM, Adil adil.cha...@gmail.com wrote: yeh we started nodes one at timemy doubt is if we should configure alse cassandra-topology.properties or not? we leave it with default

TLS for clients on DSE

2014-11-13 Thread Danie Viljoen
Hi I configured TLS encryption for cqlsh and cassandra (open source). I now have to do it for DataStax Enterprise. I found the cassandra.yaml file (for DSE, .dse-4.5.3/resources/cassandra/conf. Same changes as previously..but not the same results. Any pointers? Regards Danie

Questiona about node repair

2014-11-13 Thread Di, Jieming
Hi There, I have a question about Cassandra node repair, there is a function called forceTerminateAllRepairSessions();, so will the function terminate all the repair session in only one node, or it will terminate all the session in a ring? And when it terminates all repair sessions, does it

OR mapping for set appends…

2014-11-13 Thread Kevin Burton
I’m trying to figure out the best way to handle things like set appends (and other CQL extensions) in traditional OR mapping. Our OR mapper does basic setFoo() .. then save() to write the record back to the database. So if foo is a Sett then I can set all members. But I want to do some appends

how wide can wide rows get?

2014-11-13 Thread Adaryl Bob Wakefield, MBA
I’m struggling with this wide row business. Is there an upward limit on the number of columns you can have? Adaryl Bob Wakefield, MBA Principal Mass Street Analytics 913.938.6685 www.linkedin.com/in/bobwakefieldmba Twitter: @BobLovesData

Re: how wide can wide rows get?

2014-11-13 Thread Hannu Kröger
The theoretical limit is maybe 2 billion but recommended max is around 10-20 thousand. Br, Hannu On 14.11.2014, at 8.10, Adaryl Bob Wakefield, MBA adaryl.wakefi...@hotmail.com wrote: I’m struggling with this wide row business. Is there an upward limit on the number of columns you can

Re: how wide can wide rows get?

2014-11-13 Thread Joe Ramsey
You can have up to 2 billion columns but there are some considerations. This article might be of some help. http://www.ebaytechblog.com/2012/08/14/cassandra-data-modeling-best-practices-part-2/#.VGWdT4enCS0

Re[2]: how wide can wide rows get?

2014-11-13 Thread Plotnik, Alexey
We have 380k of them in some of our rows and it's ok. -- Original Message -- From: Hannu Kröger hkro...@gmail.commailto:hkro...@gmail.com To: user@cassandra.apache.org user@cassandra.apache.orgmailto:user@cassandra.apache.org Sent: 14.11.2014 16:13:49 Subject: Re: how wide can wide rows

about collections limit

2014-11-13 Thread diwayou
can i scan collection (list, set) paged by limit?

Re: OR mapping for set appends…

2014-11-13 Thread DuyHai Doan
Alternatively build a SetWrapper that extends the Java sets interface and intercepts calls to add(), addAll(), remove() For each of these method, the SetWrapper will generate an appropriate UPDATE statement. This is more general purpose than just an AppendSet. TTL is another story, it is

Re: Re[2]: how wide can wide rows get?

2014-11-13 Thread Takenori Sato
We have up to a few hundreds of millions of columns in a super wide row. There are two major issues you should care about. 1. the wider the row is, the more memory pressure you get for every slice query 2. repair is row based, which means a huge row could be transferred at every repair 1 is not