Re: TTransportException (java.net.SocketException: Broken pipe)

2014-07-08 Thread Mark Reddy
Hi Bhaskar, Can you check your limits using 'ulimit -a'? The default is 1024, which needs to be increased if you have not done so already. Here you will find a list of recommended production settings:

RE: Compaction causing listeners to stall

2014-07-08 Thread Bryon Spahn
Robert, New development today: FSReadError in /mnt/data/cassandra/COMPANY/crmFieldInfo/COMPANYFieldInfo-jb-710-Data.db at org.apache.cassandra.io.compress.CompressedRandomAccessReader.reBuffer(CompressedRandomAccessReader.java:95) at

help on querying cassandra

2014-07-08 Thread srinivas rao
Hi All, When i query the cassandra, it creates a cartesion produt on my input request (row keys * column keys). Is there any way to query cassandra with map kind of input as below. current scenarios 5 row keys, 5 column keys as below = result data with 25 (if data is available). example

Easy diff of schema from dev-production

2014-07-08 Thread Kevin Burton
Are there any easy/elegant ways to compare dev schema to production schema. I want to find if there are any rows/columns we need to add. I could try to format the output and just use 'diff' … but with the table options that isn't super clean either. -- Founder/CEO Spinn3r.com Location: *San

Re: Easy diff of schema from dev-production

2014-07-08 Thread Shane Hansen
I'd suggest looking at the system keyspace. Like schema_columns On Jul 8, 2014 9:39 AM, Kevin Burton bur...@spinn3r.com wrote: Are there any easy/elegant ways to compare dev schema to production schema. I want to find if there are any rows/columns we need to add. I could try to format the

Re: Easy diff of schema from dev-production

2014-07-08 Thread DuyHai Doan
If you are using CQL3, the meta data are stored in system tables On Tue, Jul 8, 2014 at 5:38 PM, Kevin Burton bur...@spinn3r.com wrote: Are there any easy/elegant ways to compare dev schema to production schema. I want to find if there are any rows/columns we need to add. I could try to

Re: TTransportException (java.net.SocketException: Broken pipe)

2014-07-08 Thread Bhaskar Singhal
Thanks Mark. Yes the 1024 is the limit. I haven't changed it as per the recommended production settings. But I am wondering why does Cassandra need to keep 3000+ commit log segment files open? Regards, Bhaskar On Tuesday, 8 July 2014 1:50 PM, Mark Reddy mark.re...@boxever.com wrote: Hi 

New application - separate column family or separate cluster?

2014-07-08 Thread Jeremy Jongsma
Do you prefer purpose-specific Cassandra clusters that support a single application's data set, or a single Cassandra cluster that contains column families for many applications? I realize there is no ideal answer for every situation, but what have your experiences been in this area for cluster

Re: Easy diff of schema from dev-production

2014-07-08 Thread Kevin Burton
Ah.. I think that's what I was hoping for! On Tue, Jul 8, 2014 at 9:05 AM, DuyHai Doan doanduy...@gmail.com wrote: If you are using CQL3, the meta data are stored in system tables On Tue, Jul 8, 2014 at 5:38 PM, Kevin Burton bur...@spinn3r.com wrote: Are there any easy/elegant ways to

Re: Compaction causing listeners to stall

2014-07-08 Thread Robert Coli
On Tue, Jul 8, 2014 at 5:31 AM, Bryon Spahn bsp...@kitedesk.com wrote: FSReadError in /mnt/data/cassandra/COMPANY/crmFieldInfo/COMPANYFieldInfo- jb-710-Data.db FSReadError seems relatively likely to be a problem on the underlying filesystem, though I don't have a sec right now to grep and

Re: Cassandra use cases/Strengths/Weakness

2014-07-08 Thread Robert Coli
On Fri, Jul 4, 2014 at 2:10 PM, DuyHai Doan doanduy...@gmail.com wrote: c. operational simplicity due to master-less architecture. This feature is, although quite transparent for developers, is a key selling point. Having suffered when installing manually a Hadoop cluster, I happen to love

Re: Cassandra use cases/Strengths/Weakness

2014-07-08 Thread Jonathan Haddad
I've used various databases in production for over 10 years. Each has strengths and weaknesses. I ran Cassandra for just shy of 2 years in production as part of both development teams and operations, and I only hit 1 serious problem that Rob mentioned. Ideally C* would have guarded against it,

Re: New application - separate column family or separate cluster?

2014-07-08 Thread Tupshin Harper
I've seen a lot of deployments, and I think you captured the scenarios and reasoning quite well. You can apply other nuances and details to #2 (e.g. segment based on SLA or topology), but I agree with all of your reasoning. -Tupshin -Global Field Strategy -Datastax On Jul 8, 2014 10:54 AM, Jeremy

Re: Cassandra use cases/Strengths/Weakness

2014-07-08 Thread Jack Krupansky
“Is cassandra only for use cases with data load 100TB and massive user counts?” I wouldn’t make that extreme a statement! There are plenty of more moderate use cases for Cassandra. For example, a dozen nodes with 300 GB per node for just a few million users and their interactions and