Re: Heap is N.N full. Immediately on startup

2013-02-26 Thread Andras Szerdahelyi
( I am monitoring via a visual vm plugin that shows generation sizes ) I've increased the index sampling rate from 64 to 512 and the bloom filter fp ratio from default to 0.1 ( and rebuilt stables ) - still getting 1-2 sstable reads with LCS However at startup I see a 5GB old gen ( that seems to

Re: Data Model - Additional Column Families or one CF?

2013-02-26 Thread Raman
Greetings! Thank you very much sharing your insight and experience. I am trying to migrate a normalized Schema -- 1 TB database. The data is hierarchical... child entities carry foreign keys to the parent entities. There are several instances like ShapeTable, Circle, Square, Rectangle

please explain read path when key not in database

2013-02-26 Thread Igor
Hello! Explain please, how this work when I request for key which is not in database * The closest node (as determined by proximity sorting as described above) will be sent a command to perform an actual data read (i.e., return data to the co-ordinating node). * As required by

RE: Read Perf

2013-02-26 Thread Kanwar Sangha
Thanks. For our case, the no of rows will more or less be the same. The only thing which changes is the columns and they keep getting added. -Original Message- From: Hiller, Dean [mailto:dean.hil...@nrel.gov] Sent: 26 February 2013 09:21 To: user@cassandra.apache.org Subject: Re: Read

Re: Data Model - Additional Column Families or one CF?

2013-02-26 Thread Hiller, Dean
The bottleneck is RAM, each CF uses more RAM. We tried to go above 15000 column families and that hurt big time so we added a feature to PlayOrm and now have 60,000 virtual Column families all in one column family. This turned out to be HUGE benefit though as those 60,000 tables now have been

Re: Read Perf

2013-02-26 Thread Hiller, Dean
In that case, make sure you don't plan on going into the millions or test the limit as I pretty sure it can't go above 10 million. (from previous posts on this list). Dean On 2/26/13 8:23 AM, Kanwar Sangha kan...@mavenir.com wrote: Thanks. For our case, the no of rows will more or less be the

Re: Data Model - Additional Column Families or one CF?

2013-02-26 Thread Hiller, Dean
Oh, and 50 CF's should be fine. Dean From: Javier Sotelo javier.a.sot...@gmail.commailto:javier.a.sot...@gmail.com Reply-To: user@cassandra.apache.orgmailto:user@cassandra.apache.org user@cassandra.apache.orgmailto:user@cassandra.apache.org Date: Tuesday, February 26, 2013 12:27 AM To:

Re: please explain read path when key not in database

2013-02-26 Thread Hiller, Dean
This is my understanding from using cassandra for probably around 2 years….(though I still make mistakes sometimes)…. For CL.ONE read Depending on the client, the client may go through one of it's known nodes(co-ordinating node) which goes to real node(clients like astyanax/hector read in the

Re: Read Perf

2013-02-26 Thread Hiller, Dean
Depends, are you 1. Reading the same size of data as the data set size grows? (reading more data does generally get slower like reading 1MB vs. 10MB) 2. Reading the same number of columns as the data set size grows? 3. Never reading in the entire row? If the answer to all of the above is yes,

Re: Data Model - Additional Column Families or one CF?

2013-02-26 Thread Javier Sotelo
Thanks Dean, very helpful info. Javier On Tue, Feb 26, 2013 at 7:33 AM, Hiller, Dean dean.hil...@nrel.gov wrote: Oh, and 50 CF's should be fine. Dean From: Javier Sotelo javier.a.sot...@gmail.commailto: javier.a.sot...@gmail.com Reply-To:

Re: Data Model - Additional Column Families or one CF?

2013-02-26 Thread Edward Capriolo
http://www.edwardcapriolo.com/roller/edwardcapriolo/entry/whytf_would_i_need_with On Tue, Feb 26, 2013 at 12:28 PM, Javier Sotelo javier.a.sot...@gmail.com wrote: Thanks Dean, very helpful info. Javier On Tue, Feb 26, 2013 at 7:33 AM, Hiller, Dean dean.hil...@nrel.gov wrote: Oh, and 50

Re: Authentication and Authorization with Cassandra 1.2.2.

2013-02-26 Thread Jeremy Hanna
does this help? Links at the bottom show the cql statements to add/modify users: http://www.datastax.com/docs/1.2/security/native_authentication On Feb 26, 2013, at 4:06 PM, C.F.Scheidecker Antunes cf.antu...@gmail.com wrote: Hello all, Cassandra has changed and now has a default

Re: Bulk Loading-Unable to select from CQL3 tables with NO COMPACT STORAGE option after Bulk Loading - Cassandra version 1.2.1

2013-02-26 Thread aaron morton
CQL 3 tables that do not use compact storage store use Composite Types , which other code may not be expecting. Take a look at the CQL 3 table definitions through cassandra-cli and you may see the changes you need to make when creating the SSTables. Cheers - Aaron Morton

Re: no other nodes seen on priam cluster

2013-02-26 Thread Ben Bromhead
Hi Marcelo A few questions: Have your added the priam java agent to cassandras JVM argurments (e.g. -javaagent:$CASS_HOME/lib/priam-cass-extensions-1.1.15.jar) and does the web container running priam have permissions to write to the cassandra config directory? Also what do the priam logs say?