Re: Read performance in map data type

2014-04-03 Thread Apoorva Gaurav
Hello Shrikar, We are still facing read latency issue, here is the histogram http://pastebin.com/yEvMuHYh On Sat, Mar 29, 2014 at 8:11 AM, Apoorva Gaurav apoorva.gau...@myntra.comwrote: Hello Shrikar, Yes primary key is (studentID, subjectID). I had dropped the test table, recreating and

Re: Read performance in map data type

2014-04-03 Thread Shrikar archak
Hi Apoorva, As per the cfhistogram there are some rows which have more than 75k columns and around 150k reads hit 2 SStables. Are you sure that you are seeing more than 500ms latency? The cfhistogram should the worst read performance was around 51ms which looks reasonable with many reads hitting

Re: Read performance in map data type

2014-04-03 Thread Apoorva Gaurav
At the client side we are getting a latency of ~350ms, we are using datastax driver 2.0.0 and have kept the fetch size as 500. And these are coming while reading rows having ~200 columns. On Thu, Apr 3, 2014 at 12:45 PM, Shrikar archak shrika...@gmail.com wrote: Hi Apoorva, As per the

Re: Read performance in map data type

2014-04-03 Thread Shrikar archak
How about the client side socket limits? Cassandra client side maximum connection per host and read consistency level? ~Shrikar On Thu, Apr 3, 2014 at 12:20 AM, Apoorva Gaurav apoorva.gau...@myntra.comwrote: At the client side we are getting a latency of ~350ms, we are using datastax driver

Re: Read performance in map data type

2014-04-03 Thread Apoorva Gaurav
client side socket limit : 64K client side maximum connection per host : 8 read consistency level : Quorum On Thu, Apr 3, 2014 at 12:59 PM, Shrikar archak shrika...@gmail.com wrote: How about the client side socket limits? Cassandra client side maximum connection per host and read consistency

Row_key from sstable2json to actual value of the key

2014-04-03 Thread ng
sstable2json tomcat-t5-ic-1-Data.db -e gives me 0021 001f 0020 How do I convert this (hex) to actual value of column so I can do below select * from tomcat.t5 where c1='concerted value'; Thanks in advance for the help.

Upgrading Cassandra

2014-04-03 Thread Alain RODRIGUEZ
Hi As we are using Cassandra 1.2.11 and we will want to move to 2.1 as soon as it will be released and considered stable enough, we will have to make a few migrations : 1.2.11 -- 1.2.last (16 currently) 1.2.last -- 2.0.last 2.0.last -- 2.1.last The point is we ran into a lot of migrations

Re: Row_key from sstable2json to actual value of the key

2014-04-03 Thread Colin Blower
Hey ng, You can use CQL and Cassandra do the conversion if you would like. If your table uses int type keys: select * from tomcat.tx where c1 = blobAsInt(0x0021); The relevant section of the CQL3 docs are here: http://cassandra.apache.org/doc/cql3/CQL.html#blobFun You can use blobAs... for

Re: Upgrading Cassandra

2014-04-03 Thread Robert Coli
On Thu, Apr 3, 2014 at 8:56 AM, Alain RODRIGUEZ arodr...@gmail.comwrote: Since we use AWS EC2 instances, Is it possible to upgrade Cassandra through a new DC as it is recommended while switching to vnodes ? No, because bootstrapping (and rebuilding/repairing/etc.) on a split-major-version

Re: EC2 zones, snitches and vnodes

2014-04-03 Thread Robert Coli
On Thu, Apr 3, 2014 at 8:38 AM, Alain RODRIGUEZ arodr...@gmail.com wrote: I read that we can use different A-Z to be more crash tolerant. Basically, using a RF=3 and placing servers into different zones like node1-zoneA node2-zoneB node3-zoneC node4-zoneA... As replicas are placed to the next

Re: Read performance in map data type

2014-04-03 Thread Robert Coli
On Thu, Apr 3, 2014 at 12:20 AM, Apoorva Gaurav apoorva.gau...@myntra.comwrote: At the client side we are getting a latency of ~350ms, we are using datastax driver 2.0.0 and have kept the fetch size as 500. And these are coming while reading rows having ~200 columns. And you're sure that the

Using C* and CAS to coordinate workers

2014-04-03 Thread Jan Algermissen
Hi, maybe someone knows a nice solution to the following problem: I have N worker processes that are intentionally masterless and do not know about each other - they are stateless and independent instances of a given service system. These workers need to poll an event feed, say about every 10