Re: Inter node communication over UDP

2011-05-20 Thread pankajsoni0126
I am working on version 0.7.6 of cassandra. I have been looking into the code to identify communication between nodes. it seems to me that both inter-node and servernode-client communication happens using thrift protocol, is my understanding correct? and the gossiper communication takes place

How to reduce the Read Latency.

2011-05-20 Thread Dikang Gu
Hi All, I'm running three cassandra 0.7.4 nodes in a cluster, and I give 2G memory to each node. Now, I get the cfstats here: Keyspace: UserMap Read Count: 38411 Read Latency: 123.54214613001484 ms. Write Count: 44155 Write Latency: 0.02341093873853471 ms. Pending Tasks: 0 Column Family: Map

CQL: Select for multiple ranges

2011-05-20 Thread David Boxenhorn
In order to fully implement the functionality of super columns using compound columns I need to be able to select multiple column ranges - this would be functionally equivalent to selecting multiple super columns (and more!). I would like to request the following CQL syntax: SELECT [FIRST N]

[RELEASE] Apache Cassandra 0.7.6-2 released

2011-05-20 Thread Sylvain Lebresne
Apache Cassandra 0.7.6 is just 2 days old, but it shipped with a bug in the debian packaging code that prevents the package from being successfully installed. Since debian packaging is an integral part of the project, 0.7.6-2 comes to fix this issue. This is the only change[1] that separate

Re: Cassandra Vs. Oracle Coherence

2011-05-20 Thread Jeffrey Kesselman
I believe coherence is their name for the TimesTen technology they bought. TT is an in memory SQL database that can run as a cache for Oracle. Its totally different from Cassandra. On the one hand it supports trad SQL whereas Cassandra does not. On the other hand Cassandra is truly

Re: How to reduce the Read Latency.

2011-05-20 Thread Jeffrey Kesselman
What consistency are you asking for? On Fri, May 20, 2011 at 7:42 AM, Dikang Gu dikan...@gmail.com wrote: Hi All, I'm running three cassandra 0.7.4 nodes in a cluster, and I give 2G memory to each node. Now, I get the cfstats here: Keyspace: UserMap Read Count: 38411 Read Latency:

Re: Inter node communication over UDP

2011-05-20 Thread Jeffrey Kesselman
TCP/IP byte over-head v. UDP really isnt that much if your packets are of any significant size (its 30 bytes). And as others have pointed out you can easily get more over-head with worse results trying to reinvent reliable transport on top of UDP. Remember that TCP/IP has had 30 years of

Re: How to reduce the Read Latency.

2011-05-20 Thread Dikang Gu
I use the default consistency level in the hector client, so it should be QUORUM. -- Dikang Gu 0086 - 18611140205 On Friday, May 20, 2011 at 4:25 PM, Jeffrey Kesselman wrote: What consistency are you asking for? On Fri, May 20, 2011 at 7:42 AM, Dikang Gu dikan...@gmail.com wrote: Hi All,

Re: Inter node communication over UDP

2011-05-20 Thread Sylvain Lebresne
On Fri, May 20, 2011 at 9:39 AM, pankajsoni0126 pankajsoni0...@gmail.com wrote: I am working on version 0.7.6 of cassandra. I have been looking into the code to identify communication between nodes. it seems to me that both inter-node and servernode-client communication happens using thrift

simple implementation of counters

2011-05-20 Thread Sasha Dolgy
Hi, I'm trying to play around with 0.8.0-rc1 and counters, and I'm a little confused. First question I have is about the definition. A column within a standard column family cannot be a counter column type? I had tried the following, with no success. create column family urlcounts

Re : selecting data

2011-05-20 Thread karim abbouh
is there a way to set for a column of the same key a set of value ? De : Watanabe Maki watanabe.m...@gmail.com À : user@cassandra.apache.org user@cassandra.apache.org Envoyé le : Jeu 19 mai 2011, 17h 38min 39s Objet : Re: selecting data Cassandra is not a

Re: Cassandra Vs. Oracle Coherence

2011-05-20 Thread Peter Lin
That's completely wrong. TimesTen and Coherence are 2 separate products sold by Oracle. Coherence is a data grid that takes a key/value approach. It is massively scalable across LAN and WAN. In terms of comparing Cassandra and Coherence, I wouldn't. Coherence is a data grid and most often used

DatabaseMetadata

2011-05-20 Thread Vivek Mishra
Any thoughts on building something like separate DatabaseMetadata api for CQL? -Original Message- From: Peter Lin [mailto:wool...@gmail.com] Sent: Friday, May 20, 2011 5:28 PM To: user@cassandra.apache.org Subject: Re: Cassandra Vs. Oracle Coherence That's completely wrong. TimesTen and

how to use indexed column for this case

2011-05-20 Thread Monkey me
Hi, I have a SCF, Key is string, super column is TimeUUID, and several columns with one column named type, I create secondary index on this column. I want to have the foliowing query to fetch all super columns along with all columns. 1. given a specific key 2. given a range of

cannot parse as hex bytes

2011-05-20 Thread Patrick Julien
The following sample: http://www.datastax.com/dev/blog/whats-new-cassandra-07-secondary-indexes No longer works with 0.8.0-rc1 I get cannot parse as hex bytes when doing the Next we add some users: [default@demo] set users[bsanderson][full_name] = 'Brandon Sanderson'; section I can confirm

Re : Re : selecting data

2011-05-20 Thread karim abbouh
a storage-conf.xml is read just at the starting of cassandra? is there a way to add a column family dynamically? BR De : karim abbouh karim_...@yahoo.fr À : user@cassandra.apache.org Envoyé le : Ven 20 mai 2011, 12h 48min 54s Objet : Re : selecting data is

Re: Cassandra Vs. Oracle Coherence

2011-05-20 Thread Jeffrey Kesselman
AH, I stand corrected. Hard to follow Larry's acquisitions without a scorecard. On 5/20/11, Peter Lin wool...@gmail.com wrote: That's completely wrong. TimesTen and Coherence are 2 separate products sold by Oracle. Coherence is a data grid that takes a key/value approach. It is massively

RE: Re : Re : selecting data

2011-05-20 Thread Bahadur, Kamal
This is how you create it dynamically: KsDef ksdef = new KsDef(); ksdef.name = ProgKS; ksdef.replication_factor = 1; ksdef.strategy_class = org.apache.cassandra.locator.RackUnawareStrategy; ListCfDef cfdefs = new ArrayListCfDef(); CfDef cfdef1 = new CfDef(); cfdef1.name = ProgCF1;

Documentation of Known Issues

2011-05-20 Thread Daniel Doubleday
Hi all I was wondering if there might be some way to better communicate known issues. We do try to track jira issues but at times some slip through or we miss implications. Things like the broken repair of specific CFs. (https://issues.apache.org/jira/browse/CASSANDRA-2670). I know that this

Re: Exception when starting

2011-05-20 Thread mcasandra
Whenever I hear someone say data is corrupted I panic :) I have seen few people have reported that but have not seen the real reason for it. Is it a manual error, config error, bug etc. It will be good to identify why these things happen so that it can be fixed before it happens in PROD :( --

Re: how to use indexed column for this case

2011-05-20 Thread Anand Somani
From what I know you cannot create secondary indexes on SCF. You should have gotten this = https://issues.apache.org/jira/browse/CASSANDRA-1813 on index creation. On Fri, May 20, 2011 at 6:56 AM, Monkey me monkey1024.pub...@gmail.comwrote: Hi, I have a SCF, Key is string, super column is

Re: How to reduce the Read Latency.

2011-05-20 Thread mcasandra
What's your avg column size and row size? Your read latency in most case will directly be related to how much you are trying to read. In my experience you will see high read latency if you have big column size. -- View this message in context:

Re: Can I use secondary index with any partitioner

2011-05-20 Thread Jonathan Ellis
Yes. On Thu, May 19, 2011 at 7:24 PM, Dave Rav daver...@yahoo.com wrote: Can I use secondary index with any partitioner 1) RandomPartitioner 2) ByteOrderedPartitioner -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of DataStax, the source for professional Cassandra

Re: simple implementation of counters

2011-05-20 Thread Jonathan Ellis
On Fri, May 20, 2011 at 5:55 AM, Sasha Dolgy sdo...@gmail.com wrote: First question I have is about the definition.  A column within a standard column family cannot be a counter column type? Right. https://issues.apache.org/jira/browse/CASSANDRA-2614 is open to address this but that's going to

Re: cannot parse as hex bytes

2011-05-20 Thread Jonathan Ellis
You'd need to add a key validation type for 0.8. On Fri, May 20, 2011 at 9:28 AM, Patrick Julien pjul...@gmail.com wrote: The following sample: http://www.datastax.com/dev/blog/whats-new-cassandra-07-secondary-indexes No longer works with 0.8.0-rc1 I get cannot parse as hex bytes when

Re: Cassandra Vs. Oracle Coherence

2011-05-20 Thread mcasandra
Coherence is similar to memcachd (free). It's in memory cache layer on top of the DB. You as a user need to keep that cache in sync with the DB. -- View this message in context: http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/Cassandra-Vs-Oracle-Coherence-tp6375561p6386847.html

Re: Exception when starting

2011-05-20 Thread Brandon Williams
There was a bug, it is fixed. It's just a cache, chill. On May 20, 2011 11:50 AM, mcasandra mohitanch...@gmail.com wrote: Whenever I hear someone say data is corrupted I panic :) I have seen few people have reported that but have not seen the real reason for it. Is it a manual error, config

Re: Cassandra Vs. Oracle Coherence

2011-05-20 Thread Peter Lin
Although one can use Coherence as a memory cache layer on top of a DB, many customer use it in the financial sector as a in-memory key/value store. Think of transient data that doesn't need to be saved, but needs to scale out across hundreds or thousands of nodes. memcached is making progress,

Re: Exception when starting

2011-05-20 Thread Eranda Sooriyabandara
In my case I started cassandra after sometime with the newer version of it. I think this occurred because there were some files remained belongs to the previous version of cassandra and overwritten with the new one. This is just my thought. Thanks Eranda

Re: simple implementation of counters

2011-05-20 Thread Sasha Dolgy
uh. yeah ... was a bad morning ... cheers On Fri, May 20, 2011 at 6:57 PM, Jonathan Ellis jbel...@gmail.com wrote: On Fri, May 20, 2011 at 5:55 AM, Sasha Dolgy sdo...@gmail.com wrote: First question I have is about the definition.  A column within a standard column family cannot be a counter

Re: Cassandra Vs. Oracle Coherence

2011-05-20 Thread Milind Parikh
Other interesting flavors in a distributed cache terracotta, gemfire.together with a complex event processing engine. like OCEP drives a lot of low latency, high freq trading where nano seconds matter /*** sent from my android...please pardon occasional typos

Re: Cassandra Vs. Oracle Coherence

2011-05-20 Thread Peter Lin
another product in the same area is gigaspaces. On Fri, May 20, 2011 at 1:12 PM, Milind Parikh milindpar...@gmail.com wrote: Other interesting flavors in a distributed cache terracotta, gemfire.together with a complex event processing engine. like OCEP drives a lot of low

Re: Exception when starting

2011-05-20 Thread mcasandra
Brandon Williams wrote: There was a bug, it is fixed. It's just a cache, chill. There is no time to chill when fighting it in production :) It's good to know it's fixed. Another question, when this happens are we able to restore data from replica nodes? -- View this message in context:

Re: Exception when starting

2011-05-20 Thread Krish Pan
No data gets lost - * only * thing corrupted is key-cache On Fri, May 20, 2011 at 10:17 AM, mcasandra mohitanch...@gmail.com wrote: Brandon Williams wrote: There was a bug, it is fixed. It's just a cache, chill. There is no time to chill when fighting it in production :) It's good to

Re: Can I use secondary index with any partitioner

2011-05-20 Thread Dave Rav
if I use 'RandomPartitioner' and call 'get_indexed_slices' what  do I do with 'start_key' struct IndexClause { 1: required listIndexExpression expressions 2: required binary start_key, 3: required i32 count=100, }  Yes.   On Thu, May 19, 2011 at 7:24 PM, Dave Rav

Re: Exception when starting

2011-05-20 Thread mcasandra
In this case, yes. I was asking for the cases where commit log corruption was reported. -- View this message in context: http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/Re-Exception-when-starting-tp6383464p6387101.html Sent from the cassandra-u...@incubator.apache.org mailing

Re: cannot parse as hex bytes

2011-05-20 Thread Patrick Julien
thanks On Fri, May 20, 2011 at 12:58 PM, Jonathan Ellis jbel...@gmail.com wrote: You'd need to add a key validation type for 0.8. On Fri, May 20, 2011 at 9:28 AM, Patrick Julien pjul...@gmail.com wrote: The following sample:

Re: Inconsistent results using secondary indexes between two DC

2011-05-20 Thread Jonathan Ellis
Has this cluster always been on 0.7.5 or was it upgraded from an earlier version? On Thu, May 19, 2011 at 3:26 AM, Wojciech Pietrzok kosci...@gmail.com wrote: Just checked. Seems to be present in CF on all nodes (in both datacenters), but are not indexed correctly On each node I've used

Re: Can I use secondary index with any partitioner

2011-05-20 Thread Jonathan Ellis
empty byte array for the first call, last key from the previous resultset afterwards On Fri, May 20, 2011 at 12:53 PM, Dave Rav daver...@yahoo.com wrote: if I use 'RandomPartitioner' and call 'get_indexed_slices' what  do I do with 'start_key' struct IndexClause { 1: required

CounterColumn

2011-05-20 Thread Mark Emerson
CASSANDRA-2614 - create Column and CounterColumn in the same column family when this will be in cassandra will this be in cassandra 0.8

Re: CounterColumn

2011-05-20 Thread Jonathan Ellis
Look for Fix version on the ticket: https://issues.apache.org/jira/browse/CASSANDRA-2614. On Fri, May 20, 2011 at 4:35 PM, Mark Emerson a202...@yahoo.com wrote: CASSANDRA-2614 - create Column and CounterColumn in the same column family when this will be in cassandra will this be in cassandra

Re: RTG/MRTG/Cricket replacement using Cassandra?

2011-05-20 Thread yangyangyyy
hi Ryan: Thanks for the link. I read the slides, could you please provide some more details on how the temporal aggregation is implemented? do you use time+granularity as the key ? or as column names ? Thanks Yang In reply to this post by Aaron Turner We have a solution for time series data on

Re: RTG/MRTG/Cricket replacement using Cassandra?

2011-05-20 Thread Edward Capriolo
The first love of my open life was cacti. I am going to discuss with them porting some of the system to cassandra. On Friday, May 20, 2011, yangyangyyy tedd...@gmail.com wrote: hi Ryan: Thanks for the link. I read the slides, could you please provide some more details on how the