Re: cassandra goes infinite loop and data lost.....

2011-07-14 Thread Yan Chunlu
okay, I am not sure if it is infinite loop, I change log4j to DEBUG only because cassandra never get online after run cassandra, it seems just halt. I enable debug then it start showing those message very fast and never end. I have just run nodetool cleanup, and it start reading commitlog, seems

Re: How to remove/add node

2011-07-14 Thread Abdul Haq Shaik
Thanks a lot dear. I will try it out and will let you know if the problem persists. On Thu, Jul 14, 2011 at 5:52 AM, Sameer Farooqui cassandral...@gmail.comwrote: As long as you have no data in this cluster, try clearing out the /var/lib/cassandra directory from all nodes and restart

AW: New web client future API

2011-07-14 Thread MW | Codefreun.de
Hi out there, it was a bit quiet now because I am changing the framework with which Apollo is built, to get away from the flash-based charting. But it continues ... Another question is: What would be a good name for that UI, Apollo seems to be used in another Cassandra context? Greets Markus

What available Cassandra schema documentation is available?

2011-07-14 Thread Andreas Markauskas
I couldn't find any schema example for the supercolumn column family that is strongly typed. For example, create column family Super1 with comparator=UTF8Type and column_type=Super and key_validation_class=UTF8Type and column_metadata = [ {column_name: username, validation_class:UTF8Type},

gossiper problem

2011-07-14 Thread Donna Li
All: I have four cassandra servers in cluster. I do not restart any one of the servers, why the following print show the four servers restart many times? What is the possible reason? The connection between the four server's is good. Swap may be used, because there are other applications run with

NegativeArraySizeException

2011-07-14 Thread Donna Li
All: What is the following error mean? ERROR [pool-1-thread-62] 2011-07-14 14:31:04,671 CustomTThreadPoolServer.java (line 173) Error occurred during processing of message. java.lang.NegativeArraySizeException at

Thrift Java Client - Get a column family from a Keyspace

2011-07-14 Thread Chandrasekhar M
Hi I have been playing around with Cassandra and its Java Thrift Client. From my understanding, one could get/retrieve a Keyspace, KsDef object, using the describe_keyspace(String name) method on the Cassandra.Client object. Subsequently, one could get a list of all the ColumnFamily

Re: Survey: Cassandra/JVM Resident Set Size increase

2011-07-14 Thread William Oberman
I finally upgraded to 0.7.4 - 0.8.0 (using riptano packages) 2 days ago. Before, my resident memory (for the java process) would slowly grow without bound and the OS would kill the process. But, over the last 2 days, I _think_ it's been stable. I'll let you know in a week :-) My other stats:

Re: Cassandra Monitoring

2011-07-14 Thread Edward Capriolo
On Thu, Jul 14, 2011 at 8:58 AM, Albert Vila a...@imente.com wrote: Anyone has Cassandra's cacti templates for server 0.7.4+? On 20 December 2010 17:40, Edward Capriolo edlinuxg...@gmail.com wrote: On Sun, Dec 19, 2010 at 10:37 PM, Dave Viner davevi...@gmail.com wrote: Can you share the

Re: NegativeArraySizeException

2011-07-14 Thread Jonathan Ellis
That means something sent a nonsense request to Cassandra. Often this happens when a non-Cassandra client connects on the Thrift port. On Thu, Jul 14, 2011 at 3:01 AM, Donna Li donna...@utstar.com wrote: All:     What is the following error mean? ERROR [pool-1-thread-62] 2011-07-14

Re: JDBC CQL Driver unable to locate cassandra.yaml

2011-07-14 Thread Derek Tracy
I tried putting the cassandra.yaml in the classpath but got the same error. Adding -Dcassandra.config=file:/path/to/cassandra.yaml did work. - Derek Tracy trac...@gmail.com - On Wed, Jul 13, 2011 at 6:22 PM, Jonathan Ellis

JDBC CQL Driver setAutoCommit Unsupported Method

2011-07-14 Thread Derek Tracy
Still trying to integrate Cassandra's CQL JDBC driver with my companies ETL but ran into another roadblock. I will caveat this post with I do not know a lot about JDBC and how it is implemented When trying to test the connection (using the ETL) I get an Unsupported Method exception, I looked at

Re: Question about compaction

2011-07-14 Thread Maki Watanabe
These 0 byte files with -Compacted suffix indicate that the associated sstables can be removed. In current version, Cassandra delete compacted sstables at Full GC and on startup. maki 2011/7/14 Sameer Farooqui cassandral...@gmail.com: Running Cassandra 0.8.1. Ran major compaction via: sudo

Re: Storing counters in the standard column families along with non-counter columns ?

2011-07-14 Thread Chris Burroughs
On 07/13/2011 03:57 PM, Aaron Morton wrote: You can always use a dedicated CF for the counters, and use the same row key. Of course one could do this. The problem is you are now spending ~2x disk space on row keys, and app specific client code just became more complicated.

Re: Storing counters in the standard column families along with non-counter columns ?

2011-07-14 Thread Aditya Narayan
Thanks Aaron Chris, I appreciate your help. With dedicated CF for counters, in addition to the issue pointed by Chris, the major drawback I see is that I cant read *in a single query* the counters with the regular columns row which is widely required by my application. My use case is like

Re: Question about compaction

2011-07-14 Thread Sameer Farooqui
You were right, Maki. Restarting Cassandra cleaned up the directory and now there are only two SSTable files. On Thu, Jul 14, 2011 at 9:08 AM, Maki Watanabe watanabe.m...@gmail.comwrote: These 0 byte files with -Compacted suffix indicate that the associated sstables can be removed. In

Re: question on capacity planning

2011-07-14 Thread Sameer Farooqui
So, in our experience, the amount of storage overhead is much higher. If you plan on storing 120TB of data, you will want to expect storing 250 TB of data on disk after the data over head. And then since you have to leave 50% of storage space free for compaction, you're looking at needing about

Data overhead discussion in Cassandra

2011-07-14 Thread Sameer Farooqui
We just set up a demo cluster with Cassandra 0.8.1 with 12 nodes and loaded 1.5 TB of data into it. However, the actual space on disk being used by data files in Cassandra is 3 TB. We're using a standard column family with a million rows (key=string) and 35,040 columns per key. The column name is

Re: CQL + Counters = bad request

2011-07-14 Thread Nate McCall
Yep there was an issue here. RPM has been updated to 0.8.1-2 and deployed. Thanks for tracking this down. On Wed, Jul 13, 2011 at 3:58 PM, Aaron Turner synfina...@gmail.com wrote: Thanks.  Looks like we tracked down the problem to the datasax 0.8.1 rpm is actually 0.8.0. rpm -qa | grep

Re: Off-heap Cache

2011-07-14 Thread Vijay
Use describe keyspace and see the settings are right. Check the logs on all the servers, Make sure you dont see errors... Check JNA jar in all the servers. Regards, /VJ On Wed, Jul 13, 2011 at 1:29 PM, Raj N raj.cassan...@gmail.com wrote: How do I ensure it is indeed using the

Re: gossiper problem

2011-07-14 Thread Vijay
How about GC logs, what are your pause times? JVM settings might help If you are not sure how to enable GC logs check cassandra.yaml look for application pause times. it is highly recommended not to swap -- include JNA jar. Regards, /VJ On Thu, Jul 14, 2011 at 1:42 AM, Donna Li

Commit log is not emptied after nodetool drain

2011-07-14 Thread Zhu Han
The deployed version is based on 0.6.13. After nodetool drain is invoked on one of the nodes, the commit log is not emptied. Is this the expected behavior? If so, how can I rename a column family on 0.6.x branch? Here is the log output: INFO [COMMIT-LOG-WRITER] 2011-07-15 00:39:49,541

ttl on a record?

2011-07-14 Thread Boris Yen
Hi, For now, cassandra support setting ttl on columns, is there any way to do the same to a record/row? Regards Boris

Re: Commit log is not emptied after nodetool drain

2011-07-14 Thread Jonathan Ellis
It's expected to have a new, empty segment after drain completes. 2011/7/14 Zhu Han schumi@gmail.com: The deployed version is based on 0.6.13. After nodetool drain is invoked on one of the nodes, the commit log is not emptied. Is this the expected behavior? If so, how can I rename a

Re: ttl on a record?

2011-07-14 Thread Jonathan Ellis
No. Just set it on all the columns. On Thu, Jul 14, 2011 at 7:08 PM, Boris Yen yulin...@gmail.com wrote: Hi, For now, cassandra support setting ttl on columns, is there any way to do the same to a record/row? Regards Boris -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of

Re: ttl on a record?

2011-07-14 Thread Boris Yen
Hi Jonathan, In this case, will this record with no column be removed from cassandra automatically? if no, do you have any plan on supporting it? Regards Boris On Fri, Jul 15, 2011 at 10:43 AM, Jonathan Ellis jbel...@gmail.com wrote: No. Just set it on all the columns. On Thu, Jul 14, 2011

Re: Commit log is not emptied after nodetool drain

2011-07-14 Thread Jonathan Ellis
If you have non-empty segments post-drain that is a bug. Is it reproducible? 2011/7/14 Zhu Han schumi@gmail.com: Jonathan, But all the old non-empty log segments are kept on the disk. And cassandra takes some time to apply the operations from these closed log segments after restart of

Re: Commit log is not emptied after nodetool drain

2011-07-14 Thread Zhu Han
2011/7/15 Jonathan Ellis jbel...@gmail.com If you have non-empty segments post-drain that is a bug. Is it reproducible? I think it is always reproducible on 0.6.x branch. Here is a simple experiment: 1) bin/nodetool -h localhost 2) During flush the memtables, we can observe the name of

Re: gossiper problem

2011-07-14 Thread samal
well I am not a JVM guru, but it seem server has memory problem. 13 10:44:57,748 Gossiper.java (line 579) InetAddress /10.63.61.74 is now UP INFO [Timer-0] 2011-07-13 15:56:44,630 Gossiper.java (line 181) InetAddress /10.63.61.74 is now dead. INFO [GMFD:1] 2011-07-13

Re: ttl on a record?

2011-07-14 Thread Boris Yen
Thanks a lot. ^^ My project can make good use of this feature. On Fri, Jul 15, 2011 at 10:59 AM, Jonathan Ellis jbel...@gmail.com wrote: On Thu, Jul 14, 2011 at 7:50 PM, Boris Yen yulin...@gmail.com wrote: Hi Jonathan, In this case, will this record with no column be removed from cassandra

Cache layer in front of cassandra... any help / suggestions?

2011-07-14 Thread Suman Ghosh
Hi, We're presently trying to use Cassandra as a storage/retrieval system for live data composite counters (on the data). As we work on telecom data records (voice call/sms/GPRS xDRs), the data volume is simply HUGE, and we definitely need a controlled caching mechanism in front of the