Query

2012-06-06 Thread MOHD ARSHAD SALEEM
Hi All, I am using Hector client for cassandra . I wanted to know how to create keyspace and column family using API's to read and write data. or i have to create keyspace and column family manually using command line interface. Regards Arshad

Re: How to include two nodes in Java code using Hector

2012-06-06 Thread Roshni Rajagopal
In Hector when you create a cluster using the API, you specify an IP address cluster name. Thereafter internally which node serves the request or how many nodes need to be contacted to read/write data depends on the cluster configuration i.e. Whats your replication strategy, factor,

RE: How to include two nodes in Java code using Hector

2012-06-06 Thread Prakrati Agrawal
Thank you for the reply. Now I have decommissioned a node but now I don't know how to recommission it .Please help me Thanks and Regards Prakrati Agrawal | Developer - Big Data(ID)| 9731648376 | www.mu-sigma.com -Original Message- From: Roshni Rajagopal

How to make a decommissioned node join the ring again

2012-06-06 Thread Prakrati Agrawal
Dear all I decommissioned a node. Now I want to make that node a part of the ring again. How do I do it? Please help me Thanks and Regards Prakrati Agrawal | Developer - Big Data(ID)| 9731648376 | www.mu-sigma.com This email message may contain proprietary,

Re: memory issue on 1.1.0

2012-06-06 Thread aaron morton
Mina, That does not sound right. If you have the time can you create a jira ticket describing the problem, please include: * the GC logs gathered by enabling them here https://github.com/apache/cassandra/blob/trunk/conf/cassandra-env.sh#L165 (It would be good to see the node

how to create keyspace using cassandra API's

2012-06-06 Thread MOHD ARSHAD SALEEM
Hi All, I am using Hector as a client in cassandra.And iam trying to create Keyspace using the following API's Keyspace keyspace = HFactory.createKeyspace(test, cluster); but it showing the following error: caused by: InvalidRequestException(why:Keyspace test does not exist) can any body help

Re: Query

2012-06-06 Thread Filippo Diotalevi
Hi, the Javadoc (or source code) of the me.prettyprint.hector.api.factory.HFactory class contains all the examples to create keyspaces and column families. To create a keyspace: String testKeyspace = testKeyspace; KeyspaceDefinition newKeyspace =

RE: how to create keyspace using cassandra API's

2012-06-06 Thread Prakrati Agrawal
You have to create the keyspace manually first using Cassandra cli Prakrati Agrawal | Developer - Big Data(ID)| 9731648376 | www.mu-sigma.com From: MOHD ARSHAD SALEEM [mailto:marshadsal...@tataelxsi.co.in] Sent: Wednesday, June 06, 2012 2:27 PM To: user@cassandra.apache.org Subject: how to

Re: memory issue on 1.1.0

2012-06-06 Thread aaron morton
I looked through the log again. Still looks like it's overloaded and not handling the overload very well. It looks like a sustained write load of around 280K columns every 5 minutes for about 5 hours. It may be that the CPU is the bottle neck when it comes to GC throughput. You are hitting

Cassandra not retrieving the complete data on 2 nodes

2012-06-06 Thread Prakrati Agrawal
Dear all I was originally having a 1 node cluster. Then I added one more node to it with initial token configured appropriately. Now when I run my queries I am not getting all my data ie all columns. Output on 2 nodes Time taken to retrieve columns 43707 of key range is 1276 Time taken to

Why Hector is taking more time than Thrift

2012-06-06 Thread Prakrati Agrawal
Dear all I am trying to evaluate the performance of Cassandra and wrote a code to retrieve a complete row ( having 43707 columns) using Thrift and Hector. The thrift client code took 0.767 seconds while Hector code took 0.883 seconds . Is it expected that Hector will be slower than Thrift? If

Re: Why Hector is taking more time than Thrift

2012-06-06 Thread R. Verlangen
Hector is a higher-level client that provides some abstraction and an easy to use interface. The Thrift API is pretty raw. So for most cases the Hector client would be the best choice; except for use-cases where the ultimate performance is a requirement (resulting in lots of more maintenance

Re: Nodes not picking up data on repair, disk loaded unevenly

2012-06-06 Thread aaron morton
You are basically in trouble. If you can nuke it and start again it would be easier. If you want to figure out how to get out of it keep the cluster up and have a play. -What I think the solution should be: You want to get repair to work before you start deleting data. At ~840GB I'm

RE: Cassandra not retrieving the complete data on 2 nodes

2012-06-06 Thread Prakrati Agrawal
Please anyone reply to my query Prakrati Agrawal | Developer - Big Data(ID)| 9731648376 | www.mu-sigma.com From: Prakrati Agrawal [mailto:prakrati.agra...@mu-sigma.com] Sent: Wednesday, June 06, 2012 2:34 PM To: user@cassandra.apache.org Subject: Cassandra not retrieving the complete data on 2

RE: Query

2012-06-06 Thread MOHD ARSHAD SALEEM
Hi, After creating the keyspace successfully now i want to know how to read write data using API,s Regards Arshad From: Filippo Diotalevi [fili...@ntoklo.com] Sent: Wednesday, June 06, 2012 2:27 PM To: user@cassandra.apache.org Subject: Re: Query Hi, the Javadoc

Problem in getting data from a 2 node cluster

2012-06-06 Thread Prakrati Agrawal
Dear all, I had a 1 node cluster. Then I added 1 more node to it. When I ran my query on 1 node cluster I got all my data but when I ran my query on the 2 node cluster (Hector code) I am not getting the same data. How do I ensure that my Hector code retrieves data from all the nodes. Also when

unsubscribe

2012-06-06 Thread Cyril Scetbon
-- Cyril SCETBON

Re: unsubscribe

2012-06-06 Thread Cyril Scetbon
On 6/6/12 12:13 PM, Cyril Scetbon wrote: sorry for that -- Cyril SCETBON

Re: Problem in getting data from a 2 node cluster

2012-06-06 Thread R. Verlangen
Did you run repair on the new node? 2012/6/6 Prakrati Agrawal prakrati.agra...@mu-sigma.com Dear all, ** ** I had a 1 node cluster. Then I added 1 more node to it. ** ** When I ran my query on 1 node cluster I got all my data but when I ran my query on the 2 node cluster (Hector

RE: Problem in getting data from a 2 node cluster

2012-06-06 Thread Prakrati Agrawal
What does repair do? Prakrati Agrawal | Developer - Big Data(ID)| 9731648376 | www.mu-sigma.com From: R. Verlangen [mailto:ro...@us2.nl] Sent: Wednesday, June 06, 2012 3:56 PM To: user@cassandra.apache.org Subject: Re: Problem in getting data from a 2 node cluster Did you run repair on the new

RE: Problem in getting data from a 2 node cluster

2012-06-06 Thread Prakrati Agrawal
When I run the nodetool command I get the following information ./nodetool -h localhost ring Address DC RackStatus State Load Effective-Owership Token

Re: Problem in getting data from a 2 node cluster

2012-06-06 Thread R. Verlangen
Repair ensures that all data is consistent and available on the node. 2012/6/6 Prakrati Agrawal prakrati.agra...@mu-sigma.com When I run the nodetool command I get the following information ./nodetool -h localhost ring Address DC RackStatus State Load

RE: Problem in getting data from a 2 node cluster

2012-06-06 Thread Prakrati Agrawal
Yes I ran nodetool repair also. Still the same problem I am getting lesser data when using my code on a 2 node cluster. Please help me Prakrati Agrawal | Developer - Big Data(ID)| 9731648376 | www.mu-sigma.com From: R. Verlangen [mailto:ro...@us2.nl] Sent: Wednesday, June 06, 2012 4:01 PM To:

RE: Problem in getting data from a 2 node cluster

2012-06-06 Thread Prakrati Agrawal
I even used CassandraHostConfigurator and added a string of hosts but still the same issue. Please someone help me Thanks and Regards Prakrati Agrawal | Developer - Big Data(ID)| 9731648376 | www.mu-sigma.com From: Prakrati Agrawal [mailto:prakrati.agra...@mu-sigma.com] Sent: Wednesday, June

RE: Problem in getting data from a 2 node cluster

2012-06-06 Thread Prakrati Agrawal
I will repeat my query once again: I had a 1 node cluster. Then I added 1 more node to it. When I ran my query on 1 node cluster I got all my data but when I ran my query on the 2 node cluster (Hector code) I am not getting the same data. How do I ensure that my Hector code retrieves data from

Re: Query

2012-06-06 Thread shelan Perera
Hi, You can find detailed info here [1] [1] https://github.com/hector-client/hector/wiki/User-Guide regards On Wed, Jun 6, 2012 at 3:38 PM, MOHD ARSHAD SALEEM marshadsal...@tataelxsi.co.in wrote: Hi, After creating the keyspace successfully now i want to know how to read write data using

RE: Problem in getting data from a 2 node cluster

2012-06-06 Thread Tim Wintle
On Wed, 2012-06-06 at 06:54 -0500, Prakrati Agrawal wrote: This node will not auto bootstrap because it is configured to be a seed node This means the cassandra.yaml on that node references itself as a seed node. After you decommission the second node, can you still access the entire dataset

Node decomission failed

2012-06-06 Thread Marc Canaleta
Hi, We are testing Cassandra and tried to remove a node from the cluster using nodetool decomission. The node transferred the data, then died for about 20 minutes without responding, then came back to life with a load of 50-100, was in a heavy load during about 1 hour and then returned to normal

Re: MeteredFlusher in system.log entries

2012-06-06 Thread rohit bhatia
Hi.. the link http://thelastpickle.com/2011/05/04/How-are-Memtables-measured/ mentions that From version 0.7 onwards the worse case scenario is up to CF Count + Secondary Index Count + memtable_flush_queue_size (defaults to 4) + memtable_flush_writers (defaults to 1 per data directory) memtables

Re: MeteredFlusher in system.log entries

2012-06-06 Thread rohit bhatia
Also, Could someone please explain how the factor of 7 comes in the picture in this sentence For example if memtable_total_space_in_mb is 100MB, and memtable_flush_writers is the default 1 (with one data directory), and memtable_flush_queue_size is the default 4, and a Column Family has no

How do I initialize Astyanax in a EJB Stateless bean

2012-06-06 Thread xsdt
Hello All, How do I initialize Astyanax inside an EJB Stateless bean, which I am using to implement DAO? Thanks ben.jamin

Re: Nodes not picking up data on repair, disk loaded unevenly

2012-06-06 Thread Luke Hospadaruk
Thanks for the tips Some things I found looking around: grepping the logs for a specific repair I ran yesterday: /var/log/cassandra# grep df14e460-af48-11e1--e9014560c7bd system.log INFO [AntiEntropySessions:13] 2012-06-05 19:58:51,303 AntiEntropyService.java (line 658) [repair

Re: [phpcassa] multi_get and composite, cassandra crash my mind

2012-06-06 Thread Tyler Hobbs
On Wed, Jun 6, 2012 at 2:49 AM, Juan Ezquerro LLanes arr...@gmail.comwrote: El martes, 5 de junio de 2012 19:19:02 UTC+2, Tyler Hobbs escribió: The Cassandra users mailing list is a better place for this question, so I'm moving it there. Hi, I need a phpcassa compatible solution .

RE: Cassandra not retrieving the complete data on 2 nodes

2012-06-06 Thread Poziombka, Wade L
what is your consistency level? From: Prakrati Agrawal [mailto:prakrati.agra...@mu-sigma.com] Sent: Wednesday, June 06, 2012 4:58 AM To: user@cassandra.apache.org Subject: RE: Cassandra not retrieving the complete data on 2 nodes Please anyone reply to my query Prakrati Agrawal | Developer -

Re: Cassandra not retrieving the complete data on 2 nodes

2012-06-06 Thread Tyler Hobbs
In addition to using a low consistency level, it sounds like you didn't bootstrap the node or run a repair after it joined the ring. On Wed, Jun 6, 2012 at 12:41 PM, Poziombka, Wade L wade.l.poziom...@intel.com wrote: what is your consistency level? ** ** *From:* Prakrati Agrawal

Re: memory issue on 1.1.0

2012-06-06 Thread Tyler Hobbs
Just to check, do you have JNA setup correctly? (You should see a couple of log messages about it shortly after startup.) Truncate also performs a snapshot by default. On Wed, Jun 6, 2012 at 12:38 PM, Poziombka, Wade L wade.l.poziom...@intel.com wrote: ** However, after all the work I

RE: memory issue on 1.1.0

2012-06-06 Thread Poziombka, Wade L
I believe so. There are no warnings on startup. So is there a preferred way to completely eliminate a column family? From: Tyler Hobbs [mailto:ty...@datastax.com] Sent: Wednesday, June 06, 2012 1:17 PM To: user@cassandra.apache.org Subject: Re: memory issue on 1.1.0 Just to check, do you have

Re: Removing a node in cluster

2012-06-06 Thread aaron morton
It depends on what you mean by remove (background info here http://www.datastax.com/docs/1.0/operations/cluster_management ) If you use nodetool decomission or nodetool removetoken the data will be redistributed. Cheers - Aaron Morton Freelance Developer @aaronmorton

Re: How to include two nodes in Java code using Hector

2012-06-06 Thread aaron morton
The client does not have to know where the data is, thats what the cluster works out see http://www.datastax.com/docs/1.0/cluster_architecture/about_client_requests Now I have decommissioned a node but now I don't know how to recommission it .Please help me

Re: how to create keyspace using cassandra API's

2012-06-06 Thread aaron morton
You can use the CLI http://www.datastax.com/docs/1.0/dml/using_cli or CQL http://www.datastax.com/docs/1.0/dml/using_cql Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 6/06/2012, at 9:00 PM, Prakrati Agrawal wrote: You have to create

Re: Node decomission failed

2012-06-06 Thread aaron morton
Take a look in the logs for .185 and check for errors. Run node tool ring from node .62 to see if it thinks .185 is in the ring. if all looks good, try to decomission again. Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 7/06/2012, at

Re: MeteredFlusher in system.log entries

2012-06-06 Thread aaron morton
You question was Could you please throw light on the what conditions does MeteredFlusher use to trigger memtable flushes. The answer is estimates of the ratio between the live size and the serialised size of memtables are kept. The MeteredFlusher periodically checks the serialised size of all

Re: memory issue on 1.1.0

2012-06-06 Thread aaron morton
use drop. truncate is mostly for unit tests. A - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 7/06/2012, at 6:22 AM, Poziombka, Wade L wrote: I believe so. There are no warnings on startup. So is there a preferred way to completely

Re: Nodes not picking up data on repair, disk loaded unevenly

2012-06-06 Thread Luke Hospadaruk
Another little question: I just added some EBS volumes to the nodes that are particularly choked and I am now running major compactions on those nodes (and all is well so far). Once everything gets back down to a normal size, can I move all the data back off the ebs volumes? something along

Re: Secondary Indexes, Quorum and Cluster Availability

2012-06-06 Thread Jim Ancona
On Tue, Jun 5, 2012 at 4:30 PM, Jim Ancona j...@anconafamily.com wrote: It might be a good idea for the documentation to reflect the tradeoffs more clearly. Here's a proposed addition to the Secondary Index FAQ at http://wiki.apache.org/cassandra/SecondaryIndexes Q: How does choice of

Cassandra 1.1.1 Fails to Start

2012-06-06 Thread Javier Sotelo
Hi All, On SuSe Linux blade with 6GB of RAM. with disk_access_mode mmap_index_only and mmap I see OOM map failed error on SSTableBatchOpen thread. cat /proc/pid/maps shows a peak of 53521 right before it dies. vm.max_map_count = 1966080 and /proc/pid/limits shows unlimited locked memory. with

Re: how to create keyspace using cassandra API's

2012-06-06 Thread Abhijit Chanda
U can use Astyanax API. These sort minor issues are resolved in that API. Regards, Abhijit