Re: Node stuck in joining the ring

2015-02-26 Thread Batranut Bogdan
No errors in the system.log file [root@cassa09 cassandra]# grep ERROR system.log[root@cassa09 cassandra]# Nothing. On Thursday, February 26, 2015 1:55 PM, mck m...@apache.org wrote: Any errors in your log file? We saw something similar when bootstrap crashed when rebuilding

Re: Node stuck in joining the ring

2015-02-26 Thread Batranut Bogdan
All the nodes have the same version. 2.0.12

Re: Node stuck in joining the ring

2015-02-26 Thread Batranut Bogdan
Hello Jan, Yes I do have ntp and it is in synch. On Thursday, February 26, 2015 11:49 AM, Jan Kesten j.kes...@enercast.de wrote: Hi Batranut, apart from the other suggestions - do you have ntp running on all your cluster nodes and are times in sync? Jan

Re: Node stuck in joining the ring

2015-02-26 Thread Batranut Bogdan
25, 2015 at 3:38 PM, Batranut Bogdan batra...@yahoo.com wrote: I have a new node that I want to add to the ring. The problem is that nodetool says UJ I have left it for several days and the status has not changed. In Opscenter it is seen as in an unknown cluster.  If I were you, I would do

Node stuck in joining the ring

2015-02-25 Thread Batranut Bogdan
Hello all, I have a new node that I want to add to the ring. The problem is that nodetool says UJ I have left it for several days and the status has not changed. In Opscenter it is seen as in an unknown cluster.  From the time that I started it, it was streaming data and the data size is 5,9

FileNotFoundException

2015-02-24 Thread Batranut Bogdan
Hello all, One of my C* throws a big amount of exceptions like this: ERROR [ReadStage:792] 2015-02-24 10:43:54,183 CassandraDaemon.java (line 199) Exception in thread Thread[ReadStage:792,5,main]java.lang.RuntimeException: java.lang.RuntimeException: java.io.FileNotFoundException:

Fw: FileNotFoundException

2015-02-24 Thread Batranut Bogdan
? On Tuesday, February 24, 2015 11:46 AM, Batranut Bogdan batra...@yahoo.com wrote: Hello all, One of my C* throws a big amount of exceptions like this: ERROR [ReadStage:792] 2015-02-24 10:43:54,183 CassandraDaemon.java (line 199) Exception in thread Thread[ReadStage:792,5,main

Re: Adding new node to cluster

2015-02-18 Thread Batranut Bogdan
nodes need the same seeds in the yaml file. Here is more info: http://www.datastax.com/documentation/cassandra/2.0/cassandra/initialize/initializeSingleDS.html    Sean Durity – Cassandra Admin, Big Data TeamTo engage the team,create a request From: Batranut Bogdan [mailto:batra...@yahoo.com

Re: Adding new node to cluster

2015-02-17 Thread Batranut Bogdan
and Joining - UN: means your node is Up and in Normal state UN in nodetool is good ;-) On 17/02/2015 13:56, Batranut Bogdan wrote: Hello all, I have an existing cluster. When adding a new node, I saw that Opscenter saw the node in an unknown cluster. In the yaml, the cluster name

Re: Adding new node to cluster

2015-02-17 Thread Batranut Bogdan
browser to see the nodes represented properly in OpsCenter.     Sean Durity – Cassandra Admin, Home Depot   From: Batranut Bogdan [mailto:batra...@yahoo.com] Sent: Tuesday, February 17, 2015 10:20 AM To: user@cassandra.apache.org; reynald.bourtembo...@esrf.fr Subject: Re: Adding new node to cluster

Adding new node to cluster

2015-02-17 Thread Batranut Bogdan
Hello all, I have an existing cluster. When adding a new node, I saw that Opscenter saw the node in an unknown cluster. In the yaml, the cluster name is the same. So i have stopped the node and added it's ip address in the list of seeds. Now Opscenter sees my node. But nodetool status now sees

Re: Added new nodes to cluster but no streams

2015-02-13 Thread Batranut Bogdan
Got it, thank you very much. On Friday, February 13, 2015 4:04 PM, Jens Rantil jens.ran...@tink.se wrote: Hi Bastranut, A few minutes between each node will do. Cheers,Jens On Fri, Feb 13, 2015 at 1:12 PM, Batranut Bogdan batra...@yahoo.com wrote: Hello, When adding a new node

Re: Added new nodes to cluster but no streams

2015-02-13 Thread Batranut Bogdan
, 2015 at 3:20 AM, Batranut Bogdan batra...@yahoo.com wrote: I have added new nodes to the existing cluster. In Opscenter I do not see any streams... I presume that the new nodes get the data from the rest of the cluster via streams. The existing cluster has TB magnitude, and space used in the new

Added new nodes to cluster but no streams

2015-02-12 Thread Batranut Bogdan
Hello, I have added new nodes to the existing cluster. In Opscenter I do not see any streams... I presume that the new nodes get the data from the rest of the cluster via streams. The existing cluster has TB magnitude, and space used in the new nodes is ~90 GB. I must admit that I have

Adding new node - OPSCenter problems

2015-02-11 Thread Batranut Bogdan
Hello all, I have added new 3 nodes to existing cluster. I must point out that I have copied the cassandra yaml file, from an existing node and just changed listen_addres per instructions here: Adding nodes to an existing cluster | DataStax Cassandra 2.0 Documentation |   | |   |   |   |   |  

Re: Adding new node - OPSCenter problems

2015-02-11 Thread Batranut Bogdan
: 1649www.pythian.com On Wed, Feb 11, 2015 at 3:46 PM, Batranut Bogdan batra...@yahoo.com wrote: Hello all, I have added new 3 nodes to existing cluster. I must point out that I have copied the cassandra yaml file, from an existing node and just changed listen_addres per instructions here: Adding

Opscenter served reads / second

2015-01-29 Thread Batranut Bogdan
Hello, Is there a metric that will show how many reads per second C* serves? Read requests shows how many requests are issued to cassandra, but I want to know how many the cluster can actualy serve .

Nodetool clearsnapshot

2015-01-13 Thread Batranut Bogdan
I have read that snapshots are basicaly symlinks and they do not take that much space.Why if I run nodetool clearsnapshot it frees a lot of space? I am seeing GBs freed...

Re: Nodetool clearsnapshot

2015-01-13 Thread Batranut Bogdan
OK Thanks, But I also read that repair will take a snapshot. Due to the fact that I have Replication factor 3 for my keyspace, I run nodetool clearsnapshot to keep disk space use to a minimum. Will this impact my repair? On Tuesday, January 13, 2015 4:19 PM, Jan Kesten

Re: 2 Cassandra nodes slow

2015-01-13 Thread Batranut Bogdan
Neelakantan ra...@rahul.be wrote: Is the data distribution OK? Have you tried running repairs? Rahul On Jan 13, 2015, at 5:01 AM, Batranut Bogdan batra...@yahoo.com wrote: Hello, I have a cluster of 6 C* nodes. All machines have the same hardware. I have noticed in opscenter that when I start

2 Cassandra nodes slow

2015-01-13 Thread Batranut Bogdan
Hello, I have a cluster of 6 C* nodes. All machines have the same hardware. I have noticed in opscenter that when I start reading a lot from the cluster 2 nodes have read latencies, but the rest do not have such high values. The replication factor for the keyspace is 3. Also those 2 nodes have

Re: Nodetool clearsnapshot

2015-01-13 Thread Batranut Bogdan
Got it, Thank you! On Tuesday, January 13, 2015 5:00 PM, Yuki Morishita mor.y...@gmail.com wrote: Snapshot during repair is automatically cleared if repair succeeds. Unfortunately, you have to delete it manually if repair failed or stalled. On Tue, Jan 13, 2015 at 8:30 AM, Batranut

Datastax Cassandra Java Driver executeAsynch question.

2015-01-12 Thread Batranut Bogdan
Hello all, In my implementation of the FutureCallBack interface in the onSuccess method, I put Thread.currentThread.getName(). What I saw was that there is a ThreadPool... That is all fine, but seems to me that the pool does not have that many threads. About 10 from my observations - I did not

Key Cache Questions

2014-12-19 Thread Batranut Bogdan
Hello all,I just read that the default size of the Key cache is 100 MB. Is it stored in memory or disk? 

Date Tiered Compaction Strategy and collections

2014-11-28 Thread Batranut Bogdan
Hello all, If one has a table like this:id text,ts timestampvalues listtext  PK (id,ts)  How will the DTCS work? I am asking this because the writeTime() function does not work on collections.

Cassandra COPY to CSV and DateTieredCompactionStrategy

2014-11-27 Thread Batranut Bogdan
Hello all, I have a few things that I need to understand. 1 . Here is the scenario: we have a HUGE cf where there are daily writes it is like a time series. Now we want to change the type of a column in primary key. What I think we can do is to export to csv, create the new table and write back

Cassandra corrupt column family

2014-08-12 Thread Batranut Bogdan
Hello all, I have altered a table in cassandra and on one node it somehow got corrupted. I the changes did not propagate ok. Ran repair keyspace columnfamily... noting changed...  Is there a way to repair this?

Cassandra select results differs

2014-07-23 Thread Batranut Bogdan
Hello all, I have a CF  CREATE TABLE cf (   a text,   b int,   c int,   d int,   e int,   PRIMARY KEY (a) )  WITH   bloom_filter_fp_chance=0.01 AND   caching='KEYS_ONLY' AND   comment='' AND   dclocal_read_repair_chance=0.00 AND   gc_grace_seconds=864000 AND   index_interval=128 AND  

Re: Cassandra select results differs

2014-07-23 Thread Batranut Bogdan
I have cron jobs that repair every week. node 1 - monday , node 2 tuesday . On Wednesday, July 23, 2014 7:52 PM, Russell Bradberry rbradbe...@gmail.com wrote: sounds like you may need to run a repair On July 23, 2014 at 12:50:23 PM, Batranut Bogdan (batra...@yahoo.com) wrote: Hello

Cassandra counter column family performance

2014-05-13 Thread Batranut Bogdan
Hello all, I have a counter CF defined as pk text PRIMARY KEY, a counter, b counter, c counter, d counter After inserting a few million keys... 55 mil, the performance goes down the drain, 2-3 nodes in the cluster are on medium load, and when inserting batches of same lengths writes take

Couter column family performance problems

2014-05-13 Thread Batranut Bogdan
Hello all, I have a counter CF defined as pk text PRIMARY KEY, a counter, b counter, c counter, d counter After inserting a few million keys... 55 mil, the performance goes down the drain, 2-3 nodes in the cluster are on medium load, and when inserting batches of same lengths writes take

cassandra snapshots

2014-05-05 Thread Batranut Bogdan
Hello all I have a big col family and I see that cassandra is taking snapshots for it. I do not have incremental enabled. What are the triggers that start the process of taking a snapshot? Is is automatic ? Thanks

Re: cassandra snapshots

2014-05-05 Thread Batranut Bogdan
Hello Robert, Neither of those actions were taken on that cf as far as I know. In that cf we only insert historical data. No deletes no drops / truncates. Thanks On Monday, May 5, 2014 10:50 PM, Robert Coli rc...@eventbrite.com wrote: On Mon, May 5, 2014 at 12:48 PM, Batranut Bogdan batra

Old tables still exist

2014-04-30 Thread Batranut Bogdan
Hello all, I have a question. I looked in the keyspace directory and saw that old dirs still exist after dropping the corresponding table. eg drop table t1 and in /data/keyspace I still see the t1 dir.  Is there a way to get cassandra to remove these old and unused tables?

Re: Old tables still exist

2014-04-30 Thread Batranut Bogdan
the real need is there. Thanks for the answer. On Thursday, May 1, 2014 1:06 AM, Robert Coli rc...@eventbrite.com wrote: On Wed, Apr 30, 2014 at 3:00 PM, Batranut Bogdan batra...@yahoo.com wrote: Is there a way to get cassandra to remove these old and unused tables? Those directories have

Compaction throrheling

2014-04-24 Thread Batranut Bogdan
Hello allbr/Can someone please explain to me what compaction throtheling does ? I am reffering to the yaml parameter. I have changed it from the default 16 to 160 but i see no improvement. I have a cluster with hdds. I might be missing something ...br/br/Thanksa

Re: Load balancing issue with virtual nodes

2014-04-24 Thread Batranut Bogdan
Htop is not the only tool for this . Cassandra will hit io bottlnecks before cpu (on faster cpus) . A simple solution is to check the size of the data dir on the boxes. If you have aprox the same size then cassandra is wrinting in the whole cluster. Check how the data dir size changes when

Re: Compaction throrheling

2014-04-24 Thread Batranut Bogdan
Is this a setting that will have an impact only on fast cpu + ssd ? On Thursday, April 24, 2014 11:52 PM, Robert Coli rc...@eventbrite.com wrote: On Thu, Apr 24, 2014 at 12:50 PM, Batranut Bogdan batra...@yahoo.com wrote: Can someone please explain to me what compaction throtheling does ? I am

Re: Compaction throrheling

2014-04-24 Thread Batranut Bogdan
...@eventbrite.com wrote: On Thu, Apr 24, 2014 at 1:54 PM, Batranut Bogdan batra...@yahoo.com wrote: Is this a setting that will have an impact only on fast cpu + ssd ? It's a setting that will only have impact if you have CPU or IO to spare. You don't need a fast CPU or SSD to meet those

Re: Load balancing issue with virtual nodes

2014-04-24 Thread Batranut Bogdan
I don't know about hector but the datastax java driver needs just one ip from the cluster and it will discover the rest of the nodes. Then by default it will do a round robin when sending requests. So if Hector does the same the patterb will againg appear. Did you look at the size of the dirs?

Re: FileNotFoundException ...-Data.db

2014-03-25 Thread Batranut Bogdan
at 9:41 AM, Batranut Bogdan batra...@yahoo.com wrote: I am reposting a question about missing files on one of the nodes of my cluster. After I first saw that I was missing a ...-Data.db file, I decomissioned the node, deleted the data and added it back into the cluster. Now I see again that I am

Re: FileNotFoundException ...-Data.db

2014-03-25 Thread Batranut Bogdan
the other nodes in the cluster. On Tuesday, March 25, 2014 9:53 PM, Duncan Sands duncan.sa...@gmail.com wrote: Hi, On 25/03/14 19:30, Robert Coli wrote: On Tue, Mar 25, 2014 at 5:36 AM, Batranut Bogdan batra...@yahoo.com mailto:batra...@yahoo.com wrote:     I am running 2.0.6 and I use /etc

Re: FileNotFoundException ...-Data.db

2014-03-25 Thread Batranut Bogdan
Well grepping the logs for a file resulted in this: During startup that file was opened OK. During runtime the compactionexecutor tried to compact more files that included this one but threw and exception for another one that is first in that list. So I do not have more info. In one particular

FileNotFoundException ...-Data.db

2014-03-24 Thread Batranut Bogdan
Hello all, I am reposting a question about missing files on one of the nodes of my cluster. After I first saw that I was missing a ...-Data.db file, I decomissioned the node, deleted the data and added it back into the cluster. Now I see again that I am missing some files. Do you have an ideea

Cassandra FileNotFoundException .db file not found

2014-03-17 Thread Batranut Bogdan
Hello, A investigation on one of the nodes reveals that I am missing several .db files. I got FileNotFoundException in the logs on one node in the cluster. How can I fix this? nodetool repair doesn't seem to work in this case. Thank you.

Re: Cassandra slow on some reads

2014-03-15 Thread Batranut Bogdan
Hello, Yes for the first query the server can be slow but no matter what is should not take 10 seconds to get one key from a column family. I can see this happening if I have times like 20 ms for some queries and let's say 300 ms for uncached ones. But I have responses that take from 8 to 20

Re: Cassandra slow on some reads

2014-03-15 Thread Batranut Bogdan
of the lengthy queries? On 15 Mar 2014 20:49, Batranut Bogdan batra...@yahoo.com wrote: Hello, Yes for the first query the server can be slow but no matter what is should not take 10 seconds to get one key from a column family. I can see this happening if I have times like 20 ms for some queries

Cassandra slow on some reads

2014-03-14 Thread Batranut Bogdan
Hello all, Here is the environment: I have a 6 node Cassandra cluster. On each node I have: - 32 G RAM - 24 G RAM for cassa - ~150 - 200 MB/s disk speed - tomcat 6 with axis2 webservice that uses the datastax java driver to make asynch reads / writes  - replication factor for the keyspace is 3

Re: Cassandra slow on some reads

2014-03-14 Thread Batranut Bogdan
Ok will try to reduce heap and see what happens. Thanks guys. I' get back with conclusions.a href=https://overview.mail.yahoo.com?.src=iOS;br/br/Sent from Yahoo Mail for iPhone/a

Re: Cassandra slow on some reads

2014-03-14 Thread Batranut Bogdan
- Tomcat ). I don’t quite understand your reasoning here:  (I know that there is a lot of heap but I also have write heavy tasks and I want them to get into mem fast) . So, I would try with default cassandra-env.sh JVM params too From: Batranut Bogdan batra...@yahoo.com Reply-To: user

Re: Cassandra slow on some reads

2014-03-14 Thread Batranut Bogdan
, 2014 at 8:50 AM, Batranut Bogdan batra...@yahoo.com wrote: Hello all, Here is the environment: I have a 6 node Cassandra cluster. On each node I have: - 32 G RAM - 24 G RAM for cassa - ~150 - 200 MB/s disk speed - tomcat 6 with axis2 webservice that uses the datastax java driver to make asynch

Re:

2014-03-13 Thread Batranut Bogdan
, March 12, 2014, Batranut Bogdan batra...@yahoo.com wrote: Hello all, The environment: I have a 6 node Cassandra cluster. On each node I have: - 32 G RAM - 24 G RAM for cassa - ~150 - 200 MB/s disk speed - tomcat 6 with axis2 webservice that uses the datastax java driver to make asynch

[no subject]

2014-03-12 Thread Batranut Bogdan
Hello all, The environment: I have a 6 node Cassandra cluster. On each node I have: - 32 G RAM - 24 G RAM for cassa - ~150 - 200 MB/s disk speed - tomcat 6 with axis2 webservice that uses the datastax java driver to make asynch reads / writes  - replication factor for the keyspace is 3 All