Re: WriteTimeoutException When only One Node is Down

2017-01-12 Thread Yuji Ito
Hi Shalom, I also got WriteTimeoutException in my destructive test like your test. When did you drop a node? A coordinator node sends a write request to all replicas. When one of nodes was down while the request is executed, sometimes WriteTimeOutException happens. cf.

Re: Queries execution time

2017-01-12 Thread Voytek Jarnot
We use QueryLogger which is baked in to the datastax java driver; gives you basic query execution times (and bind params) in your logs, can be tweaked using log levels. On Thu, Jan 12, 2017 at 12:31 PM, Jonathan Haddad wrote: > You're likely to benefit a lot more if you log

Check snapshot / sstable integrity

2017-01-12 Thread Jérôme Mainaud
Hello, Is there any tool to test the integrity of a snapshot? Suppose I have a snapshot based backup stored in an external low cost storage system that I want to restore to a database after someone deleted important data by mistake. Before restoring the files, I will truncate the table to

Metric to monitor partition size

2017-01-12 Thread Saumitra S
Is there any metric or way to find out if any partition has grown beyond a certain size or certain row count? If a partition reaches a certain size or limit, I want to stop sending further write requests to it. Is it possible?

Re: Is this normal!?

2017-01-12 Thread Romain Hardouin
Just a side note: increase system_auth keyspace replication factor if you're using authentication. Le Jeudi 12 janvier 2017 14h52, Alain RODRIGUEZ a écrit :  Hi, Nodetool repair always list lots of data and never stays repaired. I think. This might be the

Re: Check snapshot / sstable integrity

2017-01-12 Thread Alain RODRIGUEZ
Hi Jérôme, About this concern: But my Op retains my arm and asks: "Are you sure that the snapshot is safe > and will be restored before truncating data we have?" Make sure to enable snapshot on truncate (cassandra.yaml) or do it manually. This way if the restored dataset is worst than the

Re: Is this normal!?

2017-01-12 Thread Alain RODRIGUEZ
Hi, Nodetool repair always list lots of data and never stays repaired. I think. > This might be the reason: "incremental: true" Incremental repairs is the default in your version. It marks data as being repaired in order to only repair each data only once. It is a clever feature, but with

Re: Strange issue wherein cassandra not being started from cron

2017-01-12 Thread Alain RODRIGUEZ
Hi Ajay, honestly I would try to fix the main issue: Sometimes, the cassandra-process gets killed (reason unknown as of now). As focusing on how to restart Apache Cassandra every minute sounds like a wrong approach to me: Adding this in cron would at least ensure that the maximum downtime is

Re: Backups eating up disk space

2017-01-12 Thread Alain RODRIGUEZ
My 2 cents, As I mentioned earlier, we're not currently using snapshots - it's only the > backups that are bothering me right now. I believe backups folder is just the new name for the previously called snapshots folder. But I can be completely wrong, I haven't played that much with snapshots

Re: Backups eating up disk space

2017-01-12 Thread Khaja, Raziuddin (NIH/NLM/NCBI) [C]
Thanks, Prasenjit, I appreciate the compliment ☺ Kunal, To add to Prasenjit’s comment, it doesn’t make sense to make backups unless it is moved to secondary storage. This means that if you don’t plan to move the backups to secondary storage, you should set incremental_backups: false, and

Re: Backups eating up disk space

2017-01-12 Thread Khaja, Raziuddin (NIH/NLM/NCBI) [C]
snapshots are slightly different than backups. In my explanation of the hardlinks created in the backups folder, notice that compacted sstables, never end up in the backups folder. On the other hand, a snapshot is meant to represent the data at a particular moment in time. Thus, the snapshots

Queries execution time

2017-01-12 Thread D. Salvatore
Hi, Does anyone know if there is a way to record in a log file the queries total or partial execution time? I am interested in something similar to the tracing option but on file. Thanks Best Regards Salvatore

Re: Queries execution time

2017-01-12 Thread Benjamin Roth
Hi Salvatore, 1. Cassandra offers tons of metrics through JMX to monitor performance on keyspace and CF level 2. There is a config option to log slow queries, unfortunately JIRA is currently down, so I can't find the ticket with more details 2017-01-12 19:21 GMT+01:00 D. Salvatore

Re: Queries execution time

2017-01-12 Thread Jonathan Haddad
You're likely to benefit a lot more if you log query times from your application, as you can customize the metadata that you add around logging to increase its relevancy. On Thu, Jan 12, 2017 at 10:24 AM Benjamin Roth wrote: > Hi Salvatore, > > 1. Cassandra offers tons