Re: Why are automatic anti-entropy repairs required when hinted hand-off is enabled?

2017-04-27 Thread Thakrar, Jayesh
Thanks for the explanation, Alain - very helpful! From: Alain RODRIGUEZ Date: Thursday, April 27, 2017 at 6:12 AM To: Subject: Re: Why are automatic anti-entropy repairs required when hinted hand-off is enabled? It happened to me in the future in

Re: Commit Log question

2017-04-27 Thread Jasonstack Zhao Yang
Hi Charulata, IMO, 64MB is fine unless you archive commit log or scan it for backup. Zhao Charulata Sharma (charshar) 于2017年4月28日周五 上午8:01写道: > Hi , > > Can anyone please tell me the implication of increasing the > commitlog_segment_size_in_mb > from the default value

UNSUBSCRIBE

2017-04-27 Thread spawgi
UNSUBSCRIBE On Tue, Apr 25, 2017 at 12:53 AM, Vladimir Yudovin wrote: > Hi Luis, > > I don't thinks it's possible to achieve this by custom Snitch. As far as I > understand Snitch only provides cluster topology, and connectivity is done > by another component/layer. And

Counter being incremented extra times

2017-04-27 Thread Ali Akhtar
I have the following schema: CREATE TABLE total_volume ( team_id text, channel_id text, volume counter, PRIMARY KEY (team_id, channel_id) ); I've written an integration test, using CassandraUnit, which runs a loop 200 times and executes the query: UPDATE total_volume SET volume = volume + 1

Re: [Question] Automated cluster cleanup

2017-04-27 Thread Luigi Tagliamonte
Hello Ben, thank you for sharing the cassandra-reaper reposiroty and about the security advice. Regards L On Thu, Apr 27, 2017 at 4:54 PM, Ben Bromhead wrote: > Hi Luigi > > Under the hood, nodetool is actually just a command line wrapper around > certain JMX calls. If you

Commit Log question

2017-04-27 Thread Charulata Sharma (charshar)
Hi , Can anyone please tell me the implication of increasing the commitlog_segment_size_in_mb from the default value of 32 MB to a higher value? Some of our mutations are > 16MB, so the writes are failing. This is because of the way we store data in our Column families. 95% of the data is <

Re: [Question] Automated cluster cleanup

2017-04-27 Thread Ben Bromhead
Hi Luigi Under the hood, nodetool is actually just a command line wrapper around certain JMX calls. If you are looking to automate some more of commonplace nodetool actions, have a look at the nodetool source and it will show exactly what JMX calls (and parameters) are being passed. One thing to

[Question] Automated cluster cleanup

2017-04-27 Thread Luigi Tagliamonte
Hello Cassandra users, my cluster is getting bigger and I was looking into automating some tedious operations like the node cleanup after adding a new node to the cluster. I gave a quick search and I didn't find any good available option, so I decided to look into the JMX interface (In the

Re: How can I efficiently export the content of my table to KAFKA

2017-04-27 Thread Chris Stromberger
Maybe https://www.confluent.io/blog/kafka-connect-cassandra-sink-the-perfect-match/ On Wed, Apr 26, 2017 at 2:49 PM, Tobias Eriksson < tobias.eriks...@qvantel.com> wrote: > Hi > > I would like to make a dump of the database, in JSON format, to KAFKA > > The database contains lots of data,

Re: [Cassandra] nodetool compactionstats not showing pending task.

2017-04-27 Thread Alain RODRIGUEZ
Maybe try to monitor through JMX with 'org.apache.cassandra.db:type=CompactionManager', attribute 'Compactions' or 'CompactionsSummary' C*heers --- Alain Rodriguez - @arodream - al...@thelastpickle.com France The Last Pickle - Apache Cassandra Consulting

Re: Why are automatic anti-entropy repairs required when hinted hand-off is enabled?

2017-04-27 Thread Alain RODRIGUEZ
> > It happened to me in the future in a bad way, and nothing prevent it from > happening in the future Obviously "It happened to me in the past in a bad way"*. Thinking faster than I write... I am quite slow writing :p. To be clear I recommend: - to run repairs within gc_grace_seconds when

Re: Why are automatic anti-entropy repairs required when hinted hand-off is enabled?

2017-04-27 Thread Alain RODRIGUEZ
Hi, To put it easy, I have been taught that anything that can be disabled is an optimization. So we don't want to rely an optimization that can silently fail. This goes for read repair as well as we cannot be sure that all the data will be read. Plus it is configured to trigger only 10 % of the

Re: [Cassandra] nodetool compactionstats not showing pending task.

2017-04-27 Thread Alain RODRIGUEZ
Hi, I am not sure about this one. It happened to me in the past as well. I never really wondered about it as it was gone after a while or a restart off the top of my head. To get rid of it, a restart might be enough. But if you feel like troubleshooting this, I think the first thing is to try to

Re: what is MemtableReclaimMemory mean ??

2017-04-27 Thread Alain RODRIGUEZ
Hi Pranay, According to http://docs.datastax.com/en/cassandra/3.0/cassandra/tools/toolsTPstats.html, "*MemtableReclaimMemory*" is the thread pool used for "Making unused memory available". I don't know much about it since it was never an issue for me. Neither did I heard much about it. - Are

Re: Drop tables takes too long

2017-04-27 Thread Alain RODRIGUEZ
Hi > Long GC Pauses take about one minute. But why it takes so much time and > how that can be fixed? This is very long. Looks like you are having a major issue, and it is not just about dropping tables... Or is it on happening during drop table actions? Knowing the complete set of GC options