Re: Cassandra Compaction Metrics - CompletedTasks vs TotalCompactionCompleted

2018-08-10 Thread Chris Lohfink
If its occurring that often you can monitor nodetool compactionstats to see whats running > On Aug 10, 2018, at 11:35 AM, Dionne Cloudoupoulos > wrote: > > On 2017/10/31 16:56:29, Chris Lohfink wrote: >> The "CompletedTasks" metric is a measure of how many tasks ran on these two >> executors

Re: Cassandra Compaction Metrics - CompletedTasks vs TotalCompactionCompleted

2018-08-10 Thread Dionne Cloudoupoulos
On 2017/10/31 16:56:29, Chris Lohfink wrote: > The "CompletedTasks" metric is a measure of how many tasks ran on these two > executors combined. > The "TotalCompactionsCompleted" metric is a measure of how many compactions > issued from the compaction manager ran (normal compactions, cache writes,

Re: Cassandra Compaction Metrics - CompletedTasks vs TotalCompactionCompleted

2017-11-01 Thread Lucas Benevides
Thanks a lot Chris, I had noticed that even the counter in the TotalCompactionsCompleted is higher than the number of SSTables compactions, that is what interests me most. I measured the number of compactions turning on the log_all in the compaction settings in the tables and reading the

Re: Cassandra Compaction Metrics - CompletedTasks vs TotalCompactionCompleted

2017-10-31 Thread Chris Lohfink
CompactionMetrics is a combination of the compaction executor (sstable compactions, secondary index build, view building, relocate, garbagecollect, cleanup, scrub etc) and validation executor (repairs). Keep in mind not all jobs execute 1 task per operation, things that use the

Re: Cassandra Compaction Metrics - CompletedTasks vs TotalCompactionCompleted

2017-10-30 Thread Lucas Benevides
Kurt, I apreciate your answer but I don't believe CompletedTasks count the "validation compactions". These are compactions that occur from repair operations. I am running tests on 10 cluster nodes in the same physical rack, with Cassandra Stress Tool and I didn't make any Repair commands. The

Cassandra Compaction Metrics - CompletedTasks vs TotalCompactionCompleted

2017-10-27 Thread Lucas Benevides
Dear community, I am studying the behaviour of the Cassandra TimeWindowCompactionStragegy. To do so I am watching some metrics. Two of these metrics are important: Compaction.CompletedTasks, a gauge, and the TotalCompactionsCompleted, a Meter. According to the documentation (