Re: many instances of org.apache.cassandra.io.sstable.format.SSTableReader$InstanceTidier$1 on the heap

2020-08-04 Thread jelmer
old version of caffeine and there have been issues <https://github.com/ben-manes/caffeine/issues/216> with it in the past where it would go into an endless loop under the wrong set of circumstances On Mon, 3 Aug 2020 at 13:52, jelmer wrote: > It did look like there where repairs running at

Re: many instances of org.apache.cassandra.io.sstable.format.SSTableReader$InstanceTidier$1 on the heap

2020-08-03 Thread jelmer
It did look like there where repairs running at the time. The LiveSSTableCount for the entire node is about 2200 tables, for the keyspace that was being repaired its just 150 We run cassandra 3.11.6 so we should be unaffected by cassandra-14096 We use http://cassandra-reaper.io/ for the repairs

many instances of org.apache.cassandra.io.sstable.format.SSTableReader$InstanceTidier$1 on the heap

2020-07-31 Thread jelmer
Hi, I am looking into some issues we are having with a cassandra cluster. What happens is that a node will suddenly start spending all its time in garbage collection becoming non responsive and dropping in and out of the cluster. A restart will solve the problem. We created a heap dump this time