Re: Upgrading to 3.11.8 Caused Map Failures

2020-12-11 Thread Shalom Sagges
Forgot to mention that there were also LEAK DETECTED errors: ERROR [Reference-Reaper] 2020-12-11 03:25:42,172 Ref.java:229 - LEAK DETECTED: a reference (org.apache.cassandra.utils.concurrent.Ref$State@451030de) to class

Upgrading to 3.11.8 Caused Map Failures

2020-12-11 Thread Shalom Sagges
Hi All, I upgraded Cassandra from v3.11.4 to v3.11.8. The upgrade went smoothly, however, after a few hours, a node crashed on OOM and a few hours later, another one crashed. Seems like they crashed from excessive GC behaviour (CMS). The logs show Map failures on CompactionExecutor: ERROR