cassandra 3.11.4 deadlock

2020-06-23 Thread John Doe
We are running apache-cassandra-3.11.4, 10 node cluster with -Xms32G -Xmx32G -Xmn8G using CMS. after running couple of days one of the node become unresponsive and threaddump (jstack -F) shows deadlock. Found one Java-level deadlock: =

Cassandra upgrade from 3.11.3 -> 3.11.6

2020-06-23 Thread Jai Bheemsen Rao Dhanwada
Hello, I am trying to upgrade from 3.11.3 to 3.11.6. Can I add new nodes with the 3.11.6 version to the cluster running with 3.11.3? Also, I see the SSTable format changed from mc-* to md-*, does this cause any issues?

Re: Cassandra upgrade from 3.11.3 -> 3.11.6

2020-06-23 Thread Jürgen Albersdorfer
Hi, I would say „It depends“ - as it always does. I have had a 21 Node Cluster running in Production in one DC with versions ranging from 3.11.1 to 3.11.6 without having had any single issue for over a year. I just upgraded all nodes to 3.11.6 for the sake of consistency. Von meinem iPhone

Re: Cassandra upgrade from 3.11.3 -> 3.11.6

2020-06-23 Thread Surbhi Gupta
In case of any issue, it gets very difficult to debug when we have multiple versions. On Tue, 23 Jun 2020 at 22:23, Jürgen Albersdorfer wrote: > Hi, I would say „It depends“ - as it always does. I have had a 21 Node > Cluster running in Production in one DC with versions ranging from 3.11.1 >

Re: cassandra 3.11.4 deadlock

2020-06-23 Thread Jeff Jirsa
Can you open a JIRA? https://issues.apache.org/jira/projects/CASSANDRA/issues On Tue, Jun 23, 2020 at 11:56 AM John Doe wrote: > We are running apache-cassandra-3.11.4, 10 node cluster with -Xms32G > -Xmx32G -Xmn8G using CMS. > after running couple of days one of the node become unresponsive

Re: cassandra 3.11.4 deadlock

2020-06-23 Thread John Doe
Yes here is one more example, happended on another node   using TWCS compaction = {'class': 'org.apache.cassandra.db.compaction.TimeWindowCompactionStrategy',   'compaction_window_size': '30',   'compaction_window_unit': 'MINUTES',   'max_threshold': '32',    

Re: cassandra 3.11.4 deadlock

2020-06-23 Thread John Doe
https://issues.apache.org/jira/browse/CASSANDRA-15898 > Sent: Tuesday, June 23, 2020 at 4:16 PM > From: "John Doe" > To: user@cassandra.apache.org > Subject: Re: cassandra 3.11.4 deadlock > > > Yes > here is one more example, happended on another node >   > using TWCS > compaction = {'class':

Re: Cassandra upgrade from 3.11.3 -> 3.11.6

2020-06-23 Thread Surbhi Gupta
Hi , We have recently upgraded from 3.11.0 to 3.11.5 . There is a sstable format change from 3.11.4 . We also had to expand the cluster and we also discussed about expansion first and than upgrade. But finally we upgraded and than expanded. As per our experience what I could tell you is, it is