Re: MUTATION_* messages in log
First thing to check, do you have NTP client running on all Cassandra servers? Are their clock in sync? If you answer "yes" to both, check the server load, does any server have high CPU usage or disk utilization? Any swapping activity? If not, check the GC logs, and looking for long GC pauses. On 12/04/2022 10:15, Azamat Hackimov wrote: Hello. I've got two DCs with 8 hardware servers on each. After migration to Cassandra 4 I have strange messages in system.log: INFO [ScheduledTasks:1] 2022-04-12 12:05:58,595 MessagingMetrics.java:206 - MUTATION_RSP messages were dropped in last 5000 ms: 0 internal and 241 cross node. Mean internal dropped latency: 0 ms and Mean cross-node dropped latency: 2395 ms INFO [ScheduledTasks:1] 2022-04-12 12:05:58,596 MessagingMetrics.java:206 - MUTATION_REQ messages were dropped in last 5000 ms: 0 internal and 8 cross node. Mean internal dropped latency: 0 ms and Mean cross-node dropped latency: 2395 ms INFO [ScheduledTasks:1] 2022-04-12 12:05:58,596 MessagingMetrics.java:206 - PAXOS_COMMIT_RSP messages were dropped in last 5000 ms: 0 internal and 102 cross node. Mean internal dropped latency: 0 ms and Mean cross-node dropped latency: 2395 ms Can someone interpret these messages? I suspect that messages indicate that the cluster has some replication issues.
MUTATION_* messages in log
Hello. I've got two DCs with 8 hardware servers on each. After migration to Cassandra 4 I have strange messages in system.log: INFO [ScheduledTasks:1] 2022-04-12 12:05:58,595 MessagingMetrics.java:206 - MUTATION_RSP messages were dropped in last 5000 ms: 0 internal and 241 cross node. Mean internal dropped latency: 0 ms and Mean cross-node dropped latency: 2395 ms INFO [ScheduledTasks:1] 2022-04-12 12:05:58,596 MessagingMetrics.java:206 - MUTATION_REQ messages were dropped in last 5000 ms: 0 internal and 8 cross node. Mean internal dropped latency: 0 ms and Mean cross-node dropped latency: 2395 ms INFO [ScheduledTasks:1] 2022-04-12 12:05:58,596 MessagingMetrics.java:206 - PAXOS_COMMIT_RSP messages were dropped in last 5000 ms: 0 internal and 102 cross node. Mean internal dropped latency: 0 ms and Mean cross-node dropped latency: 2395 ms Can someone interpret these messages? I suspect that messages indicate that the cluster has some replication issues.
Cassandra track Call for Papers. ApacheCon NA October 3-6, 2022
We are excited to announce that the upcoming ApacheCon North America will have a two day Cassandra track. ApacheCon North America will be held October 3-6, at the Sheraton Hotel in New Orleans. The CFP is now open, and will be until May 23rd. We are interested in all talks with anything related to developing, using, or deploying Apache Cassandra. You will be surprised how useful your open source stories and experiences are to others and to our dev community. It might be how you solved a specific problem or just a general picture into how your organization uses Apache Cassandra. And of course, upgrading and running on 4.0 is a particularly hot topic we won't be able to get enough of. This will be a fantastic opportunity to network with peers, ask questions, get answers, etc. When submitting your talk, please remember to choose from the drop-down Category "Cassandra". For more information please read our blog post: https://cassandra.apache.org/_/blog/ApacheCon-NA-2022-Call-for-Papers-Open.html To go directly to submit your paper, go to https://www.apachecon.com/acna2022/cfp.html Any questions, just reach out…
