Shawn Kumar created CASSANDRA-8008:
--------------------------------------
Summary: "Timed out waiting for timer thread" on large stress
command
Key: CASSANDRA-8008
URL: https://issues.apache.org/jira/browse/CASSANDRA-8008
Project: Cassandra
Issue Type: Bug
Components: Core
Reporter: Shawn Kumar
Attachments: node1.log, node2.log
I've been using cstar_perf to test cassandra with different gc's and came
across this error on one run which effectively stopped the test:
java.lang.RuntimeException: Timed out waiting for a timer thread - seems one
got stuck at org.apache.cassandra.stress.util.Timing.snap(Timing.java:83)
It looks similar to CASSANDRA-6943, but that should have fixed it, and I
haven't been able to consistently replicate this with other runs. This
particular run was stress writing/reading about 300M keys, and is an early
attempt at carrying out a test of this size so perhaps it only manifests with
larger tests.
The modifications from stock 2.1.0 were changes to heap size and usage of g1gc,
as well as using offheap_objects. I have attached thread dumps from the nodes
in question, hopefully they capture the broken state. I am continuing to test
this, and will see if I can reproduce this again.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
