[ 
https://issues.apache.org/jira/browse/CASSANDRA-11668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Russ Hatch updated CASSANDRA-11668:
-----------------------------------
    Description: 
This exception was seen when trying to repro a test problem. The original issue 
test problem appears to be a non-issue, but the exception seems like it could 
be worth investigation.

This happened on upgrade from 3.2.1 to 3.3 HEAD (a soon to be retired 
test-case).

The test does a rolling upgrade where nodes are one by one stopped, upgraded, 
and started on the new version.

The exception occurred some time after starting node1 on the upgraded version, 
and upgrading/starting node2 on the new version. Node2 logged the exception.
{noformat}
node2: ERROR [HintsDispatcher:2] 2016-05-09 23:37:45,816 
CassandraDaemon.java:195 - Exception in thread Thread[HintsDispatcher:2,1,main]
java.lang.AssertionError: java.lang.InterruptedException
        at 
org.apache.cassandra.hints.HintsDispatcher$Callback.await(HintsDispatcher.java:205)
 ~[apache-cassandra-3.2.1.jar:3.2.1]
        at 
org.apache.cassandra.hints.HintsDispatcher.sendHintsAndAwait(HintsDispatcher.java:146)
 ~[apache-cassandra-3.2.1.jar:3.2.1]
        at 
org.apache.cassandra.hints.HintsDispatcher.dispatch(HintsDispatcher.java:121) 
~[apache-cassandra-3.2.1.jar:3.2.1]
        at 
org.apache.cassandra.hints.HintsDispatcher.dispatch(HintsDispatcher.java:93) 
~[apache-cassandra-3.2.1.jar:3.2.1]
        at 
org.apache.cassandra.hints.HintsDispatchExecutor$DispatchHintsTask.dispatch(HintsDispatchExecutor.java:247)
 ~[apache-cassandra-3.2.1.jar:3.2.1]
        at 
org.apache.cassandra.hints.HintsDispatchExecutor$DispatchHintsTask.dispatch(HintsDispatchExecutor.java:219)
 ~[apache-cassandra-3.2.1.jar:3.2.1]
        at 
org.apache.cassandra.hints.HintsDispatchExecutor$DispatchHintsTask.run(HintsDispatchExecutor.java:198)
 ~[apache-cassandra-3.2.1.jar:3.2.1]
        at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) 
~[na:1.8.0_51]
        at java.util.concurrent.FutureTask.run(FutureTask.java:266) 
~[na:1.8.0_51]
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) 
~[na:1.8.0_51]
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
[na:1.8.0_51]
        at java.lang.Thread.run(Thread.java:745) [na:1.8.0_51]
Caused by: java.lang.InterruptedException: null
        at 
org.apache.cassandra.utils.concurrent.WaitQueue$AbstractSignal.checkInterrupted(WaitQueue.java:313)
 ~[apache-cassandra-3.2.1.jar:3.2.1]
        at 
org.apache.cassandra.utils.concurrent.WaitQueue$AbstractSignal.awaitUntil(WaitQueue.java:301)
 ~[apache-cassandra-3.2.1.jar:3.2.1]
        at 
org.apache.cassandra.utils.concurrent.SimpleCondition.await(SimpleCondition.java:63)
 ~[apache-cassandra-3.2.1.jar:3.2.1]
        at 
org.apache.cassandra.hints.HintsDispatcher$Callback.await(HintsDispatcher.java:201)
 ~[apache-cassandra-3.2.1.jar:3.2.1]
        ... 11 common frames omitted
Unexpected error in node2 log, error: 
ERROR [HintsDispatcher:2] 2016-05-09 23:37:45,816 CassandraDaemon.java:195 - 
Exception in thread Thread[HintsDispatcher:2,1,main]
java.lang.AssertionError: java.lang.InterruptedException
        at 
org.apache.cassandra.hints.HintsDispatcher$Callback.await(HintsDispatcher.java:205)
 ~[apache-cassandra-3.2.1.jar:3.2.1]
        at 
org.apache.cassandra.hints.HintsDispatcher.sendHintsAndAwait(HintsDispatcher.java:146)
 ~[apache-cassandra-3.2.1.jar:3.2.1]
        at 
org.apache.cassandra.hints.HintsDispatcher.dispatch(HintsDispatcher.java:121) 
~[apache-cassandra-3.2.1.jar:3.2.1]
        at 
org.apache.cassandra.hints.HintsDispatcher.dispatch(HintsDispatcher.java:93) 
~[apache-cassandra-3.2.1.jar:3.2.1]
        at 
org.apache.cassandra.hints.HintsDispatchExecutor$DispatchHintsTask.dispatch(HintsDispatchExecutor.java:247)
 ~[apache-cassandra-3.2.1.jar:3.2.1]
        at 
org.apache.cassandra.hints.HintsDispatchExecutor$DispatchHintsTask.dispatch(HintsDispatchExecutor.java:219)
 ~[apache-cassandra-3.2.1.jar:3.2.1]
        at 
org.apache.cassandra.hints.HintsDispatchExecutor$DispatchHintsTask.run(HintsDispatchExecutor.java:198)
 ~[apache-cassandra-3.2.1.jar:3.2.1]
        at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) 
~[na:1.8.0_51]
        at java.util.concurrent.FutureTask.run(FutureTask.java:266) 
~[na:1.8.0_51]
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) 
~[na:1.8.0_51]
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
[na:1.8.0_51]
        at java.lang.Thread.run(Thread.java:745) [na:1.8.0_51]
Caused by: java.lang.InterruptedException: null
        at 
org.apache.cassandra.utils.concurrent.WaitQueue$AbstractSignal.checkInterrupted(WaitQueue.java:313)
 ~[apache-cassandra-3.2.1.jar:3.2.1]
        at 
org.apache.cassandra.utils.concurrent.WaitQueue$AbstractSignal.awaitUntil(WaitQueue.java:301)
 ~[apache-cassandra-3.2.1.jar:3.2.1]
        at 
org.apache.cassandra.utils.concurrent.SimpleCondition.await(SimpleCondition.java:63)
 ~[apache-cassandra-3.2.1.jar:3.2.1]
        at 
org.apache.cassandra.hints.HintsDispatcher$Callback.await(HintsDispatcher.java:201)
 ~[apache-cassandra-3.2.1.jar:3.2.1]
        ... 11 common frames omitted
{noformat}


CI results can be viewed here: 
http://cassci.datastax.com/view/Parameterized/job/parameterized_dtest_multiplexer/95/testReport/node_2_iter_001.upgrade_tests.upgrade_through_versions_test/ProtoV4Upgrade_3_2_UpTo_3_3_HEAD/rolling_upgrade_with_internode_ssl_test_2/


  was:
This exception was seen when trying to repro a test problem. The original issue 
test problem appears to be a non-issue, but the exception seems like it could 
be worth investigation.

This happened on upgrade from 3.2.1 to 3.3 HEAD (a soon to be retired 
test-case).

The test does a rolling upgrade where nodes are one by one stopped, upgraded, 
and started on the new version.

The exception occurred some time after starting node1 on the upgraded version, 
and upgrading/starting node2 on the new version. Node2 logged the exception.
{noformat}
node2: ERROR [HintsDispatcher:2] 2016-05-09 23:37:45,816 
CassandraDaemon.java:195 - Exception in thread Thread[HintsDispatcher:2,1,main]
java.lang.AssertionError: java.lang.InterruptedException
        at 
org.apache.cassandra.hints.HintsDispatcher$Callback.await(HintsDispatcher.java:205)
 ~[apache-cassandra-3.2.1.jar:3.2.1]
        at 
org.apache.cassandra.hints.HintsDispatcher.sendHintsAndAwait(HintsDispatcher.java:146)
 ~[apache-cassandra-3.2.1.jar:3.2.1]
        at 
org.apache.cassandra.hints.HintsDispatcher.dispatch(HintsDispatcher.java:121) 
~[apache-cassandra-3.2.1.jar:3.2.1]
        at 
org.apache.cassandra.hints.HintsDispatcher.dispatch(HintsDispatcher.java:93) 
~[apache-cassandra-3.2.1.jar:3.2.1]
        at 
org.apache.cassandra.hints.HintsDispatchExecutor$DispatchHintsTask.dispatch(HintsDispatchExecutor.java:247)
 ~[apache-cassandra-3.2.1.jar:3.2.1]
        at 
org.apache.cassandra.hints.HintsDispatchExecutor$DispatchHintsTask.dispatch(HintsDispatchExecutor.java:219)
 ~[apache-cassandra-3.2.1.jar:3.2.1]
        at 
org.apache.cassandra.hints.HintsDispatchExecutor$DispatchHintsTask.run(HintsDispatchExecutor.java:198)
 ~[apache-cassandra-3.2.1.jar:3.2.1]
        at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) 
~[na:1.8.0_51]
        at java.util.concurrent.FutureTask.run(FutureTask.java:266) 
~[na:1.8.0_51]
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) 
~[na:1.8.0_51]
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
[na:1.8.0_51]
        at java.lang.Thread.run(Thread.java:745) [na:1.8.0_51]
Caused by: java.lang.InterruptedException: null
        at 
org.apache.cassandra.utils.concurrent.WaitQueue$AbstractSignal.checkInterrupted(WaitQueue.java:313)
 ~[apache-cassandra-3.2.1.jar:3.2.1]
        at 
org.apache.cassandra.utils.concurrent.WaitQueue$AbstractSignal.awaitUntil(WaitQueue.java:301)
 ~[apache-cassandra-3.2.1.jar:3.2.1]
        at 
org.apache.cassandra.utils.concurrent.SimpleCondition.await(SimpleCondition.java:63)
 ~[apache-cassandra-3.2.1.jar:3.2.1]
        at 
org.apache.cassandra.hints.HintsDispatcher$Callback.await(HintsDispatcher.java:201)
 ~[apache-cassandra-3.2.1.jar:3.2.1]
        ... 11 common frames omitted
Unexpected error in node2 log, error: 
ERROR [HintsDispatcher:2] 2016-05-09 23:37:45,816 CassandraDaemon.java:195 - 
Exception in thread Thread[HintsDispatcher:2,1,main]
java.lang.AssertionError: java.lang.InterruptedException
        at 
org.apache.cassandra.hints.HintsDispatcher$Callback.await(HintsDispatcher.java:205)
 ~[apache-cassandra-3.2.1.jar:3.2.1]
        at 
org.apache.cassandra.hints.HintsDispatcher.sendHintsAndAwait(HintsDispatcher.java:146)
 ~[apache-cassandra-3.2.1.jar:3.2.1]
        at 
org.apache.cassandra.hints.HintsDispatcher.dispatch(HintsDispatcher.java:121) 
~[apache-cassandra-3.2.1.jar:3.2.1]
        at 
org.apache.cassandra.hints.HintsDispatcher.dispatch(HintsDispatcher.java:93) 
~[apache-cassandra-3.2.1.jar:3.2.1]
        at 
org.apache.cassandra.hints.HintsDispatchExecutor$DispatchHintsTask.dispatch(HintsDispatchExecutor.java:247)
 ~[apache-cassandra-3.2.1.jar:3.2.1]
        at 
org.apache.cassandra.hints.HintsDispatchExecutor$DispatchHintsTask.dispatch(HintsDispatchExecutor.java:219)
 ~[apache-cassandra-3.2.1.jar:3.2.1]
        at 
org.apache.cassandra.hints.HintsDispatchExecutor$DispatchHintsTask.run(HintsDispatchExecutor.java:198)
 ~[apache-cassandra-3.2.1.jar:3.2.1]
        at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) 
~[na:1.8.0_51]
        at java.util.concurrent.FutureTask.run(FutureTask.java:266) 
~[na:1.8.0_51]
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) 
~[na:1.8.0_51]
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
[na:1.8.0_51]
        at java.lang.Thread.run(Thread.java:745) [na:1.8.0_51]
Caused by: java.lang.InterruptedException: null
        at 
org.apache.cassandra.utils.concurrent.WaitQueue$AbstractSignal.checkInterrupted(WaitQueue.java:313)
 ~[apache-cassandra-3.2.1.jar:3.2.1]
        at 
org.apache.cassandra.utils.concurrent.WaitQueue$AbstractSignal.awaitUntil(WaitQueue.java:301)
 ~[apache-cassandra-3.2.1.jar:3.2.1]
        at 
org.apache.cassandra.utils.concurrent.SimpleCondition.await(SimpleCondition.java:63)
 ~[apache-cassandra-3.2.1.jar:3.2.1]
        at 
org.apache.cassandra.hints.HintsDispatcher$Callback.await(HintsDispatcher.java:201)
 ~[apache-cassandra-3.2.1.jar:3.2.1]
        ... 11 common frames omitted
{noformat}




> InterruptedException in HintsDispatcher
> ---------------------------------------
>
>                 Key: CASSANDRA-11668
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-11668
>             Project: Cassandra
>          Issue Type: Bug
>            Reporter: Russ Hatch
>            Assignee: Russ Hatch
>              Labels: dtest
>
> This exception was seen when trying to repro a test problem. The original 
> issue test problem appears to be a non-issue, but the exception seems like it 
> could be worth investigation.
> This happened on upgrade from 3.2.1 to 3.3 HEAD (a soon to be retired 
> test-case).
> The test does a rolling upgrade where nodes are one by one stopped, upgraded, 
> and started on the new version.
> The exception occurred some time after starting node1 on the upgraded 
> version, and upgrading/starting node2 on the new version. Node2 logged the 
> exception.
> {noformat}
> node2: ERROR [HintsDispatcher:2] 2016-05-09 23:37:45,816 
> CassandraDaemon.java:195 - Exception in thread 
> Thread[HintsDispatcher:2,1,main]
> java.lang.AssertionError: java.lang.InterruptedException
>       at 
> org.apache.cassandra.hints.HintsDispatcher$Callback.await(HintsDispatcher.java:205)
>  ~[apache-cassandra-3.2.1.jar:3.2.1]
>       at 
> org.apache.cassandra.hints.HintsDispatcher.sendHintsAndAwait(HintsDispatcher.java:146)
>  ~[apache-cassandra-3.2.1.jar:3.2.1]
>       at 
> org.apache.cassandra.hints.HintsDispatcher.dispatch(HintsDispatcher.java:121) 
> ~[apache-cassandra-3.2.1.jar:3.2.1]
>       at 
> org.apache.cassandra.hints.HintsDispatcher.dispatch(HintsDispatcher.java:93) 
> ~[apache-cassandra-3.2.1.jar:3.2.1]
>       at 
> org.apache.cassandra.hints.HintsDispatchExecutor$DispatchHintsTask.dispatch(HintsDispatchExecutor.java:247)
>  ~[apache-cassandra-3.2.1.jar:3.2.1]
>       at 
> org.apache.cassandra.hints.HintsDispatchExecutor$DispatchHintsTask.dispatch(HintsDispatchExecutor.java:219)
>  ~[apache-cassandra-3.2.1.jar:3.2.1]
>       at 
> org.apache.cassandra.hints.HintsDispatchExecutor$DispatchHintsTask.run(HintsDispatchExecutor.java:198)
>  ~[apache-cassandra-3.2.1.jar:3.2.1]
>       at 
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) 
> ~[na:1.8.0_51]
>       at java.util.concurrent.FutureTask.run(FutureTask.java:266) 
> ~[na:1.8.0_51]
>       at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>  ~[na:1.8.0_51]
>       at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>  [na:1.8.0_51]
>       at java.lang.Thread.run(Thread.java:745) [na:1.8.0_51]
> Caused by: java.lang.InterruptedException: null
>       at 
> org.apache.cassandra.utils.concurrent.WaitQueue$AbstractSignal.checkInterrupted(WaitQueue.java:313)
>  ~[apache-cassandra-3.2.1.jar:3.2.1]
>       at 
> org.apache.cassandra.utils.concurrent.WaitQueue$AbstractSignal.awaitUntil(WaitQueue.java:301)
>  ~[apache-cassandra-3.2.1.jar:3.2.1]
>       at 
> org.apache.cassandra.utils.concurrent.SimpleCondition.await(SimpleCondition.java:63)
>  ~[apache-cassandra-3.2.1.jar:3.2.1]
>       at 
> org.apache.cassandra.hints.HintsDispatcher$Callback.await(HintsDispatcher.java:201)
>  ~[apache-cassandra-3.2.1.jar:3.2.1]
>       ... 11 common frames omitted
> Unexpected error in node2 log, error: 
> ERROR [HintsDispatcher:2] 2016-05-09 23:37:45,816 CassandraDaemon.java:195 - 
> Exception in thread Thread[HintsDispatcher:2,1,main]
> java.lang.AssertionError: java.lang.InterruptedException
>       at 
> org.apache.cassandra.hints.HintsDispatcher$Callback.await(HintsDispatcher.java:205)
>  ~[apache-cassandra-3.2.1.jar:3.2.1]
>       at 
> org.apache.cassandra.hints.HintsDispatcher.sendHintsAndAwait(HintsDispatcher.java:146)
>  ~[apache-cassandra-3.2.1.jar:3.2.1]
>       at 
> org.apache.cassandra.hints.HintsDispatcher.dispatch(HintsDispatcher.java:121) 
> ~[apache-cassandra-3.2.1.jar:3.2.1]
>       at 
> org.apache.cassandra.hints.HintsDispatcher.dispatch(HintsDispatcher.java:93) 
> ~[apache-cassandra-3.2.1.jar:3.2.1]
>       at 
> org.apache.cassandra.hints.HintsDispatchExecutor$DispatchHintsTask.dispatch(HintsDispatchExecutor.java:247)
>  ~[apache-cassandra-3.2.1.jar:3.2.1]
>       at 
> org.apache.cassandra.hints.HintsDispatchExecutor$DispatchHintsTask.dispatch(HintsDispatchExecutor.java:219)
>  ~[apache-cassandra-3.2.1.jar:3.2.1]
>       at 
> org.apache.cassandra.hints.HintsDispatchExecutor$DispatchHintsTask.run(HintsDispatchExecutor.java:198)
>  ~[apache-cassandra-3.2.1.jar:3.2.1]
>       at 
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) 
> ~[na:1.8.0_51]
>       at java.util.concurrent.FutureTask.run(FutureTask.java:266) 
> ~[na:1.8.0_51]
>       at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>  ~[na:1.8.0_51]
>       at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>  [na:1.8.0_51]
>       at java.lang.Thread.run(Thread.java:745) [na:1.8.0_51]
> Caused by: java.lang.InterruptedException: null
>       at 
> org.apache.cassandra.utils.concurrent.WaitQueue$AbstractSignal.checkInterrupted(WaitQueue.java:313)
>  ~[apache-cassandra-3.2.1.jar:3.2.1]
>       at 
> org.apache.cassandra.utils.concurrent.WaitQueue$AbstractSignal.awaitUntil(WaitQueue.java:301)
>  ~[apache-cassandra-3.2.1.jar:3.2.1]
>       at 
> org.apache.cassandra.utils.concurrent.SimpleCondition.await(SimpleCondition.java:63)
>  ~[apache-cassandra-3.2.1.jar:3.2.1]
>       at 
> org.apache.cassandra.hints.HintsDispatcher$Callback.await(HintsDispatcher.java:201)
>  ~[apache-cassandra-3.2.1.jar:3.2.1]
>       ... 11 common frames omitted
> {noformat}
> CI results can be viewed here: 
> http://cassci.datastax.com/view/Parameterized/job/parameterized_dtest_multiplexer/95/testReport/node_2_iter_001.upgrade_tests.upgrade_through_versions_test/ProtoV4Upgrade_3_2_UpTo_3_3_HEAD/rolling_upgrade_with_internode_ssl_test_2/



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to