[
https://issues.apache.org/jira/browse/CASSANDRA-17081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17437643#comment-17437643
]
David Capwell commented on CASSANDRA-17081:
-------------------------------------------
and of corse I am wrong... failed in CI for the patch in CASSANDRA-17085 (patch
still needed to fix threads); new issue happened which was different than
previous ones... zero-copy-streaming causes the disk failure policy to trigger
on channel close...
{code}
ERROR [Stream-Deserializer-/127.0.0.1:7000-bcd266ec] 2021-11-02 21:49:39,859
DefaultFSErrorHandler.java:104 - Exiting forcefully due to file system
exception on startup, disk failure policy "stop"
org.apache.cassandra.io.FSWriteError: java.nio.channels.ClosedChannelException
at
org.apache.cassandra.io.sstable.format.big.BigTableZeroCopyWriter.write(BigTableZeroCopyWriter.java:227)
at
org.apache.cassandra.io.sstable.format.big.BigTableZeroCopyWriter.writeComponent(BigTableZeroCopyWriter.java:206)
at
org.apache.cassandra.db.streaming.CassandraEntireSSTableStreamReader.read(CassandraEntireSSTableStreamReader.java:125)
at
org.apache.cassandra.db.streaming.CassandraIncomingFile.read(CassandraIncomingFile.java:84)
at
org.apache.cassandra.streaming.messages.IncomingStreamMessage$1.deserialize(IncomingStreamMessage.java:51)
at
org.apache.cassandra.streaming.messages.IncomingStreamMessage$1.deserialize(IncomingStreamMessage.java:37)
at
org.apache.cassandra.streaming.messages.StreamMessage.deserialize(StreamMessage.java:50)
at
org.apache.cassandra.streaming.StreamDeserializingTask.run(StreamDeserializingTask.java:62)
at
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.nio.channels.ClosedChannelException: null
at
org.apache.cassandra.net.AsyncStreamingInputPlus.reBuffer(AsyncStreamingInputPlus.java:136)
at
org.apache.cassandra.net.AsyncStreamingInputPlus.consume(AsyncStreamingInputPlus.java:155)
at
org.apache.cassandra.io.sstable.format.big.BigTableZeroCopyWriter.write(BigTableZeroCopyWriter.java:217)
... 9 common frames omitted
{code}
> Fix test:
> bootstrap_test.py::TestBootstrap::test_bootstrap_with_reset_bootstrap_state
> -------------------------------------------------------------------------------------
>
> Key: CASSANDRA-17081
> URL: https://issues.apache.org/jira/browse/CASSANDRA-17081
> Project: Cassandra
> Issue Type: Bug
> Components: Test/dtest/python
> Reporter: Josh McKenzie
> Assignee: David Capwell
> Priority: Normal
> Fix For: NA
>
> Time Spent: 20m
> Remaining Estimate: 0h
>
> Seeing in circle and locally on trunk:
> Looks like it's timing out waiting for the bootstrap to complete.
> {code:java}
> test_bootstrap_with_reset_bootstrap_state failed (1 runs remaining out of 2).
> <class 'ccmlib.node.TimeoutError'>
> 28 Oct 2021 19:03:53 [node3] after 120.39/120 seconds Missing:
> ['127.0.0.1:7000.* is now UP'] not found in system.log:
> Head: ERROR [Stream-Deserializer-/127.0.0.1:7000-20b885c
> Tail: ...b336de0e72/nb-1-big-Data.db
> ERROR [Stream-Deserializer-/127.0.0.1:7000-29a7cdb5] 2021-10-28 15:01:36,578
> StorageService.java:483 - Stopping gossiper
> [<TracebackEntry
> /Users/jmckenzie/src/cassandra-dtest/bootstrap_test.py:483>
> <TracebackEntry /Users/jmckenzie/src/ccm/ccmlib/node.py:895>
> <TracebackEntry /Users/jmckenzie/src/ccm/ccmlib/node.py:664>
> <TracebackEntry /Users/jmckenzie/src/ccm/ccmlib/node.py:588>
> <TracebackEntry /Users/jmckenzie/src/ccm/ccmlib/node.py:56>]
> test_bootstrap_with_reset_bootstrap_state failed; it passed 0 out of the
> required 1 times.
> <class 'ccmlib.node.TimeoutError'>
> 28 Oct 2021 19:08:23 [node3] after 120.41/120 seconds Missing:
> ['127.0.0.1:7000.* is now UP'] not found in system.log:
> Head:
> Tail: ...
> [<TracebackEntry
> /Users/jmckenzie/src/cassandra-dtest/bootstrap_test.py:483>
> <TracebackEntry /Users/jmckenzie/src/ccm/ccmlib/node.py:895>
> <TracebackEntry /Users/jmckenzie/src/ccm/ccmlib/node.py:664>
> <TracebackEntry /Users/jmckenzie/src/ccm/ccmlib/node.py:588>
> <TracebackEntry /Users/jmckenzie/src/ccm/ccmlib/node.py:56>]
> {code}
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
