Michał Matłoka created CASSANDRA-11287:
------------------------------------------
Summary: Node Bootstrap fails due to Streaming error
Key: CASSANDRA-11287
URL: https://issues.apache.org/jira/browse/CASSANDRA-11287
Project: Cassandra
Issue Type: Bug
Environment: Cassandra 3.3
Reporter: Michał Matłoka
I am trying to bootstrap a node, in its logs I get the following errors
{code}
ERROR [STREAM-IN-/10.10.10.3] 2016-03-01 08:16:33,006 StreamSession.java:520 -
[Stream #866ffb60-df7d-11e5-a235-6562056da4d2] Streaming error occurred
java.io.EOFException: null
at java.io.DataInputStream.readFully(DataInputStream.java:197)
~[na:1.8.0_72]
at java.io.DataInputStream.readLong(DataInputStream.java:416)
~[na:1.8.0_72]
at
org.apache.cassandra.io.compress.CompressionMetadata$ChunkSerializer.deserialize(CompressionMetadata.java:513)
~[apache-cassandra-3.3.0.jar:3.3.0]
at
org.apache.cassandra.io.compress.CompressionMetadata$ChunkSerializer.deserialize(CompressionMetadata.java:503)
~[apache-cassandra-3.3.0.jar:3.3.0]
at
org.apache.cassandra.streaming.compress.CompressionInfo$CompressionInfoSerializer.deserialize(CompressionInfo.java:73)
~[apache-cassandra-3.3.0.jar:3.3.0]
at
org.apache.cassandra.streaming.compress.CompressionInfo$CompressionInfoSerializer.deserialize(CompressionInfo.java:46)
~[apache-cassandra-3.3.0.jar:3.3.0]
at
org.apache.cassandra.streaming.messages.FileMessageHeader$FileMessageHeaderSerializer.deserialize(FileMessageHeader.java:227)
~[apache-cassandra-3.3.0.jar:3.3.0]
at
org.apache.cassandra.streaming.messages.IncomingFileMessage$1.deserialize(IncomingFileMessage.java:44)
~[apache-cassandra-3.3.0.jar:3.3.0]
at
org.apache.cassandra.streaming.messages.IncomingFileMessage$1.deserialize(IncomingFileMessage.java:39)
~[apache-cassandra-3.3.0.jar:3.3.0]
at
org.apache.cassandra.streaming.messages.StreamMessage.deserialize(StreamMessage.java:59)
~[apache-cassandra-3.3.0.jar:3.3.0]
at
org.apache.cassandra.streaming.ConnectionHandler$IncomingMessageHandler.run(ConnectionHandler.java:261)
~[apache-cassandra-3.3.0.jar:3.3.0]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_72]
ERROR [STREAM-OUT-/10.10.10.3] 2016-03-01 08:16:33,007 StreamSession.java:520 -
[Stream #866ffb60-df7d-11e5-a235-6562056da4d2] Streaming error occurred
java.io.IOException: Broken pipe
at sun.nio.ch.FileDispatcherImpl.write0(Native Method) ~[na:1.8.0_72]
at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47)
~[na:1.8.0_72]
at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
~[na:1.8.0_72]
at sun.nio.ch.IOUtil.write(IOUtil.java:51) ~[na:1.8.0_72]
at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:471)
~[na:1.8.0_72]
at
org.apache.cassandra.io.util.BufferedDataOutputStreamPlus.doFlush(BufferedDataOutputStreamPlus.java:323)
~[apache-cassandra-3.3.0.jar:3.3.0]
at
org.apache.cassandra.io.util.BufferedDataOutputStreamPlus.flush(BufferedDataOutputStreamPlus.java:331)
~[apache-cassandra-3.3.0.jar:3.3.0]
at
org.apache.cassandra.streaming.ConnectionHandler$OutgoingMessageHandler.sendMessage(ConnectionHandler.java:364)
[apache-cassandra-3.3.0.jar:3.3.0]
at
org.apache.cassandra.streaming.ConnectionHandler$OutgoingMessageHandler.run(ConnectionHandler.java:335)
[apache-cassandra-3.3.0.jar:3.3.0]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_72]
INFO [STREAM-OUT-/10.10.10.3] 2016-03-01 08:16:33,019
StreamResultFuture.java:185 - [Stream #866ffb60-df7d-11e5-a235-6562056da4d2]
Session with /10.10.10.3 is complete
ERROR [STREAM-OUT-/10.10.10.3] 2016-03-01 08:16:33,020 StreamSession.java:520 -
[Stream #866ffb60-df7d-11e5-a235-6562056da4d2] Streaming error occurred
java.io.IOException: Broken pipe
at sun.nio.ch.FileDispatcherImpl.write0(Native Method) ~[na:1.8.0_72]
at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47)
~[na:1.8.0_72]
at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
~[na:1.8.0_72]
at sun.nio.ch.IOUtil.write(IOUtil.java:51) ~[na:1.8.0_72]
at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:471)
~[na:1.8.0_72]
at
org.apache.cassandra.io.util.BufferedDataOutputStreamPlus.doFlush(BufferedDataOutputStreamPlus.java:323)
~[apache-cassandra-3.3.0.jar:3.3.0]
at
org.apache.cassandra.io.util.BufferedDataOutputStreamPlus.flush(BufferedDataOutputStreamPlus.java:331)
~[apache-cassandra-3.3.0.jar:3.3.0]
at
org.apache.cassandra.streaming.ConnectionHandler$OutgoingMessageHandler.sendMessage(ConnectionHandler.java:364)
[apache-cassandra-3.3.0.jar:3.3.0]
at
org.apache.cassandra.streaming.ConnectionHandler$OutgoingMessageHandler.run(ConnectionHandler.java:343)
[apache-cassandra-3.3.0.jar:3.3.0]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_72]
{code}
on source node
{code}
INFO [STREAM-IN-/10.10.10.5] 2016-03-01 08:34:59,057
StreamResultFuture.java:171 - [Stream #19bddf70-df80-11e5-a235-6562056da4d2
ID#0] Prepare completed. Receiving 0 files(0 bytes), sending 102
files(276993164542 bytes)
ERROR [STREAM-OUT-/10.10.10.5] 2016-03-01 08:34:59,185 StreamSession.java:520 -
[Stream #19bddf70-df80-11e5-a235-6562056da4d2] Streaming error occurred
java.lang.NullPointerException: null
at
org.apache.cassandra.db.SerializationHeader$Component.access$500(SerializationHeader.java:283)
~[apache-cassandra-3.3.0.jar:3.3.0]
at
org.apache.cassandra.db.SerializationHeader$Serializer.serialize(SerializationHeader.java:430)
~[apache-cassandra-3.3.0.jar:3.3.0]
at
org.apache.cassandra.streaming.messages.FileMessageHeader$FileMessageHeaderSerializer.serialize(FileMessageHeader.java:208)
~[apache-cassandra-3.3.0.jar:3.3.0]
at
org.apache.cassandra.streaming.messages.OutgoingFileMessage.serialize(OutgoingFileMessage.java:84)
~[apache-cassandra-3.3.0.jar:3.3.0]
at
org.apache.cassandra.streaming.messages.OutgoingFileMessage$1.serialize(OutgoingFileMessage.java:48)
~[apache-cassandra-3.3.0.jar:3.3.0]
at
org.apache.cassandra.streaming.messages.OutgoingFileMessage$1.serialize(OutgoingFileMessage.java:40)
~[apache-cassandra-3.3.0.jar:3.3.0]
at
org.apache.cassandra.streaming.messages.StreamMessage.serialize(StreamMessage.java:48)
~[apache-cassandra-3.3.0.jar:3.3.0]
at
org.apache.cassandra.streaming.ConnectionHandler$OutgoingMessageHandler.sendMessage(ConnectionHandler.java:363)
~[apache-cassandra-3.3.0.jar:3.3.0]
at
org.apache.cassandra.streaming.ConnectionHandler$OutgoingMessageHandler.run(ConnectionHandler.java:335)
~[apache-cassandra-3.3.0.jar:3.3.0]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_66]
INFO [STREAM-OUT-/10.10.10.5] 2016-03-01 08:34:59,186
StreamResultFuture.java:185 - [Stream #19bddf70-df80-11e5-a235-6562056da4d2]
Session with /10.10.10.5 is complete
WARN [STREAM-OUT-/10.10.10.5] 2016-03-01 08:34:59,186
StreamResultFuture.java:212 - [Stream #19bddf70-df80-11e5-a235-6562056da4d2]
Stream failed
{code}
All nodes have Cassandra 3.3.
Note: source node is doing an sstable upgrade.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
