[
https://issues.apache.org/jira/browse/CASSANDRA-12249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15386193#comment-15386193
]
Michael Shuler commented on CASSANDRA-12249:
--------------------------------------------
I believe this is a dupe of CASSANDRA-12236, or at least depends on it being
fixed, from the full node2_debug.log error:
{noformat}
INFO [SharedPool-Worker-1] 2016-07-20 04:50:56,533 Gossiper.java:994 -
InetAddress /127.0.0.1 is now UP
DEBUG [SharedPool-Worker-1] 2016-07-20 04:50:56,534 MigrationManager.java:101 -
Submitting migration task for /127.0.0.1
ERROR [MessagingService-Incoming-/127.0.0.1] 2016-07-20 04:50:56,568
CassandraDaemon.java:201 - Exception in thread
Thread[MessagingService-Incoming-/127.0.0.1,5,main]
java.lang.RuntimeException: Unknown column cdc during deserialization
at
org.apache.cassandra.db.Columns$Serializer.deserialize(Columns.java:432)
~[apache-cassandra-3.0.8.jar:3.0.8]
at
org.apache.cassandra.db.SerializationHeader$Serializer.deserializeForMessaging(SerializationHeader.java:427)
~[apache-cassandra-3.0.8.jar:3.0.8]
at
org.apache.cassandra.db.rows.UnfilteredRowIteratorSerializer.deserializeHeader(UnfilteredRowIteratorSerializer.java:190)
~[apache-cassandra-3.0.8.jar:3.0.8]
at
org.apache.cassandra.db.partitions.PartitionUpdate$PartitionUpdateSerializer.deserialize30(PartitionUpdate.java:657)
~[apache-cassandra-3.0.8.jar:3.0.8]
at
org.apache.cassandra.db.partitions.PartitionUpdate$PartitionUpdateSerializer.deserialize(PartitionUpdate.java:645)
~[apache-cassandra-3.0.8.jar:3.0.8]
at
org.apache.cassandra.db.Mutation$MutationSerializer.deserialize(Mutation.java:344)
~[apache-cassandra-3.0.8.jar:3.0.8]
at
org.apache.cassandra.db.Mutation$MutationSerializer.deserialize(Mutation.java:353)
~[apache-cassandra-3.0.8.jar:3.0.8]
at
org.apache.cassandra.service.MigrationManager$MigrationsSerializer.deserialize(MigrationManager.java:609)
~[apache-cassandra-3.0.8.jar:3.0.8]
at
org.apache.cassandra.service.MigrationManager$MigrationsSerializer.deserialize(MigrationManager.java:592)
~[apache-cassandra-3.0.8.jar:3.0.8]
at org.apache.cassandra.net.MessageIn.read(MessageIn.java:98)
~[apache-cassandra-3.0.8.jar:3.0.8]
at
org.apache.cassandra.net.IncomingTcpConnection.receiveMessage(IncomingTcpConnection.java:201)
~[apache-cassandra-3.0.8.jar:3.0.8]
at
org.apache.cassandra.net.IncomingTcpConnection.receiveMessages(IncomingTcpConnection.java:178)
~[apache-cassandra-3.0.8.jar:3.0.8]
at
org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:92)
~[apache-cassandra-3.0.8.jar:3.0.8]
ERROR [MessagingService-Incoming-/127.0.0.1] 2016-07-20 04:50:56,623
CassandraDaemon.java:201 - Exception in thread
Thread[MessagingService-Incoming-/127.0.0.1,5,main]
java.lang.RuntimeException: Unknown column cdc during deserialization
at
org.apache.cassandra.db.Columns$Serializer.deserialize(Columns.java:432)
~[apache-cassandra-3.0.8.jar:3.0.8]
at
org.apache.cassandra.db.SerializationHeader$Serializer.deserializeForMessaging(SerializationHeader.java:427)
~[apache-cassandra-3.0.8.jar:3.0.8]
at
org.apache.cassandra.db.rows.UnfilteredRowIteratorSerializer.deserializeHeader(UnfilteredRowIteratorSerializer.java:190)
~[apache-cassandra-3.0.8.jar:3.0.8]
at
org.apache.cassandra.db.partitions.PartitionUpdate$PartitionUpdateSerializer.deserialize30(PartitionUpdate.java:657)
~[apache-cassandra-3.0.8.jar:3.0.8]
at
org.apache.cassandra.db.partitions.PartitionUpdate$PartitionUpdateSerializer.deserialize(PartitionUpdate.java:645)
~[apache-cassandra-3.0.8.jar:3.0.8]
at
org.apache.cassandra.db.Mutation$MutationSerializer.deserialize(Mutation.java:344)
~[apache-cassandra-3.0.8.jar:3.0.8]
at
org.apache.cassandra.db.Mutation$MutationSerializer.deserialize(Mutation.java:353)
~[apache-cassandra-3.0.8.jar:3.0.8]
at
org.apache.cassandra.service.MigrationManager$MigrationsSerializer.deserialize(MigrationManager.java:609)
~[apache-cassandra-3.0.8.jar:3.0.8]
at
org.apache.cassandra.service.MigrationManager$MigrationsSerializer.deserialize(MigrationManager.java:592)
~[apache-cassandra-3.0.8.jar:3.0.8]
at org.apache.cassandra.net.MessageIn.read(MessageIn.java:98)
~[apache-cassandra-3.0.8.jar:3.0.8]
at
org.apache.cassandra.net.IncomingTcpConnection.receiveMessage(IncomingTcpConnection.java:201)
~[apache-cassandra-3.0.8.jar:3.0.8]
at
org.apache.cassandra.net.IncomingTcpConnection.receiveMessages(IncomingTcpConnection.java:178)
~[apache-cassandra-3.0.8.jar:3.0.8]
at
org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:92)
~[apache-cassandra-3.0.8.jar:3.0.8]
DEBUG [GossipStage:1] 2016-07-20 04:50:57,474 MigrationManager.java:101 -
Submitting migration task for /127.0.0.1
ERROR [MessagingService-Incoming-/127.0.0.1] 2016-07-20 04:50:57,499
CassandraDaemon.java:201 - Exception in thread
Thread[MessagingService-Incoming-/127.0.0.1,5,main]
java.lang.RuntimeException: Unknown column cdc during deserialization
at
org.apache.cassandra.db.Columns$Serializer.deserialize(Columns.java:432)
~[apache-cassandra-3.0.8.jar:3.0.8]
at
org.apache.cassandra.db.SerializationHeader$Serializer.deserializeForMessaging(SerializationHeader.java:427)
~[apache-cassandra-3.0.8.jar:3.0.8]
at
org.apache.cassandra.db.rows.UnfilteredRowIteratorSerializer.deserializeHeader(UnfilteredRowIteratorSerializer.java:190)
~[apache-cassandra-3.0.8.jar:3.0.8]
at
org.apache.cassandra.db.partitions.PartitionUpdate$PartitionUpdateSerializer.deserialize30(PartitionUpdate.java:657)
~[apache-cassandra-3.0.8.jar:3.0.8]
at
org.apache.cassandra.db.partitions.PartitionUpdate$PartitionUpdateSerializer.deserialize(PartitionUpdate.java:645)
~[apache-cassandra-3.0.8.jar:3.0.8]
at
org.apache.cassandra.db.Mutation$MutationSerializer.deserialize(Mutation.java:344)
~[apache-cassandra-3.0.8.jar:3.0.8]
at
org.apache.cassandra.db.Mutation$MutationSerializer.deserialize(Mutation.java:353)
~[apache-cassandra-3.0.8.jar:3.0.8]
at
org.apache.cassandra.service.MigrationManager$MigrationsSerializer.deserialize(MigrationManager.java:609)
~[apache-cassandra-3.0.8.jar:3.0.8]
at
org.apache.cassandra.service.MigrationManager$MigrationsSerializer.deserialize(MigrationManager.java:592)
~[apache-cassandra-3.0.8.jar:3.0.8]
at org.apache.cassandra.net.MessageIn.read(MessageIn.java:98)
~[apache-cassandra-3.0.8.jar:3.0.8]
at
org.apache.cassandra.net.IncomingTcpConnection.receiveMessage(IncomingTcpConnection.java:201)
~[apache-cassandra-3.0.8.jar:3.0.8]
at
org.apache.cassandra.net.IncomingTcpConnection.receiveMessages(IncomingTcpConnection.java:178)
~[apache-cassandra-3.0.8.jar:3.0.8]
at
org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:92)
~[apache-cassandra-3.0.8.jar:3.0.8]
DEBUG [MemtablePostFlush:1] 2016-07-20 04:51:02,569 ColumnFamilyStore.java:898
- forceFlush requested but everything is clean in test
DEBUG [SharedPool-Worker-1] 2016-07-20 04:51:02,573 ColumnFamilyStore.java:2015
- Discarding sstable data for truncated CF + indexes
DEBUG [MemtablePostFlush:1] 2016-07-20 04:51:02,573 ColumnFamilyStore.java:898
- forceFlush requested but everything is clean in test
DEBUG [SharedPool-Worker-1] 2016-07-20 04:51:02,583 ColumnFamilyStore.java:845
- Enqueuing flush of local: 701 (0%) on-heap, 0 (0%) off-heap
DEBUG [MemtableFlushWriter:1] 2016-07-20 04:51:02,584 Memtable.java:353 -
Writing Memtable-local@2136174792(0.122KiB serialized bytes, 8 ops, 0%/0% of
on/off-heap limit)
DEBUG [MemtableFlushWriter:1] 2016-07-20 04:51:02,590 Memtable.java:386 -
Completed flushing
/tmp/dtest-0XJz5q/test/node2/data1/system/local-7ad54392bcdd35a684174e047860b377/mb-14-big-Data.db
(0.086KiB) for commitlog position ReplayPosition(segmentId=1468990226959,
position=82251)
DEBUG [MemtablePostFlush:1] 2016-07-20 04:51:02,631 ColumnFamilyStore.java:898
- forceFlush requested but everything is clean in test2
DEBUG [SharedPool-Worker-1] 2016-07-20 04:51:02,632 ColumnFamilyStore.java:2015
- Discarding sstable data for truncated CF + indexes
DEBUG [MemtablePostFlush:1] 2016-07-20 04:51:02,634 ColumnFamilyStore.java:898
- forceFlush requested but everything is clean in test2
DEBUG [SharedPool-Worker-1] 2016-07-20 04:51:02,636 ColumnFamilyStore.java:845
- Enqueuing flush of local: 477 (0%) on-heap, 0 (0%) off-heap
DEBUG [MemtableFlushWriter:2] 2016-07-20 04:51:02,637 Memtable.java:353 -
Writing Memtable-local@1897345792(0.091KiB serialized bytes, 1 ops, 0%/0% of
on/off-heap limit)
DEBUG [MemtableFlushWriter:2] 2016-07-20 04:51:02,643 Memtable.java:386 -
Completed flushing
/tmp/dtest-0XJz5q/test/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/mb-15-big-Data.db
(0.063KiB) for commitlog position ReplayPosition(segmentId=1468990226959,
position=82572)
ERROR [MessagingService-Incoming-/127.0.0.1] 2016-07-20 04:51:02,836
CassandraDaemon.java:201 - Exception in thread
Thread[MessagingService-Incoming-/127.0.0.1,5,main]
java.lang.AssertionError: null
at
org.apache.cassandra.db.ReadCommand$LegacyPagedRangeCommandSerializer.deserialize(ReadCommand.java:1042)
~[apache-cassandra-3.0.8.jar:3.0.8]
at
org.apache.cassandra.db.ReadCommand$LegacyPagedRangeCommandSerializer.deserialize(ReadCommand.java:964)
~[apache-cassandra-3.0.8.jar:3.0.8]
at org.apache.cassandra.net.MessageIn.read(MessageIn.java:98)
~[apache-cassandra-3.0.8.jar:3.0.8]
at
org.apache.cassandra.net.IncomingTcpConnection.receiveMessage(IncomingTcpConnection.java:201)
~[apache-cassandra-3.0.8.jar:3.0.8]
at
org.apache.cassandra.net.IncomingTcpConnection.receiveMessages(IncomingTcpConnection.java:178)
~[apache-cassandra-3.0.8.jar:3.0.8]
at
org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:92)
~[apache-cassandra-3.0.8.jar:3.0.8]
ERROR [MessagingService-Incoming-/127.0.0.1] 2016-07-20 04:51:32,857
CassandraDaemon.java:201 - Exception in thread
Thread[MessagingService-Incoming-/127.0.0.1,5,main]
java.lang.AssertionError: null
at
org.apache.cassandra.db.ReadCommand$LegacyPagedRangeCommandSerializer.deserialize(ReadCommand.java:1042)
~[apache-cassandra-3.0.8.jar:3.0.8]
at
org.apache.cassandra.db.ReadCommand$LegacyPagedRangeCommandSerializer.deserialize(ReadCommand.java:964)
~[apache-cassandra-3.0.8.jar:3.0.8]
at org.apache.cassandra.net.MessageIn.read(MessageIn.java:98)
~[apache-cassandra-3.0.8.jar:3.0.8]
at
org.apache.cassandra.net.IncomingTcpConnection.receiveMessage(IncomingTcpConnection.java:201)
~[apache-cassandra-3.0.8.jar:3.0.8]
at
org.apache.cassandra.net.IncomingTcpConnection.receiveMessages(IncomingTcpConnection.java:178)
~[apache-cassandra-3.0.8.jar:3.0.8]
at
org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:92)
~[apache-cassandra-3.0.8.jar:3.0.8]
{noformat}
> dtest failure in
> upgrade_tests.paging_test.TestPagingDataNodes3RF3_Upgrade_current_3_0_x_To_indev_3_x.basic_paging_test
> -----------------------------------------------------------------------------------------------------------------------
>
> Key: CASSANDRA-12249
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12249
> Project: Cassandra
> Issue Type: Bug
> Reporter: Philip Thompson
> Assignee: Tyler Hobbs
> Labels: dtest
> Fix For: 3.x
>
> Attachments: node1.log, node1_debug.log, node1_gc.log, node2.log,
> node2_debug.log, node2_gc.log
>
>
> example failure:
> http://cassci.datastax.com/job/cassandra-3.8_dtest_upgrade/1/testReport/upgrade_tests.paging_test/TestPagingDataNodes3RF3_Upgrade_current_3_0_x_To_indev_3_x/basic_paging_test
> Failed on CassCI build cassandra-3.8_dtest_upgrade #1
> This is on a mixed version cluster, one node is 3.0.8 and the other is
> 3.8-tentative.
> Stack trace looks like:
> {code}
> ERROR [MessagingService-Incoming-/127.0.0.1] 2016-07-20 04:51:02,836
> CassandraDaemon.java:201 - Exception in thread
> Thread[MessagingService-Incoming-/127.0.0.1,5,main]
> java.lang.AssertionError: null
> at
> org.apache.cassandra.db.ReadCommand$LegacyPagedRangeCommandSerializer.deserialize(ReadCommand.java:1042)
> ~[apache-cassandra-3.0.8.jar:3.0.8]
> at
> org.apache.cassandra.db.ReadCommand$LegacyPagedRangeCommandSerializer.deserialize(ReadCommand.java:964)
> ~[apache-cassandra-3.0.8.jar:3.0.8]
> at org.apache.cassandra.net.MessageIn.read(MessageIn.java:98)
> ~[apache-cassandra-3.0.8.jar:3.0.8]
> at
> org.apache.cassandra.net.IncomingTcpConnection.receiveMessage(IncomingTcpConnection.java:201)
> ~[apache-cassandra-3.0.8.jar:3.0.8]
> at
> org.apache.cassandra.net.IncomingTcpConnection.receiveMessages(IncomingTcpConnection.java:178)
> ~[apache-cassandra-3.0.8.jar:3.0.8]
> at
> org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:92)
> ~[apache-cassandra-3.0.8.jar:3.0.8]
> {code}
> This trace is from the 3.0.8 node.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
