I'm also having "AssertionError"s.
ERROR [ReadStage:51687] 2012-09-10 14:33:54,211 AbstractCassandraDaemon.java
(line 134) Exception in thread Thread[ReadStage:51687,5,main]
java.io.IOError: java.io.EOFException
at
org.apache.cassandra.db.columniterator.SSTableSliceIterator.<init>(SSTableSliceIterator.java:64)
at
org.apache.cassandra.db.filter.SliceQueryFilter.getSSTableColumnIterator(SliceQueryFilter.java:66)
at
org.apache.cassandra.db.filter.QueryFilter.getSSTableColumnIterator(QueryFilter.java:78)
at
org.apache.cassandra.db.CollationController.collectAllData(CollationController.java:256)
at
org.apache.cassandra.db.CollationController.getTopLevelColumns(CollationController.java:63)
at
org.apache.cassandra.db.ColumnFamilyStore.getTopLevelColumns(ColumnFamilyStore.java:1345)
at
org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore.java:1207)
at
org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore.java:1142)
at org.apache.cassandra.db.Table.getRow(Table.java:378)
at
org.apache.cassandra.db.SliceFromReadCommand.getRow(SliceFromReadCommand.java:69)
at
org.apache.cassandra.service.StorageProxy$LocalReadRunnable.runMayThrow(StorageProxy.java:816)
at
org.apache.cassandra.service.StorageProxy$DroppableRunnable.run(StorageProxy.java:1250)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
Caused by: java.io.EOFException
at java.io.RandomAccessFile.readFully(RandomAccessFile.java:399)
at java.io.RandomAccessFile.readFully(RandomAccessFile.java:377)
at
org.apache.cassandra.io.util.RandomAccessReader.readBytes(RandomAccessReader.java:324)
at
org.apache.cassandra.utils.ByteBufferUtil.read(ByteBufferUtil.java:398)
at
org.apache.cassandra.utils.ByteBufferUtil.readWithShortLength(ByteBufferUtil.java:380)
at
org.apache.cassandra.db.columniterator.SSTableSliceIterator.<init>(SSTableSliceIterator.java:54)
... 14 more
ERROR [ReadStage:51801] 2012-09-10 14:44:38,852 AbstractCassandraDaemon.java
(line 134) Exception in thread Thread[ReadStage:51801,5,main]
java.lang.AssertionError: DecoratedKey(12064825934064381804725403203980154559,
0bc7e1c5800000001170726573656e746174696f6e5f707074200017696d6167652f782d706f727461626c652d7069786d617000000000000000420000001000000003000000010000020000400008000000007fffffff800000000000000000000001000469636f6e000004c90f4f65275600000007554e4b4e4f574e000a746578742f782d74657800000000000000420000001000000003000000010000020000400008000000007fffffff800000000000000000000001000469636f6e000004c90f8a0b80ac00000007554e4b4e4f574e00466170706c69636174696f6e2f766e642e6f70656e786d6c666f726d6174732d6f6666696365646f63756d656e742e70726573656e746174696f6e6d6c2e736c69646573686f77000000000000004c0000001000000003000000010000020000400008000000007fffffff800000000000000000000001000469636f6e000004c90bc7e19a880000001170726573656e746174696f6e5f70707320000a746578742f782d632b2b00000000000000420000001000000003000000010000020000400008000000007fffffff800000000000000000000001000469636f6e000004c90f4e902aaa00000007554e4b4e4f574e000c696d6167652f782d78706d6900000000000000420000001000000003000000010000020000400008000000007fffffff800000000000000000000001000469636f6e000004c90f4b8360f200000007554e4b4e4f574e0013696d6167652f782d77696e646f77732d626d7000000000000000440000001000000003000000010000020000400008000000007fffffff800000000000000000000001000469636f6e000004c90bc7de896000000009696d6167655f626d7000156170706c69636174696f6e2f782d646f736578656300000000000000490000001000000003000000010000020000400008000000007fffffff800000000000000000000001000469636f6e000004c90bc7dd97300000000e61706c69636174696f6e5f6578650009766964656f2f64766400000000000000430000001000000003000000010000020000400008000000007fffffff800000000000000000000001000469636f6e000004c90bc7e0759000000008746578745f766f620008746578742f63737300000000000000430000001000000003000000010000020000400008000000007fffffff800000000000000000000001000469636f6e000004c90bc7e07d6000000008746578745f637373001d6170706c69636174696f6e2f782d73686f636b776176652d666c61736800000000000000440000001000000003000000010000020000400008000000007fffffff800000000000000000000001000469636f6e000004c90bc7deb07000000009766964656f5f737766000a746578742f782d61776b00000000000000420000001000000003000000010000020000400008000000007fffffff800000000000000000000001000469636f6e000004c9117d73ced500000007554e4b4e4f574e00186170706c69636174696f6e2f766e642e6d732d657863656c00000000000000430000001000000003000000010000020000400008000000007fffffff800000000000000000000001000469636f6e000004c90bc7df19e800000008746578745f786c73000f766964656f2f717569636b74696d6500)
!= DecoratedKey(121031529647353036275964125031804748412,
6170706c69636174696f6e2f7a6970) in
/var/lib/cassandra/data/Disco/MimeType/Disco-MimeType-he-1-Data.db
at
org.apache.cassandra.db.columniterator.SSTableSliceIterator.<init>(SSTableSliceIterator.java:58)
at
org.apache.cassandra.db.filter.SliceQueryFilter.getSSTableColumnIterator(SliceQueryFilter.java:66)
at
org.apache.cassandra.db.filter.QueryFilter.getSSTableColumnIterator(QueryFilter.java:78)
at
org.apache.cassandra.db.CollationController.collectAllData(CollationController.java:256)
at
org.apache.cassandra.db.CollationController.getTopLevelColumns(CollationController.java:63)
at
org.apache.cassandra.db.ColumnFamilyStore.getTopLevelColumns(ColumnFamilyStore.java:1345)
at
org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore.java:1207)
at
org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore.java:1142)
at org.apache.cassandra.db.Table.getRow(Table.java:378)
at
org.apache.cassandra.db.SliceFromReadCommand.getRow(SliceFromReadCommand.java:69)
at
org.apache.cassandra.service.StorageProxy$LocalReadRunnable.runMayThrow(StorageProxy.java:816)
at
org.apache.cassandra.service.StorageProxy$DroppableRunnable.run(StorageProxy.java:1250)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
Some gets to this CF never returned, it looks like it was corrupted somehow.
This only stopped after I truncated it and re-populated it. Fortunately we're
still in testing phase...
Cassandra 1.1.4
André
On Sep 11, 2012, at 1:29 AM, Radim Kolar <h...@filez.com> wrote:
> this is first version from 1.1 branch i used in pre-production stress testing
> and i got lot of following errors: decorated key -1 != some number
>
> INFO [CompactionExecutor:10] 2012-09-11 02:22:13,586
> CompactionController.java (line 172) Compacting large row
> system/HintsColumnFamily:67fd0f04ca3294558142a5b33a30f6f5 (241502947 bytes)
> incrementally
> ERROR [ReadStage:44] 2012-09-11 02:22:13,992 AbstractCassandraDaemon.java
> (line 135) Exception in thread Thread[ReadStage:44,5,main]
> java.lang.AssertionError: DecoratedKey(-1, ) !=
> DecoratedKey(133375303318769338050543368330356089660, 0000ad4f) in
> c:\cassandra\data\test\sipdb\test-sipdb-he-5-Data.db
> at
> org.apache.cassandra.db.columniterator.SSTableNamesIterator.<init>(SSTableNamesIterator.java:72)
> at
> org.apache.cassandra.db.filter.NamesQueryFilter.getSSTableColumnIterator(NamesQueryFilter.java:61)
> at
> org.apache.cassandra.db.filter.QueryFilter.getSSTableColumnIterator(QueryFilter.java:79)
> at
> org.apache.cassandra.db.CollationController.collectTimeOrderedData(CollationController.java:124)
> at
> org.apache.cassandra.db.CollationController.getTopLevelColumns(CollationController.java:64)
> at
> org.apache.cassandra.db.ColumnFamilyStore.getTopLevelColumns(ColumnFamilyStore.java:1345)
>
