[
https://issues.apache.org/jira/browse/CASSANDRA-2968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13073513#comment-13073513
]
Andriy Denysenko edited comment on CASSANDRA-2968 at 8/1/11 12:39 PM:
----------------------------------------------------------------------
no, I was wrong, compaction is not the culprit
I ran nodetool flush and produced 3 new small sstables - strangely they are all
numbered with odd numbers only 153 155 157 - but the point is a freshly made
sstable with only 8 rows is already unreadable by compaction/scrub.
Maybe header in counter binary value is not written or what...
{code}
{
"0000000000cc71a4":
[["clicks","000100002335e4a0b2c911e000006bb62b336af700000000000000010000000000000001",1312201208019,"c",-9223372036854775808]],
"0000000000748b45":
[["clicks","000100002335e4a0b2c911e000006bb62b336af7000000000000009f000000000000009f23d44780b2c911e00000f03fd2ec87ffa6cd8bac6eb8a32d2fd3c2059ade464925188750b2c911e0000058b7809d76ff9a8b961aed94ef799a8b961aed94ef79",1312201220709,"c",-9223372036854775808]],
"00000000010a4465":
[["clicks","00002335e4a0b2c911e000006bb62b336af700000000000045ad00000000000045ad23d44780b2c911e00000f03fd2ec87ff0000000000004bfd0000000001fae30325188750b2c911e0000058b7809d76ff000000000000038f000000000000038f",1312201219737,"c",-9223372036854775808]],
"0000000001319592":
[["clicks","000100002335e4a0b2c911e000006bb62b336af70000000000000001000000000000000123d44780b2c911e00000f03fd2ec87ffdf1636876c1c1bc2df1636876c1c1bc225188750b2c911e0000058b7809d76ff0876b1020dc02ac97f12b88d9f9df751",1312201215475,"c",-9223372036854775808]],
"0000000001b9a53e":
[["clicks","000100002335e4a0b2c911e000006bb62b336af700000000000000010000000000000001",1312201202338,"c",-9223372036854775808]],
"00000000004dd84f":
[["clicks","000100002335e4a0b2c911e000006bb62b336af70000000000000001000000000000000123d44780b2c911e00000f03fd2ec87ff000000000017d1550000000059fb2ad925188750b2c911e0000058b7809d76ff00000000000173bf00000000000173bf",1312201205636,"c",-9223372036854775808]],
"0000000000d1d52f":
[["clicks","000100002335e4a0b2c911e000006bb62b336af700000000000000020000000000000002",1312201210515,"c",-9223372036854775808]],
"0000000001410d4a":
[["clicks","000100002335e4a0b2c911e000006bb62b336af700000000000000010000000000000001",1312201220365,"c",-9223372036854775808]]
}
{code}
was (Author: andrden):
no, I was wrong, compaction is not the culprit
I ran nodetool flush and produced 3 new small sstables - strangely they are all
numbered with odd numbers only 153 155 157 - but the point is a freshly made
sstable with only 8 rows is already unreadable by compaction/scrub.
Maybe header in counter binary value is not written or what...
{
"0000000000cc71a4":
[["clicks","000100002335e4a0b2c911e000006bb62b336af700000000000000010000000000000001",1312201208019,"c",-9223372036854775808]],
"0000000000748b45":
[["clicks","000100002335e4a0b2c911e000006bb62b336af7000000000000009f000000000000009f23d44780b2c911e00000f03fd2ec87ffa6cd8bac6eb8a32d2fd3c2059ade464925188750b2c911e0000058b7809d76ff9a8b961aed94ef799a8b961aed94ef79",1312201220709,"c",-9223372036854775808]],
"00000000010a4465":
[["clicks","00002335e4a0b2c911e000006bb62b336af700000000000045ad00000000000045ad23d44780b2c911e00000f03fd2ec87ff0000000000004bfd0000000001fae30325188750b2c911e0000058b7809d76ff000000000000038f000000000000038f",1312201219737,"c",-9223372036854775808]],
"0000000001319592":
[["clicks","000100002335e4a0b2c911e000006bb62b336af70000000000000001000000000000000123d44780b2c911e00000f03fd2ec87ffdf1636876c1c1bc2df1636876c1c1bc225188750b2c911e0000058b7809d76ff0876b1020dc02ac97f12b88d9f9df751",1312201215475,"c",-9223372036854775808]],
"0000000001b9a53e":
[["clicks","000100002335e4a0b2c911e000006bb62b336af700000000000000010000000000000001",1312201202338,"c",-9223372036854775808]],
"00000000004dd84f":
[["clicks","000100002335e4a0b2c911e000006bb62b336af70000000000000001000000000000000123d44780b2c911e00000f03fd2ec87ff000000000017d1550000000059fb2ad925188750b2c911e0000058b7809d76ff00000000000173bf00000000000173bf",1312201205636,"c",-9223372036854775808]],
"0000000000d1d52f":
[["clicks","000100002335e4a0b2c911e000006bb62b336af700000000000000020000000000000002",1312201210515,"c",-9223372036854775808]],
"0000000001410d4a":
[["clicks","000100002335e4a0b2c911e000006bb62b336af700000000000000010000000000000001",1312201220365,"c",-9223372036854775808]]
}
> AssertionError during compaction of CF with counter columns
> -----------------------------------------------------------
>
> Key: CASSANDRA-2968
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2968
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 0.8.2
> Environment: CentOS release 5.6
> Reporter: Taras Puchko
> Assignee: Sylvain Lebresne
> Fix For: 0.8.3
>
> Attachments: AffiliateActivity-g-147-Data.db,
> AffiliateActivity-g-147-Index.db, AffiliateActivity-g-195-Data.db,
> AffiliateActivity-g-195-Index.db
>
>
> Having upgraded from 0.8.0 to 0.8.2 we ran nodetool compact and got
> Error occured during compaction
> java.util.concurrent.ExecutionException: java.lang.AssertionError
> at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:222)
> at java.util.concurrent.FutureTask.get(FutureTask.java:83)
> at
> org.apache.cassandra.db.compaction.CompactionManager.performMajor(CompactionManager.java:277)
> at
> org.apache.cassandra.db.ColumnFamilyStore.forceMajorCompaction(ColumnFamilyStore.java:1762)
> at
> org.apache.cassandra.service.StorageService.forceTableCompaction(StorageService.java:1358)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at
> com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:93)
> at
> com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:27)
> at
> com.sun.jmx.mbeanserver.MBeanIntrospector.invokeM(MBeanIntrospector.java:208)
> at com.sun.jmx.mbeanserver.PerInterface.invoke(PerInterface.java:120)
> at com.sun.jmx.mbeanserver.MBeanSupport.invoke(MBeanSupport.java:262)
> at
> com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.invoke(DefaultMBeanServerInterceptor.java:836)
> at
> com.sun.jmx.mbeanserver.JmxMBeanServer.invoke(JmxMBeanServer.java:761)
> at
> javax.management.remote.rmi.RMIConnectionImpl.doOperation(RMIConnectionImpl.java:1427)
> at
> javax.management.remote.rmi.RMIConnectionImpl.access$200(RMIConnectionImpl.java:72)
> at
> javax.management.remote.rmi.RMIConnectionImpl$PrivilegedOperation.run(RMIConnectionImpl.java:1265)
> at
> javax.management.remote.rmi.RMIConnectionImpl.doPrivilegedOperation(RMIConnectionImpl.java:1360)
> at
> javax.management.remote.rmi.RMIConnectionImpl.invoke(RMIConnectionImpl.java:788)
> at sun.reflect.GeneratedMethodAccessor24.invoke(Unknown Source)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:305)
> at sun.rmi.transport.Transport$1.run(Transport.java:159)
> at java.security.AccessController.doPrivileged(Native Method)
> at sun.rmi.transport.Transport.serviceCall(Transport.java:155)
> at
> sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:535)
> at
> sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:790)
> at
> sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:649)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:662)
> Caused by: java.lang.AssertionError
>
>
>
> at
> org.apache.cassandra.db.context.CounterContext.removeOldShards(CounterContext.java:593)
>
>
> at
> org.apache.cassandra.db.CounterColumn.removeOldShards(CounterColumn.java:237)
>
>
> at
> org.apache.cassandra.db.CounterColumn.removeOldShards(CounterColumn.java:256)
>
>
> at
> org.apache.cassandra.db.compaction.PrecompactedRow.<init>(PrecompactedRow.java:88)
>
>
> at
> org.apache.cassandra.db.compaction.CompactionController.getCompactedRow(CompactionController.java:140)
>
>
> at
> org.apache.cassandra.db.compaction.CompactionIterator.getReduced(CompactionIterator.java:123)
>
>
> at
> org.apache.cassandra.db.compaction.CompactionIterator.getReduced(CompactionIterator.java:43)
>
>
> at
> org.apache.cassandra.utils.ReducingIterator.computeNext(ReducingIterator.java:74)
>
>
> at
> com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:140)
>
>
> at
> com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:135)
>
>
> at
> org.apache.commons.collections.iterators.FilterIterator.setNextObject(FilterIterator.java:183)
>
>
> at
> org.apache.commons.collections.iterators.FilterIterator.hasNext(FilterIterator.java:94)
>
>
> at
> org.apache.cassandra.db.compaction.CompactionManager.doCompactionWithoutSizeEstimation(CompactionManager.java:569)
>
>
> at
> org.apache.cassandra.db.compaction.CompactionManager.doCompaction(CompactionManager.java:506)
>
>
> at
> org.apache.cassandra.db.compaction.CompactionManager$4.call(CompactionManager.java:319)
>
>
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
>
>
>
> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
>
>
>
> ... 3 more
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
