[
https://issues.apache.org/jira/browse/CASSANDRA-15669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17354230#comment-17354230
]
Yifan Cai edited comment on CASSANDRA-15669 at 5/31/21, 6:07 PM:
-----------------------------------------------------------------
Starting commit
CI Results:
||Branch||Source||Circle CI||Jenkins||
|cassandra-3.11|[branch|https://github.com/yifan-c/cassandra/tree/commit_remote_branch/CASSANDRA-15669-cassandra-3.11-8248B4BC-5657-41EF-83A0-13827185AB7E]|[build|https://app.circleci.com/pipelines/github/yifan-c/cassandra?branch=commit_remote_branch%2FCASSANDRA-15669-cassandra-3.11-8248B4BC-5657-41EF-83A0-13827185AB7E]|[build|https://ci-cassandra.apache.org/blue/organizations/jenkins/Cassandra-devbranch/detail/Cassandra-devbranch/821/pipeline]|
|cassandra-4.0|[branch|https://github.com/yifan-c/cassandra/tree/commit_remote_branch/CASSANDRA-15669-cassandra-4.0-8248B4BC-5657-41EF-83A0-13827185AB7E]|[build|https://app.circleci.com/pipelines/github/yifan-c/cassandra?branch=commit_remote_branch%2FCASSANDRA-15669-cassandra-4.0-8248B4BC-5657-41EF-83A0-13827185AB7E]|[build|https://ci-cassandra.apache.org/blue/organizations/jenkins/Cassandra-devbranch/detail/Cassandra-devbranch/818/pipeline]|
|trunk|[branch|https://github.com/yifan-c/cassandra/tree/commit_remote_branch/CASSANDRA-15669-trunk-8248B4BC-5657-41EF-83A0-13827185AB7E]|[build|https://app.circleci.com/pipelines/github/yifan-c/cassandra?branch=commit_remote_branch%2FCASSANDRA-15669-trunk-8248B4BC-5657-41EF-83A0-13827185AB7E]|[build|https://ci-cassandra.apache.org/blue/organizations/jenkins/Cassandra-devbranch/detail/Cassandra-devbranch/820/pipeline]|
-- edit 05/31 --
Results look green.
3.11 CI results looks good. Failures do not look related.
4.0 and trunk CI results mostly are good, except the test failure ("Got
unexpected overlap in level X") from {{stressTestCompactionStrategyManager –
org.apache.cassandra.db.compaction.LongLeveledCompactionStrategyCQLTest}} that
looks suspicious. There is a ticket for it already, CASSANDRA-16637. So it
should not be caused by this patch.
was (Author: yifanc):
Starting commit
CI Results (pending):
|| Branch || Source || Circle CI || Jenkins ||
|cassandra-3.11|[branch|https://github.com/yifan-c/cassandra/tree/commit_remote_branch/CASSANDRA-15669-cassandra-3.11-8248B4BC-5657-41EF-83A0-13827185AB7E]|[build|https://app.circleci.com/pipelines/github/yifan-c/cassandra?branch=commit_remote_branch%2FCASSANDRA-15669-cassandra-3.11-8248B4BC-5657-41EF-83A0-13827185AB7E]|[build|https://ci-cassandra.apache.org/blue/organizations/jenkins/Cassandra-devbranch/detail/Cassandra-devbranch/821/pipeline]|
|cassandra-4.0|[branch|https://github.com/yifan-c/cassandra/tree/commit_remote_branch/CASSANDRA-15669-cassandra-4.0-8248B4BC-5657-41EF-83A0-13827185AB7E]|[build|https://app.circleci.com/pipelines/github/yifan-c/cassandra?branch=commit_remote_branch%2FCASSANDRA-15669-cassandra-4.0-8248B4BC-5657-41EF-83A0-13827185AB7E]|[build|https://ci-cassandra.apache.org/blue/organizations/jenkins/Cassandra-devbranch/detail/Cassandra-devbranch/818/pipeline]|
|trunk|[branch|https://github.com/yifan-c/cassandra/tree/commit_remote_branch/CASSANDRA-15669-trunk-8248B4BC-5657-41EF-83A0-13827185AB7E]|[build|https://app.circleci.com/pipelines/github/yifan-c/cassandra?branch=commit_remote_branch%2FCASSANDRA-15669-trunk-8248B4BC-5657-41EF-83A0-13827185AB7E]|[build|https://ci-cassandra.apache.org/blue/organizations/jenkins/Cassandra-devbranch/detail/Cassandra-devbranch/820/pipeline]|
> LeveledCompactionStrategy compact last level throw an
> ArrayIndexOutOfBoundsException
> ------------------------------------------------------------------------------------
>
> Key: CASSANDRA-15669
> URL: https://issues.apache.org/jira/browse/CASSANDRA-15669
> Project: Cassandra
> Issue Type: Bug
> Components: Local/Compaction/LCS
> Reporter: sunhaihong
> Assignee: Alexey Zotov
> Priority: Normal
> Fix For: 3.11.x, 4.0.x
>
> Attachments: 15669-3.11.txt, 15669-4.0.txt, 15669-trunk.txt,
> cfs_compaction_info.png, error_info.png
>
> Time Spent: 1h 50m
> Remaining Estimate: 0h
>
> Cassandra will throw an ArrayIndexOutOfBoundsException when compact last
> level.
> My test is as follows：
> # Create a table with LeveledCompactionStrategy and its params are
> 'enabled': 'true', 'fanout_size': '2', 'max_threshold': '32',
> 'min_threshold': '4', 'sstable_size_in_mb': '2'（fanout_size and
> sstable_size_in_mb are too small just to make it easier to reproduce the
> problem）;
> # Insert data into the table by stress;
> # Cassandra throw an ArrayIndexOutOfBoundsException when compact level9
> sstables(this level score bigger than 1.001)
> ERROR [CompactionExecutor:4] 2020-03-28 08:59:00,990 CassandraDaemon.java:442
> - Exception in thread Thread[CompactionExecutor:4,1,main]
> java.lang.ArrayIndexOutOfBoundsException: 9
> at
> org.apache.cassandra.db.compaction.LeveledManifest.getLevel(LeveledManifest.java:814)
> at
> org.apache.cassandra.db.compaction.LeveledManifest.getCandidatesFor(LeveledManifest.java:746)
> at
> org.apache.cassandra.db.compaction.LeveledManifest.getCompactionCandidates(LeveledManifest.java:398)
> at
> org.apache.cassandra.db.compaction.LeveledCompactionStrategy.getNextBackgroundTask(LeveledCompactionStrategy.java:131)
> at
> org.apache.cassandra.db.compaction.CompactionStrategyHolder.lambda$getBackgroundTaskSuppliers$0(CompactionStrategyHolder.java:109)
> at
> org.apache.cassandra.db.compaction.AbstractStrategyHolder$TaskSupplier.getTask(AbstractStrategyHolder.java:66)
> at
> org.apache.cassandra.db.compaction.CompactionStrategyManager.getNextBackgroundTask(CompactionStrategyManager.java:214)
> at
> org.apache.cassandra.db.compaction.CompactionManager$BackgroundCompactionCandidate.run(CompactionManager.java:289)
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> at java.util.concurrent.FutureTask.run$$$capture(FutureTask.java:266)
> at java.util.concurrent.FutureTask.run(FutureTask.java)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at
> io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
> at java.lang.Thread.run(Thread.java:748)
> I tested it on cassandra version 3.11.3 & 4.0-alpha3. The exception all
> happened.
> once it triggers, level1- leveln compaction no longer works, level0 is still
> valid
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
