[
https://issues.apache.org/jira/browse/CASSANDRA-21054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18042284#comment-18042284
]
Yifan Cai commented on CASSANDRA-21054:
---------------------------------------
The relevant log messages indicates the dictionary training process in test did
not get enough samples.
https://ci-cassandra.apache.org/job/Cassandra-trunk/2337/testReport/org.apache.cassandra.db.compression/CompressionDictionarySchedulerTest/Tests___test_oa_jdk17_13_20___testScheduleSSTableBasedTrainingWithSSTables_oa_jdk17_x86_64/
{code:java}
INFO [main] 2025-11-28T23:05:01,437 ZstdDictionaryTrainer.java:302 - Started
dictionary training for
cql_test_keyspace.table_testschedulesstablebasedtrainingwithsst_00
INFO [main] 2025-11-28T23:05:01,437 CompressionDictionaryScheduler.java:97 -
Starting SSTable-based dictionary training for
cql_test_keyspace.table_testschedulesstablebasedtrainingwithsst_00 from 7
SSTables
DEBUG [main] 2025-11-28T23:05:01,438 CompressionDictionaryScheduler.java:194 -
Couldn't acquire reference to SSTable
/home/cassandra/cassandra/build/test/cassandra/data/cql_test_keyspace/table_testschedulesstablebasedtrainingwithsst_00-1b255f4def2540a60000000000000006/pa-5-big.
It may have been removed.
DEBUG [main] 2025-11-28T23:05:01,438 CompressionDictionaryScheduler.java:194 -
Couldn't acquire reference to SSTable
/home/cassandra/cassandra/build/test/cassandra/data/cql_test_keyspace/table_testschedulesstablebasedtrainingwithsst_00-1b255f4def2540a60000000000000006/pa-8-big.
It may have been removed.
DEBUG [main] 2025-11-28T23:05:01,438 CompressionDictionaryScheduler.java:194 -
Couldn't acquire reference to SSTable
/home/cassandra/cassandra/build/test/cassandra/data/cql_test_keyspace/table_testschedulesstablebasedtrainingwithsst_00-1b255f4def2540a60000000000000006/pa-7-big.
It may have been removed.
DEBUG [main] 2025-11-28T23:05:01,438 CompressionDictionaryScheduler.java:194 -
Couldn't acquire reference to SSTable
/home/cassandra/cassandra/build/test/cassandra/data/cql_test_keyspace/table_testschedulesstablebasedtrainingwithsst_00-1b255f4def2540a60000000000000006/pa-6-big.
It may have been removed.
INFO [NonPeriodicTasks:1] 2025-11-28T23:05:01,438
CompressionDictionaryScheduler.java:214 - Sampling chunks from 3 SSTables for
cql_test_keyspace.table_testschedulesstablebasedtrainingwithsst_00
INFO [NonPeriodicTasks:1] 2025-11-28T23:05:01,440 SSTableChunkSampler.java:148
- Sampling from 3 SSTables (3 compressed, 0 uncompressed) with 6 total chunks
DEBUG [NonPeriodicTasks:1] 2025-11-28T23:05:01,441 SSTableChunkSampler.java:116
- Target chunk count for sampling: 714 (max sample size: 10485760 bytes)
INFO [NonPeriodicTasks:1] 2025-11-28T23:05:01,442 SSTableChunkSampler.java:122
- Completed sampling: 6 chunks, total size: 88029 bytes
INFO [NonPeriodicTasks:1] 2025-11-28T23:05:01,442
CompressionDictionaryScheduler.java:220 - Completed sampling for
cql_test_keyspace.table_testschedulesstablebasedtrainingwithsst_00, now
training dictionary
DEBUG [NonPeriodicTasks:1] 2025-11-28T23:05:01,443
ZstdDictionaryTrainer.java:189 - Dictionary training validation failed for
cql_test_keyspace.table_testschedulesstablebasedtrainingwithsst_00:
Insufficient samples for training: 6 (minimum required: 11)
ERROR [NonPeriodicTasks:1] 2025-11-28T23:05:01,443
CompressionDictionaryScheduler.java:229 - SSTable-based dictionary training
failed for cql_test_keyspace.table_testschedulesstablebasedtrainingwithsst_00:
Insufficient samples for training: 6 (minimum required: 11)
{code}
> Test failure:
> CompressionDictionarySchedulerTest.testScheduleSSTableBasedTrainingWithSSTables
> ---------------------------------------------------------------------------------------------
>
> Key: CASSANDRA-21054
> URL: https://issues.apache.org/jira/browse/CASSANDRA-21054
> Project: Apache Cassandra
> Issue Type: Bug
> Components: Local/SSTable
> Reporter: Dmitry Konstantinov
> Assignee: Yifan Cai
> Priority: Normal
>
> Examples of CI runs with the test failure, it is failing quite consistent:
> [https://ci-cassandra.apache.org/job/Cassandra-trunk/2335/#showFailuresLink]
> [https://ci-cassandra.apache.org/job/Cassandra-trunk/2338/#showFailuresLink]
> [https://ci-cassandra.apache.org/job/Cassandra-trunk/2340/#showFailuresLink]
>
> {code:java}
> Assertion condition defined as a lambda expression in
> org.apache.cassandra.Util that uses java.util.concurrent.Callable
> Expected: <true>
> but: was <false> within 10 seconds. {code}
> {code:java}
> org.awaitility.core.ConditionTimeoutException: Assertion condition defined as
> a lambda expression in org.apache.cassandra.Util that uses
> java.util.concurrent.Callable
> Expected: <true>
> but: was <false> within 10 seconds.
> at org.awaitility.core.ConditionAwaiter.await(ConditionAwaiter.java:165)
> at
> org.awaitility.core.AssertionCondition.await(AssertionCondition.java:119)
> at
> org.awaitility.core.AssertionCondition.await(AssertionCondition.java:31)
> at org.awaitility.core.ConditionFactory.until(ConditionFactory.java:895)
> at
> org.awaitility.core.ConditionFactory.untilAsserted(ConditionFactory.java:679)
> at org.apache.cassandra.Util.spinUntilTrue(Util.java:793)
> at org.apache.cassandra.Util.spinUntilTrue(Util.java:778)
> at
> org.apache.cassandra.db.compression.CompressionDictionarySchedulerTest.testScheduleSSTableBasedTrainingWithSSTables(CompressionDictionarySchedulerTest.java:102)
> at
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> Caused by: java.lang.AssertionError:
> Expected: <true>
> but: was <false>
> at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
> at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:6)
> at org.apache.cassandra.Util.lambda$spinUntilTrue$3(Util.java:793)
> at
> org.awaitility.core.AssertionCondition.lambda$new$0(AssertionCondition.java:53)
> at
> org.awaitility.core.ConditionAwaiter$ConditionPoller.call(ConditionAwaiter.java:222)
> at
> org.awaitility.core.ConditionAwaiter$ConditionPoller.call(ConditionAwaiter.java:209)
> at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
> at
> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
> at
> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
> at java.base/java.lang.Thread.run(Thread.java:829) {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
