Summary: Somewhat rough day. While testall at 1 failure is palatable, we have a pair of new regressions and a mistagged failure on dtests, as well as a difficult to track down failure. novnode tests failed to run entirely and we have a lot of noise on upgrade tests due to failures tracked in CASSANDRA-12249.
Details follow: ===================================================================== testall: CompactionsCQLTest.testTriggerMinorCompactionDTCS Created CASSANDRA-12413, assigned to meriksson ===================================================================== dtest: ttl_test.TestDistributedTTL.ttl_is_respected_on_delayed_replication_test Regression, needs triage bootstrap_test.TestBootstrap.local_quorum_bootstrap_test Regression, needs triage commitlog_test.TestCommitLog.test_commitlog_replay_on_startup CASSANDRA-12213, Tyler Hobbs Assertions added to trunk on 7/15 to try and clarify Happening on multiple tests according to comments Any news on this Tyler? replace_address_test.TestReplaceAddress.replace_stopped_node_test Incorrectly linked to CASSANDRA-11652 and marked Windows. Needs new ticket and triage (different error message than 11652) ===================================================================== novnode: Failed to run Error message: 07:19:49 novaclient.exceptions.Forbidden: Quota exceeded for ram: Requested 81920, but already used 999424 of 1048576 ram (HTTP 403) (Request-ID: req-c5eb8318-0f2c-4528-bfbf-66ad6e34601b) Michael Shuler: Any thoughts on this failure? ===================================================================== upgrade: 49 failures Spot-checked about a quarter of them Many "java.lang.AssertionError: null at org.apache.cassandra.db.ReadCommand$LegacyPagedRangeCommandSerializer .deserialize(ReadCommand.java:1101) ~[apache-cassandra-3.7.jar:3.7]" Problem appears to be CASSANDRA-12249 Caused by changes in CASSANDRA-11393 Assigned to Benjamin Lerer Many "requested page not delivered" Russ believes problem is also caused by CASSANDRA-12249 Pinged Benjamin on ticket.