ryanwaha commented on PR #23945: URL: https://github.com/apache/kafka/pull/23945#issuecomment-6394774316
The latest commit extends the sort to the Failed, Flaky, Skipped and New tables as well. Ran `.github/scripts/junit.py` from trunk and from this branch against the JUnit XML artifacts of trunk CI run https://github.com/apache/kafka/actions/runs/39979455307 which contains real failures. Note that rows are sorted by (class name, test name) using plain string order, so parameterized tests that starts with `"` will come before the non-parameterized ones.(see the Failed table below). <details><summary>Failed table, Java 25: before vs after</summary> | # | before (trunk) | after (this PR) | |---|---|---| | 1 | StreamThreadTest > "shouldRecoverFromInvalidOffsetExceptionOnRestoreAndFinishRestore(boolean)…=true" | StreamThreadTest > "shouldAlwaysUpdateTasksMetadataAfterChangingState(boolean)…=false" | | 2 | StreamThreadTest > "shouldRecoverFromInvalidOffsetExceptionOnRestoreAndFinishRestore(boolean)…=false" | StreamThreadTest > "shouldAlwaysUpdateTasksMetadataAfterChangingState(boolean)…=true" | | 3 | StreamThreadTest > "shouldChangeStateAtStartClose(boolean)…=true" | StreamThreadTest > "shouldChangeStateAtStartClose(boolean)…=false" | | 4 | StreamThreadTest > "shouldChangeStateAtStartClose(boolean)…=false" | StreamThreadTest > "shouldChangeStateAtStartClose(boolean)…=true" | | 5 | StreamThreadTest > "shouldReturnNullIfRestoreConsumerTelemetryDisabled(boolean)…=true" | StreamThreadTest > "shouldChangeStateInRebalanceListener(boolean)…=false" | | 6 | StreamThreadTest > "shouldReturnNullIfRestoreConsumerTelemetryDisabled(boolean)…=false" | StreamThreadTest > "shouldChangeStateInRebalanceListener(boolean)…=true" | | 7 | StreamThreadTest > "shouldEnforceRebalanceWhenTaskCorruptedExceptionIsThrownForAnActiveTask(boolean)…=true" | StreamThreadTest > "shouldEnforceRebalanceWhenTaskCorruptedExceptionIsThrownForAnActiveTask(boolean)…=false" | | 8 | StreamThreadTest > "shouldEnforceRebalanceWhenTaskCorruptedExceptionIsThrownForAnActiveTask(boolean)…=false" | StreamThreadTest > "shouldEnforceRebalanceWhenTaskCorruptedExceptionIsThrownForAnActiveTask(boolean)…=true" | | 9 | StreamThreadTest > "shouldGetMainAndRestoreConsumerInstanceIdWithInternalTimeout(boolean)…=true" | StreamThreadTest > "shouldGetMainAndRestoreConsumerInstanceIdWithInternalTimeout(boolean)…=false" | | 10 | StreamThreadTest > "shouldGetMainAndRestoreConsumerInstanceIdWithInternalTimeout(boolean)…=false" | StreamThreadTest > "shouldGetMainAndRestoreConsumerInstanceIdWithInternalTimeout(boolean)…=true" | | 11 | StreamThreadTest > "shouldNotReturnDataAfterTaskMigrated(boolean)…=true" | StreamThreadTest > "shouldNotReturnDataAfterTaskMigrated(boolean)…=false" | | 12 | StreamThreadTest > "shouldNotReturnDataAfterTaskMigrated(boolean)…=false" | StreamThreadTest > "shouldNotReturnDataAfterTaskMigrated(boolean)…=true" | | 13 | StreamThreadTest > "shouldReturnNullIfProducerTelemetryDisabled(boolean)…=true" | StreamThreadTest > "shouldOnlyCompleteShutdownAfterRebalanceNotInProgress(boolean)…=false" | | 14 | StreamThreadTest > "shouldReturnNullIfProducerTelemetryDisabled(boolean)…=false" | StreamThreadTest > "shouldOnlyCompleteShutdownAfterRebalanceNotInProgress(boolean)…=true" | | 15 | StreamThreadTest > "shouldOnlyCompleteShutdownAfterRebalanceNotInProgress(boolean)…=true" | StreamThreadTest > "shouldPurgeAfterPurgeInterval(boolean)…=false" | | 16 | StreamThreadTest > "shouldOnlyCompleteShutdownAfterRebalanceNotInProgress(boolean)…=false" | StreamThreadTest > "shouldPurgeAfterPurgeInterval(boolean)…=true" | | 17 | StreamThreadTest > shouldPopulateWireTopologyDescriptionWhenPushEnabled() | StreamThreadTest > "shouldRecoverFromInvalidOffsetExceptionOnRestoreAndFinishRestore(boolean)…=false" | | 18 | StreamThreadTest > "shouldThrowTaskMigratedExceptionHandlingRevocation(boolean)…=true" | StreamThreadTest > "shouldRecoverFromInvalidOffsetExceptionOnRestoreAndFinishRestore(boolean)…=true" | | 19 | StreamThreadTest > "shouldThrowTaskMigratedExceptionHandlingRevocation(boolean)…=false" | StreamThreadTest > "shouldReinitializeRevivedTasksInAnyState(boolean)…=false" | | 20 | StreamThreadTest > "shouldReinitializeRevivedTasksInAnyState(boolean)…=true" | StreamThreadTest > "shouldReinitializeRevivedTasksInAnyState(boolean)…=true" | | 21 | StreamThreadTest > "shouldReinitializeRevivedTasksInAnyState(boolean)…=false" | StreamThreadTest > "shouldReturnErrorIfMainConsumerInstanceIdNotInitialized(boolean)…=false" | | 22 | StreamThreadTest > shouldProcessWhenPartitionAssigned() | StreamThreadTest > "shouldReturnErrorIfMainConsumerInstanceIdNotInitialized(boolean)…=true" | | 23 | StreamThreadTest > "shouldReturnErrorIfMainConsumerInstanceIdNotInitialized(boolean)…=true" | StreamThreadTest > "shouldReturnNullIfProducerTelemetryDisabled(boolean)…=false" | | 24 | StreamThreadTest > "shouldReturnErrorIfMainConsumerInstanceIdNotInitialized(boolean)…=false" | StreamThreadTest > "shouldReturnNullIfProducerTelemetryDisabled(boolean)…=true" | | 25 | StreamThreadTest > "shouldAlwaysUpdateTasksMetadataAfterChangingState(boolean)…=true" | StreamThreadTest > "shouldReturnNullIfRestoreConsumerTelemetryDisabled(boolean)…=false" | | 26 | StreamThreadTest > "shouldAlwaysUpdateTasksMetadataAfterChangingState(boolean)…=false" | StreamThreadTest > "shouldReturnNullIfRestoreConsumerTelemetryDisabled(boolean)…=true" | | 27 | StreamThreadTest > shouldKeepGroupMembershipOperationOfTheCallerThatInitiatedShutdown() | StreamThreadTest > "shouldThrowTaskMigratedExceptionHandlingRevocation(boolean)…=false" | | 28 | StreamThreadTest > "shouldPurgeAfterPurgeInterval(boolean)…=true" | StreamThreadTest > "shouldThrowTaskMigratedExceptionHandlingRevocation(boolean)…=true" | | 29 | StreamThreadTest > "shouldPurgeAfterPurgeInterval(boolean)…=false" | StreamThreadTest > shouldKeepGroupMembershipOperationOfTheCallerThatInitiatedShutdown() | | 30 | StreamThreadTest > "shouldChangeStateInRebalanceListener(boolean)…=true" | StreamThreadTest > shouldPopulateWireTopologyDescriptionWhenPushEnabled() | | 31 | StreamThreadTest > "shouldChangeStateInRebalanceListener(boolean)…=false" | StreamThreadTest > shouldProcessWhenPartitionAssigned() | | 32 | StreamThreadTest > shouldRouteDefaultToRemainInGroupForClassicProtocol() | StreamThreadTest > shouldRouteDefaultToRemainInGroupForClassicProtocol() | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
