brandboat commented on PR #19880: URL: https://github.com/apache/kafka/pull/19880#issuecomment-2968700060
Executed the following command to run the Streams tests: ```sh TC_PATHS="tests/kafkatest/tests/streams" bash tests/docker/run_tests.sh ``` <details closed> <summary>Test summary, 3 flaky tests - `kafkatest.tests.streams.streams_broker_bounce_test.StreamsBrokerBounceTest.test_broker_type_bounce.failure_mode=clean_bounce.broker_type=leader.num_threads=3.sleep_time_secs=120.metadata_quorum=COMBINED_KRAFT.group_protocol=classic` - `kafkatest.tests.streams.streams_broker_down_resilience_test.StreamsBrokerDownResilience.test_streams_should_failover_while_brokers_down.metadata_quorum=COMBINED_KRAFT.group_protocol=streams` - `kafkatest.tests.streams.streams_broker_bounce_test.StreamsBrokerBounceTest.test_broker_type_bounce.failure_mode=hard_shutdown.broker_type=leader.num_threads=3.sleep_time_secs=120.metadata_quorum=COMBINED_KRAFT.group_protocol=streams` </summary> ``` ==================================================================================================== SESSION REPORT (ALL TESTS) ducktape version: 0.12.0 session_id: 2025-06-12--001 run time: 30 minutes 56.677 seconds tests run: 13 passed: 13 flaky: 0 failed: 0 ignored: 0 ==================================================================================================== test_id: kafkatest.tests.streams.streams_broker_bounce_test.StreamsBrokerBounceTest.test_many_brokers_bounce.failure_mode=clean_shutdown.num_failures=2.metadata_quorum=ISOLATED_KRAFT.group_protocol=classic status: PASS run time: 5 minutes 37.010 seconds {"Client closed": "5c935038-4552-4517-9ef1-5700e8f43a03: SMOKE-TEST-CLIENT-CLOSED\n", "Records Delivered": "ALL-RECORDS-DELIVERED\n", "Logic Success/Failure": "FAILURE\n"} ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_standby_replica_test.StreamsStandbyTask.test_standby_tasks_rebalance.metadata_quorum=COMBINED_KRAFT.group_protocol=streams status: PASS run time: 2 minutes 34.606 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_application_upgrade_test.StreamsUpgradeTest.test_app_upgrade.from_version=2.4.1.bounce_type=full.metadata_quorum=COMBINED_KRAFT status: PASS run time: 1 minute 35.817 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_application_upgrade_test.StreamsUpgradeTest.test_app_upgrade.from_version=3.5.2.bounce_type=full.metadata_quorum=COMBINED_KRAFT status: PASS run time: 1 minute 32.945 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_eos_test.StreamsEosTest.test_rebalance_complex.metadata_quorum=COMBINED_KRAFT.group_protocol=classic status: PASS run time: 2 minutes 20.001 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_bounce_test.StreamsBrokerBounceTest.test_broker_type_bounce.failure_mode=clean_bounce.broker_type=leader.num_threads=1.sleep_time_secs=120.metadata_quorum=COMBINED_KRAFT.group_protocol=classic status: PASS run time: 5 minutes 15.875 seconds {"Client closed": "44075d69-2832-4a81-af6d-b06af044c6b7: SMOKE-TEST-CLIENT-CLOSED\n", "Records Delivered": "ALL-RECORDS-DELIVERED\n", "Logic Success/Failure": "FAILURE\n"} ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_bounce_test.StreamsBrokerBounceTest.test_broker_type_bounce.failure_mode=hard_bounce.broker_type=leader.num_threads=3.sleep_time_secs=120.metadata_quorum=COMBINED_KRAFT.group_protocol=classic status: PASS run time: 6 minutes 12.126 seconds {"Client closed": "172a3781-e0af-4671-9ff0-465db08ee2ad: SMOKE-TEST-CLIENT-CLOSED\n", "Records Delivered": "ALL-RECORDS-DELIVERED\n", "Logic Success/Failure": "FAILURE\n"} ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_down_resilience_test.StreamsBrokerDownResilience.test_streams_runs_with_broker_down_initially.metadata_quorum=COMBINED_KRAFT.group_protocol=classic status: PASS run time: 56.038 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_upgrade_test.StreamsUpgradeTest.test_rolling_upgrade_with_2_bounces.from_version=3.3.2.metadata_quorum=COMBINED_KRAFT status: PASS run time: 1 minute 58.437 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_upgrade_test.StreamsUpgradeTest.test_upgrade_downgrade_state_updater.from_version=4.2.0-SNAPSHOT.upgrade=False.metadata_quorum=COMBINED_KRAFT status: PASS run time: 1 minute 24.632 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_compatibility_test.StreamsBrokerCompatibility.test_compatible_brokers_eos_disabled.broker_version=3.4.1.metadata_quorum=COMBINED_KRAFT status: PASS run time: 28.257 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_compatibility_test.StreamsBrokerCompatibility.test_compatible_brokers_eos_v2_enabled.broker_version=3.3.2.metadata_quorum=COMBINED_KRAFT status: PASS run time: 29.251 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_shutdown_deadlock_test.StreamsShutdownDeadlockTest.test_shutdown_wont_deadlock.metadata_quorum=ISOLATED_KRAFT status: PASS run time: 29.918 seconds ---------------------------------------------------------------------------------------------------- ``` ``` ==================================================================================================== SESSION REPORT (ALL TESTS) ducktape version: 0.12.0 session_id: 2025-06-12--001 run time: 35 minutes 21.619 seconds tests run: 13 passed: 13 flaky: 0 failed: 0 ignored: 0 ==================================================================================================== test_id: kafkatest.tests.streams.streams_broker_bounce_test.StreamsBrokerBounceTest.test_many_brokers_bounce.failure_mode=clean_shutdown.num_failures=2.metadata_quorum=ISOLATED_KRAFT.group_protocol=streams status: PASS run time: 5 minutes 45.468 seconds {"Client closed": "88762f97-ffe4-4da8-94e4-3c5ddfa59e73: SMOKE-TEST-CLIENT-CLOSED\n", "Records Delivered": "ALL-RECORDS-DELIVERED\n", "Logic Success/Failure": "FAILURE\n"} ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_application_upgrade_test.StreamsUpgradeTest.test_app_upgrade.from_version=2.5.1.bounce_type=full.metadata_quorum=COMBINED_KRAFT status: PASS run time: 1 minute 35.013 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_application_upgrade_test.StreamsUpgradeTest.test_app_upgrade.from_version=3.6.2.bounce_type=full.metadata_quorum=COMBINED_KRAFT status: PASS run time: 1 minute 36.799 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_eos_test.StreamsEosTest.test_rebalance_complex.metadata_quorum=COMBINED_KRAFT.group_protocol=streams status: PASS run time: 2 minutes 19.851 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_smoke_test.StreamsSmokeTest.test_streams.processing_guarantee=at_least_once.crash=False.metadata_quorum=COMBINED_KRAFT.group_protocol=classic status: PASS run time: 2 minutes 46.759 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_static_membership_test.StreamsStaticMembershipTest.test_rolling_bounces_will_not_trigger_rebalance_under_static_membership.metadata_quorum=ISOLATED_KRAFT status: PASS run time: 1 minute 42.829 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_bounce_test.StreamsBrokerBounceTest.test_broker_type_bounce.failure_mode=clean_bounce.broker_type=leader.num_threads=1.sleep_time_secs=120.metadata_quorum=COMBINED_KRAFT.group_protocol=streams status: PASS run time: 5 minutes 16.826 seconds {"Client closed": "ced724ed-360b-4ee5-96a2-51fe39cf8788: SMOKE-TEST-CLIENT-CLOSED\n", "Records Delivered": "ALL-RECORDS-DELIVERED\n", "Logic Success/Failure": "FAILURE\n"} ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_bounce_test.StreamsBrokerBounceTest.test_broker_type_bounce.failure_mode=hard_bounce.broker_type=leader.num_threads=3.sleep_time_secs=120.metadata_quorum=COMBINED_KRAFT.group_protocol=streams status: PASS run time: 6 minutes 11.619 seconds {"Client closed": "b849b099-35d3-4c3f-9d7b-b08f8ced8b40: SMOKE-TEST-CLIENT-CLOSED\n", "Records Delivered": "ALL-RECORDS-DELIVERED\n", "Logic Success/Failure": "FAILURE\n"} ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_down_resilience_test.StreamsBrokerDownResilience.test_streams_runs_with_broker_down_initially.metadata_quorum=COMBINED_KRAFT.group_protocol=streams status: PASS run time: 1 minute 6.786 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_upgrade_test.StreamsUpgradeTest.test_rolling_upgrade_with_2_bounces.from_version=3.4.1.metadata_quorum=COMBINED_KRAFT status: PASS run time: 4 minutes 37.168 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_upgrade_test.StreamsUpgradeTest.test_upgrade_downgrade_state_updater.from_version=4.2.0-SNAPSHOT.upgrade=True.metadata_quorum=COMBINED_KRAFT status: PASS run time: 1 minute 22.568 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_compatibility_test.StreamsBrokerCompatibility.test_compatible_brokers_eos_disabled.broker_version=3.5.2.metadata_quorum=COMBINED_KRAFT status: PASS run time: 28.486 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_compatibility_test.StreamsBrokerCompatibility.test_compatible_brokers_eos_v2_enabled.broker_version=3.4.1.metadata_quorum=COMBINED_KRAFT status: PASS run time: 29.624 seconds ---------------------------------------------------------------------------------------------------- ``` ``` ==================================================================================================== SESSION REPORT (ALL TESTS) ducktape version: 0.12.0 session_id: 2025-06-12--001 run time: 47 minutes 15.156 seconds tests run: 13 passed: 12 flaky: 0 failed: 1 ignored: 0 ==================================================================================================== test_id: kafkatest.tests.streams.streams_broker_bounce_test.StreamsBrokerBounceTest.test_many_brokers_bounce.failure_mode=hard_bounce.num_failures=2.metadata_quorum=ISOLATED_KRAFT.group_protocol=classic status: PASS run time: 5 minutes 41.814 seconds {"Client closed": "e4700010-19f6-4e8c-a82f-183e0025c199: SMOKE-TEST-CLIENT-CLOSED\n", "Records Delivered": "ALL-RECORDS-DELIVERED\n", "Logic Success/Failure": "FAILURE\n"} ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_application_upgrade_test.StreamsUpgradeTest.test_app_upgrade.from_version=2.6.3.bounce_type=full.metadata_quorum=COMBINED_KRAFT status: PASS run time: 1 minute 33.262 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_application_upgrade_test.StreamsUpgradeTest.test_app_upgrade.from_version=3.7.2.bounce_type=full.metadata_quorum=COMBINED_KRAFT status: PASS run time: 1 minute 34.290 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_down_resilience_test.StreamsBrokerDownResilience.test_streams_should_failover_while_brokers_down.metadata_quorum=COMBINED_KRAFT.group_protocol=classic status: PASS run time: 1 minute 47.449 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_eos_test.StreamsEosTest.test_rebalance_simple.metadata_quorum=COMBINED_KRAFT.group_protocol=classic status: PASS run time: 2 minutes 12.682 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_smoke_test.StreamsSmokeTest.test_streams.processing_guarantee=at_least_once.crash=False.metadata_quorum=COMBINED_KRAFT.group_protocol=streams status: PASS run time: 2 minutes 43.763 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_bounce_test.StreamsBrokerBounceTest.test_broker_type_bounce.failure_mode=clean_bounce.broker_type=leader.num_threads=3.sleep_time_secs=120.metadata_quorum=COMBINED_KRAFT.group_protocol=classic status: FAIL run time: 16 minutes 10.123 seconds RemoteCommandError({'ssh_config': {'host': 'ducker07', 'hostname': 'ducker07', 'user': 'ducker', 'port': 22, 'password': '', 'identityfile': '/home/ducker/.ssh/id_rsa', 'connecttimeout': None}, 'hostname': 'ducker07', 'ssh_hostname': 'ducker07', 'user': 'ducker', 'externally_routable_ip': 'ducker07', '_logger': <Logger kafkatest.tests.streams.streams_broker_bounce_test.StreamsBrokerBounceTest.test_broker_type_bounce.failure_mode=clean_bounce.broker_type=leader.num_threads=3.sleep_time_secs=120.metadata_quorum=COMBINED_KRAFT.group_protocol=classic-7 (DEBUG)>, 'os': 'linux', '_ssh_client': <paramiko.client.SSHClient object at 0x7180983b84a8>, '_sftp_client': <paramiko.sftp_client.SFTPClient object at 0x7180983e5be0>, '_custom_ssh_exception_checks': None}, 'grep SMOKE-TEST-CLIENT-CLOSED /mnt/streams/streams.stdout', 1, b'') Traceback (most recent call last): File "/usr/local/lib/python3.7/dist-packages/ducktape/tests/runner_client.py", line 351, in _do_run data = self.run_test() File "/usr/local/lib/python3.7/dist-packages/ducktape/tests/runner_client.py", line 411, in run_test return self.test_context.function(self.test) File "/usr/local/lib/python3.7/dist-packages/ducktape/mark/_mark.py", line 438, in wrapper return functools.partial(f, *args, **kwargs)(*w_args, **w_kwargs) File "/opt/kafka-dev/tests/kafkatest/tests/streams/streams_broker_bounce_test.py", line 227, in test_broker_type_bounce return self.collect_results(sleep_time_secs) File "/opt/kafka-dev/tests/kafkatest/tests/streams/streams_broker_bounce_test.py", line 190, in collect_results for line in output_streams: File "/usr/local/lib/python3.7/dist-packages/ducktape/cluster/remoteaccount.py", line 697, in next return next(self.iter_obj) File "/usr/local/lib/python3.7/dist-packages/ducktape/cluster/remoteaccount.py", line 364, in output_generator raise RemoteCommandError(self, cmd, exit_status, stderr.read()) ducktape.cluster.remoteaccount.RemoteCommandError: ducker@ducker07: Command 'grep SMOKE-TEST-CLIENT-CLOSED /mnt/streams/streams.stdout' returned non-zero exit status 1. ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_bounce_test.StreamsBrokerBounceTest.test_broker_type_bounce.failure_mode=hard_shutdown.broker_type=leader.num_threads=1.sleep_time_secs=120.metadata_quorum=COMBINED_KRAFT.group_protocol=classic status: PASS run time: 6 minutes 12.571 seconds {"Client closed": "c525f849-5445-4f60-9d74-41bde34519ca: SMOKE-TEST-CLIENT-CLOSED\n", "Records Delivered": "ALL-RECORDS-DELIVERED\n", "Logic Success/Failure": "FAILURE\n"} ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_upgrade_test.StreamsUpgradeTest.test_rolling_upgrade_with_2_bounces.from_version=2.4.1.metadata_quorum=COMBINED_KRAFT status: PASS run time: 2 minutes 8.267 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_upgrade_test.StreamsUpgradeTest.test_rolling_upgrade_with_2_bounces.from_version=3.5.2.metadata_quorum=COMBINED_KRAFT status: PASS run time: 4 minutes 36.912 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_upgrade_test.StreamsUpgradeTest.test_version_probing_upgrade.metadata_quorum=COMBINED_KRAFT status: PASS run time: 1 minute 33.364 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_compatibility_test.StreamsBrokerCompatibility.test_compatible_brokers_eos_disabled.broker_version=3.6.2.metadata_quorum=COMBINED_KRAFT status: PASS run time: 28.704 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_compatibility_test.StreamsBrokerCompatibility.test_compatible_brokers_eos_v2_enabled.broker_version=3.5.2.metadata_quorum=COMBINED_KRAFT status: PASS run time: 30.165 seconds ---------------------------------------------------------------------------------------------------- ``` ``` ==================================================================================================== SESSION REPORT (ALL TESTS) ducktape version: 0.12.0 session_id: 2025-06-12--001 run time: 36 minutes 8.922 seconds tests run: 12 passed: 11 flaky: 0 failed: 1 ignored: 0 ==================================================================================================== test_id: kafkatest.tests.streams.streams_broker_bounce_test.StreamsBrokerBounceTest.test_many_brokers_bounce.failure_mode=hard_bounce.num_failures=2.metadata_quorum=ISOLATED_KRAFT.group_protocol=streams status: PASS run time: 5 minutes 34.456 seconds {"Client closed": "ec722817-1901-49bb-8aa7-2ee86f269d74: SMOKE-TEST-CLIENT-CLOSED\n", "Records Delivered": "ALL-RECORDS-DELIVERED\n", "Logic Success/Failure": "FAILURE\n"} ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_application_upgrade_test.StreamsUpgradeTest.test_app_upgrade.from_version=2.7.2.bounce_type=full.metadata_quorum=COMBINED_KRAFT status: PASS run time: 1 minute 34.475 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_application_upgrade_test.StreamsUpgradeTest.test_app_upgrade.from_version=3.8.1.bounce_type=full.metadata_quorum=COMBINED_KRAFT status: PASS run time: 1 minute 34.097 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_down_resilience_test.StreamsBrokerDownResilience.test_streams_should_failover_while_brokers_down.metadata_quorum=COMBINED_KRAFT.group_protocol=streams status: FAIL run time: 3 minutes 33.402 seconds TimeoutError("Never saw 'processed [0-9]* messages' on ducker@ducker07") Traceback (most recent call last): File "/usr/local/lib/python3.7/dist-packages/ducktape/tests/runner_client.py", line 351, in _do_run data = self.run_test() File "/usr/local/lib/python3.7/dist-packages/ducktape/tests/runner_client.py", line 411, in run_test return self.test_context.function(self.test) File "/usr/local/lib/python3.7/dist-packages/ducktape/mark/_mark.py", line 438, in wrapper return functools.partial(f, *args, **kwargs)(*w_args, **w_kwargs) File "/opt/kafka-dev/tests/kafkatest/tests/streams/streams_broker_down_resilience_test.py", line 336, in test_streams_should_failover_while_brokers_down err_msg=("Never saw '%s' on " % self.message) + str(processor_3.node.account)) File "/usr/local/lib/python3.7/dist-packages/ducktape/cluster/remoteaccount.py", line 754, in wait_until allow_fail=True) == 0, **kwargs) File "/usr/local/lib/python3.7/dist-packages/ducktape/utils/util.py", line 58, in wait_until raise TimeoutError(err_msg() if callable(err_msg) else err_msg) from last_exception ducktape.errors.TimeoutError: Never saw 'processed [0-9]* messages' on ducker@ducker07 ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_eos_test.StreamsEosTest.test_rebalance_simple.metadata_quorum=COMBINED_KRAFT.group_protocol=streams status: PASS run time: 2 minutes 14.818 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_smoke_test.StreamsSmokeTest.test_streams.processing_guarantee=at_least_once.crash=True.metadata_quorum=COMBINED_KRAFT.group_protocol=classic status: PASS run time: 2 minutes 46.931 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_bounce_test.StreamsBrokerBounceTest.test_broker_type_bounce.failure_mode=clean_bounce.broker_type=leader.num_threads=3.sleep_time_secs=120.metadata_quorum=COMBINED_KRAFT.group_protocol=streams status: PASS run time: 5 minutes 12.809 seconds {"Client closed": "9f79ee80-c3d2-4bf5-9e8c-06c1b72dc1cc: SMOKE-TEST-CLIENT-CLOSED\n", "Records Delivered": "ALL-RECORDS-DELIVERED\n", "Logic Success/Failure": "FAILURE\n"} ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_bounce_test.StreamsBrokerBounceTest.test_broker_type_bounce.failure_mode=hard_shutdown.broker_type=leader.num_threads=1.sleep_time_secs=120.metadata_quorum=COMBINED_KRAFT.group_protocol=streams status: PASS run time: 6 minutes 11.096 seconds {"Client closed": "40a0478d-d942-474f-89b5-0bde633a2e23: SMOKE-TEST-CLIENT-CLOSED\n", "Records Delivered": "ALL-RECORDS-DELIVERED\n", "Logic Success/Failure": "FAILURE\n"} ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_upgrade_test.StreamsUpgradeTest.test_rolling_upgrade_with_2_bounces.from_version=2.5.1.metadata_quorum=COMBINED_KRAFT status: PASS run time: 2 minutes 5.725 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_upgrade_test.StreamsUpgradeTest.test_rolling_upgrade_with_2_bounces.from_version=3.6.2.metadata_quorum=COMBINED_KRAFT status: PASS run time: 4 minutes 21.509 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_compatibility_test.StreamsBrokerCompatibility.test_compatible_brokers_eos_disabled.broker_version=3.7.2.metadata_quorum=COMBINED_KRAFT status: PASS run time: 28.718 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_compatibility_test.StreamsBrokerCompatibility.test_compatible_brokers_eos_v2_enabled.broker_version=3.6.2.metadata_quorum=COMBINED_KRAFT status: PASS run time: 29.298 seconds ---------------------------------------------------------------------------------------------------- ``` ``` ==================================================================================================== SESSION REPORT (ALL TESTS) ducktape version: 0.12.0 session_id: 2025-06-12--001 run time: 34 minutes 36.818 seconds tests run: 12 passed: 12 flaky: 0 failed: 0 ignored: 0 ==================================================================================================== test_id: kafkatest.tests.streams.streams_broker_bounce_test.StreamsBrokerBounceTest.test_many_brokers_bounce.failure_mode=hard_shutdown.num_failures=2.metadata_quorum=ISOLATED_KRAFT.group_protocol=classic status: PASS run time: 5 minutes 41.719 seconds {"Client closed": "f653d48a-9855-4360-9e02-e2c6dc263466: SMOKE-TEST-CLIENT-CLOSED\n", "Records Delivered": "ALL-RECORDS-DELIVERED\n", "Logic Success/Failure": "FAILURE\n"} ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_application_upgrade_test.StreamsUpgradeTest.test_app_upgrade.from_version=2.8.2.bounce_type=full.metadata_quorum=COMBINED_KRAFT status: PASS run time: 1 minute 32.766 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_application_upgrade_test.StreamsUpgradeTest.test_app_upgrade.from_version=3.9.1.bounce_type=full.metadata_quorum=COMBINED_KRAFT status: PASS run time: 1 minute 35.578 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_down_resilience_test.StreamsBrokerDownResilience.test_streams_should_scale_in_while_brokers_down.metadata_quorum=COMBINED_KRAFT.group_protocol=classic status: PASS run time: 1 minute 42.907 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_named_repartition_topic_test.StreamsNamedRepartitionTopicTest.test_upgrade_topology_with_named_repartition_topic.metadata_quorum=COMBINED_KRAFT status: PASS run time: 1 minute 26.108 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_smoke_test.StreamsSmokeTest.test_streams.processing_guarantee=at_least_once.crash=True.metadata_quorum=COMBINED_KRAFT.group_protocol=streams status: PASS run time: 2 minutes 43.048 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_bounce_test.StreamsBrokerBounceTest.test_broker_type_bounce.failure_mode=clean_shutdown.broker_type=leader.num_threads=1.sleep_time_secs=120.metadata_quorum=COMBINED_KRAFT.group_protocol=classic status: PASS run time: 6 minutes 9.734 seconds {"Client closed": "b361a8ed-3b27-4ba4-bac0-f15303c7ae38: SMOKE-TEST-CLIENT-CLOSED\n", "Records Delivered": "ALL-RECORDS-DELIVERED\n", "Logic Success/Failure": "FAILURE\n"} ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_bounce_test.StreamsBrokerBounceTest.test_broker_type_bounce.failure_mode=hard_shutdown.broker_type=leader.num_threads=3.sleep_time_secs=120.metadata_quorum=COMBINED_KRAFT.group_protocol=classic status: PASS run time: 6 minutes 10.111 seconds {"Client closed": "c2468f42-f839-44c1-9487-9c9b40be1bd3: SMOKE-TEST-CLIENT-CLOSED\n", "Records Delivered": "ALL-RECORDS-DELIVERED\n", "Logic Success/Failure": "FAILURE\n"} ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_upgrade_test.StreamsUpgradeTest.test_rolling_upgrade_with_2_bounces.from_version=2.6.3.metadata_quorum=COMBINED_KRAFT status: PASS run time: 1 minute 58.325 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_upgrade_test.StreamsUpgradeTest.test_rolling_upgrade_with_2_bounces.from_version=3.7.2.metadata_quorum=COMBINED_KRAFT status: PASS run time: 4 minutes 36.227 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_compatibility_test.StreamsBrokerCompatibility.test_compatible_brokers_eos_disabled.broker_version=3.8.1.metadata_quorum=COMBINED_KRAFT status: PASS run time: 28.457 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_compatibility_test.StreamsBrokerCompatibility.test_compatible_brokers_eos_v2_enabled.broker_version=3.7.2.metadata_quorum=COMBINED_KRAFT status: PASS run time: 30.225 seconds ---------------------------------------------------------------------------------------------------- ``` ``` ==================================================================================================== SESSION REPORT (ALL TESTS) ducktape version: 0.12.0 session_id: 2025-06-12--001 run time: 46 minutes 1.587 seconds tests run: 12 passed: 11 flaky: 0 failed: 1 ignored: 0 ==================================================================================================== test_id: kafkatest.tests.streams.streams_broker_bounce_test.StreamsBrokerBounceTest.test_many_brokers_bounce.failure_mode=hard_shutdown.num_failures=2.metadata_quorum=ISOLATED_KRAFT.group_protocol=streams status: PASS run time: 5 minutes 37.010 seconds {"Client closed": "0d387ade-378c-46a4-b77c-2482db95df74: SMOKE-TEST-CLIENT-CLOSED\n", "Records Delivered": "ALL-RECORDS-DELIVERED\n", "Logic Success/Failure": "FAILURE\n"} ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_application_upgrade_test.StreamsUpgradeTest.test_app_upgrade.from_version=3.0.2.bounce_type=full.metadata_quorum=COMBINED_KRAFT status: PASS run time: 1 minute 34.714 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_application_upgrade_test.StreamsUpgradeTest.test_app_upgrade.from_version=4.0.0.bounce_type=full.metadata_quorum=COMBINED_KRAFT status: PASS run time: 1 minute 38.680 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_down_resilience_test.StreamsBrokerDownResilience.test_streams_should_scale_in_while_brokers_down.metadata_quorum=COMBINED_KRAFT.group_protocol=streams status: PASS run time: 1 minute 13.299 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_optimized_test.StreamsOptimizedTest.test_upgrade_optimized_topology.metadata_quorum=COMBINED_KRAFT status: PASS run time: 1 minute 46.266 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_smoke_test.StreamsSmokeTest.test_streams.processing_guarantee=exactly_once_v2.crash=False.metadata_quorum=COMBINED_KRAFT.group_protocol=classic status: PASS run time: 2 minutes 48.053 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_bounce_test.StreamsBrokerBounceTest.test_broker_type_bounce.failure_mode=clean_shutdown.broker_type=leader.num_threads=1.sleep_time_secs=120.metadata_quorum=COMBINED_KRAFT.group_protocol=streams status: PASS run time: 6 minutes 11.521 seconds {"Client closed": "5568b0b2-a57b-433e-a6ba-35f0c2faed6c: SMOKE-TEST-CLIENT-CLOSED\n", "Records Delivered": "ALL-RECORDS-DELIVERED\n", "Logic Success/Failure": "FAILURE\n"} ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_bounce_test.StreamsBrokerBounceTest.test_broker_type_bounce.failure_mode=hard_shutdown.broker_type=leader.num_threads=3.sleep_time_secs=120.metadata_quorum=COMBINED_KRAFT.group_protocol=streams status: FAIL run time: 17 minutes 46.646 seconds RemoteCommandError({'ssh_config': {'host': 'ducker02', 'hostname': 'ducker02', 'user': 'ducker', 'port': 22, 'password': '', 'identityfile': '/home/ducker/.ssh/id_rsa', 'connecttimeout': None}, 'hostname': 'ducker02', 'ssh_hostname': 'ducker02', 'user': 'ducker', 'externally_routable_ip': 'ducker02', '_logger': <Logger kafkatest.tests.streams.streams_broker_bounce_test.StreamsBrokerBounceTest.test_broker_type_bounce.failure_mode=hard_shutdown.broker_type=leader.num_threads=3.sleep_time_secs=120.metadata_quorum=COMBINED_KRAFT.group_protocol=streams-8 (DEBUG)>, 'os': 'linux', '_ssh_client': <paramiko.client.SSHClient object at 0x7074ad0fed30>, '_sftp_client': <paramiko.sftp_client.SFTPClient object at 0x7074ad101160>, '_custom_ssh_exception_checks': None}, 'grep SMOKE-TEST-CLIENT-CLOSED /mnt/streams/streams.stdout', 1, b'') Traceback (most recent call last): File "/usr/local/lib/python3.7/dist-packages/ducktape/tests/runner_client.py", line 351, in _do_run data = self.run_test() File "/usr/local/lib/python3.7/dist-packages/ducktape/tests/runner_client.py", line 411, in run_test return self.test_context.function(self.test) File "/usr/local/lib/python3.7/dist-packages/ducktape/mark/_mark.py", line 438, in wrapper return functools.partial(f, *args, **kwargs)(*w_args, **w_kwargs) File "/opt/kafka-dev/tests/kafkatest/tests/streams/streams_broker_bounce_test.py", line 227, in test_broker_type_bounce return self.collect_results(sleep_time_secs) File "/opt/kafka-dev/tests/kafkatest/tests/streams/streams_broker_bounce_test.py", line 190, in collect_results for line in output_streams: File "/usr/local/lib/python3.7/dist-packages/ducktape/cluster/remoteaccount.py", line 697, in next return next(self.iter_obj) File "/usr/local/lib/python3.7/dist-packages/ducktape/cluster/remoteaccount.py", line 364, in output_generator raise RemoteCommandError(self, cmd, exit_status, stderr.read()) ducktape.cluster.remoteaccount.RemoteCommandError: ducker@ducker02: Command 'grep SMOKE-TEST-CLIENT-CLOSED /mnt/streams/streams.stdout' returned non-zero exit status 1. ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_upgrade_test.StreamsUpgradeTest.test_rolling_upgrade_with_2_bounces.from_version=2.7.2.metadata_quorum=COMBINED_KRAFT status: PASS run time: 2 minutes 3.960 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_upgrade_test.StreamsUpgradeTest.test_rolling_upgrade_with_2_bounces.from_version=3.8.1.metadata_quorum=COMBINED_KRAFT status: PASS run time: 4 minutes 19.797 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_compatibility_test.StreamsBrokerCompatibility.test_compatible_brokers_eos_disabled.broker_version=3.9.1.metadata_quorum=COMBINED_KRAFT status: PASS run time: 29.601 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_compatibility_test.StreamsBrokerCompatibility.test_compatible_brokers_eos_v2_enabled.broker_version=3.8.1.metadata_quorum=COMBINED_KRAFT status: PASS run time: 30.437 seconds ---------------------------------------------------------------------------------------------------- ``` ``` ==================================================================================================== SESSION REPORT (ALL TESTS) ducktape version: 0.12.0 session_id: 2025-06-12--001 run time: 28 minutes 45.659 seconds tests run: 12 passed: 11 flaky: 0 failed: 0 ignored: 1 ==================================================================================================== test_id: kafkatest.tests.streams.streams_broker_bounce_test.StreamsBrokerBounceTest.test_all_brokers_bounce.failure_mode=clean_bounce.num_failures=3.metadata_quorum=ISOLATED_KRAFT.group_protocol=classic status: PASS run time: 5 minutes 32.277 seconds {"Client closed": "a163023d-77bd-44e2-820b-054af5ddd187: SMOKE-TEST-CLIENT-CLOSED\n", "Records Delivered": "ALL-RECORDS-DELIVERED\n", "Logic Success/Failure": "FAILURE\n"} ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_application_upgrade_test.StreamsUpgradeTest.test_app_upgrade.from_version=3.1.2.bounce_type=full.metadata_quorum=COMBINED_KRAFT status: PASS run time: 1 minute 34.925 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_eos_test.StreamsEosTest.test_failure_and_recovery.metadata_quorum=COMBINED_KRAFT.group_protocol=classic status: PASS run time: 2 minutes 38.785 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_relational_smoke_test.StreamsRelationalSmokeTest.test_streams.crash=False.metadata_quorum=COMBINED_KRAFT.group_protocol=classic status: PASS run time: 2 minutes 3.972 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_smoke_test.StreamsSmokeTest.test_streams.processing_guarantee=exactly_once_v2.crash=False.metadata_quorum=COMBINED_KRAFT.group_protocol=streams status: PASS run time: 2 minutes 45.350 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_bounce_test.StreamsBrokerBounceTest.test_broker_type_bounce.failure_mode=clean_shutdown.broker_type=leader.num_threads=3.sleep_time_secs=120.metadata_quorum=COMBINED_KRAFT.group_protocol=classic status: PASS run time: 6 minutes 11.360 seconds {"Client closed": "599a5f09-fbce-490c-a0f5-ce233a5a55f5: SMOKE-TEST-CLIENT-CLOSED\n", "Records Delivered": "ALL-RECORDS-DELIVERED\n", "Logic Success/Failure": "FAILURE\n"} ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_bounce_test.StreamsBrokerBounceTest.test_broker_type_bounce_at_start.failure_mode=clean_shutdown.broker_type=controller.sleep_time_secs=0.metadata_quorum=COMBINED_KRAFT.group_protocol=classic status: IGNORE run time: 0.000 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_upgrade_test.StreamsUpgradeTest.test_rolling_upgrade_with_2_bounces.from_version=2.8.2.metadata_quorum=COMBINED_KRAFT status: PASS run time: 2 minutes 6.458 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_upgrade_test.StreamsUpgradeTest.test_rolling_upgrade_with_2_bounces.from_version=3.9.1.metadata_quorum=COMBINED_KRAFT status: PASS run time: 4 minutes 17.310 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_compatibility_test.StreamsBrokerCompatibility.test_compatible_brokers_eos_disabled.broker_version=3.0.2.metadata_quorum=COMBINED_KRAFT status: PASS run time: 34.836 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_compatibility_test.StreamsBrokerCompatibility.test_compatible_brokers_eos_disabled.broker_version=4.0.0.metadata_quorum=COMBINED_KRAFT status: PASS run time: 28.831 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_compatibility_test.StreamsBrokerCompatibility.test_compatible_brokers_eos_v2_enabled.broker_version=3.9.1.metadata_quorum=COMBINED_KRAFT status: PASS run time: 29.998 seconds ---------------------------------------------------------------------------------------------------- ``` ``` ==================================================================================================== SESSION REPORT (ALL TESTS) ducktape version: 0.12.0 session_id: 2025-06-12--001 run time: 29 minutes 32.940 seconds tests run: 12 passed: 11 flaky: 0 failed: 0 ignored: 1 ==================================================================================================== test_id: kafkatest.tests.streams.streams_broker_bounce_test.StreamsBrokerBounceTest.test_all_brokers_bounce.failure_mode=clean_bounce.num_failures=3.metadata_quorum=ISOLATED_KRAFT.group_protocol=streams status: PASS run time: 5 minutes 31.371 seconds {"Client closed": "d07fdb5c-c5e8-49b9-8e9a-55af4fdc6ccb: SMOKE-TEST-CLIENT-CLOSED\n", "Records Delivered": "ALL-RECORDS-DELIVERED\n", "Logic Success/Failure": "FAILURE\n"} ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_application_upgrade_test.StreamsUpgradeTest.test_app_upgrade.from_version=3.2.3.bounce_type=full.metadata_quorum=COMBINED_KRAFT status: PASS run time: 1 minute 38.785 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_eos_test.StreamsEosTest.test_failure_and_recovery.metadata_quorum=COMBINED_KRAFT.group_protocol=streams status: PASS run time: 2 minutes 58.688 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_relational_smoke_test.StreamsRelationalSmokeTest.test_streams.crash=False.metadata_quorum=COMBINED_KRAFT.group_protocol=streams status: PASS run time: 2 minutes 6.090 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_smoke_test.StreamsSmokeTest.test_streams.processing_guarantee=exactly_once_v2.crash=True.metadata_quorum=COMBINED_KRAFT.group_protocol=classic status: PASS run time: 2 minutes 49.520 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_bounce_test.StreamsBrokerBounceTest.test_broker_type_bounce.failure_mode=clean_shutdown.broker_type=leader.num_threads=3.sleep_time_secs=120.metadata_quorum=COMBINED_KRAFT.group_protocol=streams status: PASS run time: 6 minutes 11.226 seconds {"Client closed": "8e64a617-4ce8-4842-b6f1-527b9edaa64e: SMOKE-TEST-CLIENT-CLOSED\n", "Records Delivered": "ALL-RECORDS-DELIVERED\n", "Logic Success/Failure": "FAILURE\n"} ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_bounce_test.StreamsBrokerBounceTest.test_broker_type_bounce_at_start.failure_mode=clean_shutdown.broker_type=controller.sleep_time_secs=0.metadata_quorum=COMBINED_KRAFT.group_protocol=streams status: IGNORE run time: 0.000 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_upgrade_test.StreamsUpgradeTest.test_rolling_upgrade_with_2_bounces.from_version=3.0.2.metadata_quorum=COMBINED_KRAFT status: PASS run time: 2 minutes 0.764 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_upgrade_test.StreamsUpgradeTest.test_rolling_upgrade_with_2_bounces.from_version=4.0.0.metadata_quorum=COMBINED_KRAFT status: PASS run time: 4 minutes 38.672 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_compatibility_test.StreamsBrokerCompatibility.test_compatible_brokers_eos_disabled.broker_version=3.1.2.metadata_quorum=COMBINED_KRAFT status: PASS run time: 32.210 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_compatibility_test.StreamsBrokerCompatibility.test_compatible_brokers_eos_v2_enabled.broker_version=3.0.2.metadata_quorum=COMBINED_KRAFT status: PASS run time: 33.888 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_compatibility_test.StreamsBrokerCompatibility.test_compatible_brokers_eos_v2_enabled.broker_version=4.0.0.metadata_quorum=COMBINED_KRAFT status: PASS run time: 30.135 seconds ---------------------------------------------------------------------------------------------------- ``` ``` ==================================================================================================== SESSION REPORT (ALL TESTS) ducktape version: 0.12.0 session_id: 2025-06-12--001 run time: 35 minutes 6.241 seconds tests run: 12 passed: 12 flaky: 0 failed: 0 ignored: 0 ==================================================================================================== test_id: kafkatest.tests.streams.streams_broker_bounce_test.StreamsBrokerBounceTest.test_all_brokers_bounce.failure_mode=hard_bounce.num_failures=3.metadata_quorum=ISOLATED_KRAFT.group_protocol=classic status: PASS run time: 5 minutes 48.951 seconds {"Client closed": "f51c5349-47b2-48f3-bc5f-beeab3c39455: SMOKE-TEST-CLIENT-CLOSED\n", "Records Delivered": "ALL-RECORDS-DELIVERED\n", "Logic Success/Failure": "FAILURE\n"} ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_bounce_test.StreamsBrokerBounceTest.test_many_brokers_bounce.failure_mode=clean_bounce.num_failures=2.metadata_quorum=ISOLATED_KRAFT.group_protocol=classic status: PASS run time: 5 minutes 49.610 seconds {"Client closed": "91d122c7-65d8-4ebf-8822-94eea6741ecd: SMOKE-TEST-CLIENT-CLOSED\n", "Records Delivered": "ALL-RECORDS-DELIVERED\n", "Logic Success/Failure": "FAILURE\n"} ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_application_upgrade_test.StreamsUpgradeTest.test_app_upgrade.from_version=3.3.2.bounce_type=full.metadata_quorum=COMBINED_KRAFT status: PASS run time: 1 minute 47.988 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_eos_test.StreamsEosTest.test_failure_and_recovery_complex.metadata_quorum=COMBINED_KRAFT.group_protocol=classic status: PASS run time: 2 minutes 58.806 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_relational_smoke_test.StreamsRelationalSmokeTest.test_streams.crash=True.metadata_quorum=COMBINED_KRAFT.group_protocol=classic status: PASS run time: 2 minutes 18.302 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_smoke_test.StreamsSmokeTest.test_streams.processing_guarantee=exactly_once_v2.crash=True.metadata_quorum=COMBINED_KRAFT.group_protocol=streams status: PASS run time: 2 minutes 59.635 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_bounce_test.StreamsBrokerBounceTest.test_broker_type_bounce.failure_mode=hard_bounce.broker_type=leader.num_threads=1.sleep_time_secs=120.metadata_quorum=COMBINED_KRAFT.group_protocol=classic status: PASS run time: 6 minutes 29.565 seconds {"Client closed": "e1ff3a9c-31ce-4da3-b162-e95c59e37ec8: SMOKE-TEST-CLIENT-CLOSED\n", "Records Delivered": "ALL-RECORDS-DELIVERED\n", "Logic Success/Failure": "FAILURE\n"} ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_down_resilience_test.StreamsBrokerDownResilience.test_streams_resilient_to_broker_down.metadata_quorum=COMBINED_KRAFT.group_protocol=classic status: PASS run time: 1 minute 54.374 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_upgrade_test.StreamsUpgradeTest.test_rolling_upgrade_with_2_bounces.from_version=3.1.2.metadata_quorum=COMBINED_KRAFT status: PASS run time: 2 minutes 12.133 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_upgrade_test.StreamsUpgradeTest.test_upgrade_downgrade_state_updater.from_version=3.2.3.upgrade=False.metadata_quorum=COMBINED_KRAFT status: PASS run time: 1 minute 28.804 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_compatibility_test.StreamsBrokerCompatibility.test_compatible_brokers_eos_disabled.broker_version=3.2.3.metadata_quorum=COMBINED_KRAFT status: PASS run time: 33.227 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_compatibility_test.StreamsBrokerCompatibility.test_compatible_brokers_eos_v2_enabled.broker_version=3.1.2.metadata_quorum=COMBINED_KRAFT status: PASS run time: 43.030 seconds ---------------------------------------------------------------------------------------------------- ``` ``` ==================================================================================================== SESSION REPORT (ALL TESTS) ducktape version: 0.12.0 session_id: 2025-06-12--001 run time: 35 minutes 47.791 seconds tests run: 12 passed: 12 flaky: 0 failed: 0 ignored: 0 ==================================================================================================== test_id: kafkatest.tests.streams.streams_broker_bounce_test.StreamsBrokerBounceTest.test_all_brokers_bounce.failure_mode=hard_bounce.num_failures=3.metadata_quorum=ISOLATED_KRAFT.group_protocol=streams status: PASS run time: 5 minutes 32.597 seconds {"Client closed": "0a22a994-a38b-491a-b7ba-770023a64850: SMOKE-TEST-CLIENT-CLOSED\n", "Records Delivered": "ALL-RECORDS-DELIVERED\n", "Logic Success/Failure": "FAILURE\n"} ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_bounce_test.StreamsBrokerBounceTest.test_many_brokers_bounce.failure_mode=clean_bounce.num_failures=2.metadata_quorum=ISOLATED_KRAFT.group_protocol=streams status: PASS run time: 5 minutes 36.944 seconds {"Client closed": "c45f9be3-ad93-4ae1-a8ea-cad0b892a8ae: SMOKE-TEST-CLIENT-CLOSED\n", "Records Delivered": "ALL-RECORDS-DELIVERED\n", "Logic Success/Failure": "FAILURE\n"} ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_standby_replica_test.StreamsStandbyTask.test_standby_tasks_rebalance.metadata_quorum=COMBINED_KRAFT.group_protocol=classic status: PASS run time: 4 minutes 49.970 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_application_upgrade_test.StreamsUpgradeTest.test_app_upgrade.from_version=3.4.1.bounce_type=full.metadata_quorum=COMBINED_KRAFT status: PASS run time: 1 minute 36.912 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_eos_test.StreamsEosTest.test_failure_and_recovery_complex.metadata_quorum=COMBINED_KRAFT.group_protocol=streams status: PASS run time: 3 minutes 0.832 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_relational_smoke_test.StreamsRelationalSmokeTest.test_streams.crash=True.metadata_quorum=COMBINED_KRAFT.group_protocol=streams status: PASS run time: 2 minutes 5.777 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_bounce_test.StreamsBrokerBounceTest.test_broker_type_bounce.failure_mode=hard_bounce.broker_type=leader.num_threads=1.sleep_time_secs=120.metadata_quorum=COMBINED_KRAFT.group_protocol=streams status: PASS run time: 6 minutes 13.263 seconds {"Client closed": "d485c89f-d90c-4b42-a19d-bb3443f3f48e: SMOKE-TEST-CLIENT-CLOSED\n", "Records Delivered": "ALL-RECORDS-DELIVERED\n", "Logic Success/Failure": "FAILURE\n"} ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_down_resilience_test.StreamsBrokerDownResilience.test_streams_resilient_to_broker_down.metadata_quorum=COMBINED_KRAFT.group_protocol=streams status: PASS run time: 2 minutes 27.931 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_upgrade_test.StreamsUpgradeTest.test_rolling_upgrade_with_2_bounces.from_version=3.2.3.metadata_quorum=COMBINED_KRAFT status: PASS run time: 2 minutes 1.310 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_upgrade_test.StreamsUpgradeTest.test_upgrade_downgrade_state_updater.from_version=3.2.3.upgrade=True.metadata_quorum=COMBINED_KRAFT status: PASS run time: 1 minute 21.078 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_compatibility_test.StreamsBrokerCompatibility.test_compatible_brokers_eos_disabled.broker_version=3.3.2.metadata_quorum=COMBINED_KRAFT status: PASS run time: 29.713 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_compatibility_test.StreamsBrokerCompatibility.test_compatible_brokers_eos_v2_enabled.broker_version=3.2.3.metadata_quorum=COMBINED_KRAFT status: PASS run time: 29.838 seconds ---------------------------------------------------------------------------------------------------- ``` </details> Executed the following command to rerun flaky tests, and all tests passed: ``` TC_PATHS="tests/kafkatest/tests/streams/streams_broker_bounce_test.py::StreamsBrokerBounceTest.test_broker_type_bounce tests/kafkatest/tests/streams/streams_broker_down_resilience_test.py::StreamsBrokerDownResilience.test_streams_should_failover_while_brokers_down" bash tests/docker/run_tests.sh ``` <details closed> <summary>Test summary, AC</summary> ``` ==================================================================================================== SESSION REPORT (ALL TESTS) ducktape version: 0.12.0 session_id: 2025-06-12--001 run time: 11 minutes 29.530 seconds tests run: 2 passed: 2 flaky: 0 failed: 0 ignored: 0 ==================================================================================================== test_id: kafkatest.tests.streams.streams_broker_bounce_test.StreamsBrokerBounceTest.test_broker_type_bounce.failure_mode=clean_bounce.broker_type=leader.num_threads=1.sleep_time_secs=120.metadata_quorum=COMBINED_KRAFT.group_protocol=classic status: PASS run time: 5 minutes 13.640 seconds {"Client closed": "8ff6ccba-773b-48ee-8259-1d4841c4072e: SMOKE-TEST-CLIENT-CLOSED\n", "Records Delivered": "ALL-RECORDS-DELIVERED\n", "Logic Success/Failure": "FAILURE\n"} ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_bounce_test.StreamsBrokerBounceTest.test_broker_type_bounce.failure_mode=hard_bounce.broker_type=leader.num_threads=3.sleep_time_secs=120.metadata_quorum=COMBINED_KRAFT.group_protocol=classic status: PASS run time: 6 minutes 15.567 seconds {"Client closed": "e1e01ed4-0aca-43e1-b8ac-66bfa4e9c94d: SMOKE-TEST-CLIENT-CLOSED\n", "Records Delivered": "ALL-RECORDS-DELIVERED\n", "Logic Success/Failure": "FAILURE\n"} ---------------------------------------------------------------------------------------------------- ``` ``` ==================================================================================================== SESSION REPORT (ALL TESTS) ducktape version: 0.12.0 session_id: 2025-06-12--001 run time: 11 minutes 25.627 seconds tests run: 2 passed: 2 flaky: 0 failed: 0 ignored: 0 ==================================================================================================== test_id: kafkatest.tests.streams.streams_broker_bounce_test.StreamsBrokerBounceTest.test_broker_type_bounce.failure_mode=clean_bounce.broker_type=leader.num_threads=1.sleep_time_secs=120.metadata_quorum=COMBINED_KRAFT.group_protocol=streams status: PASS run time: 5 minutes 14.931 seconds {"Client closed": "68252f1d-cfb8-4661-adda-7337e4871d51: SMOKE-TEST-CLIENT-CLOSED\n", "Records Delivered": "ALL-RECORDS-DELIVERED\n", "Logic Success/Failure": "FAILURE\n"} ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_bounce_test.StreamsBrokerBounceTest.test_broker_type_bounce.failure_mode=hard_bounce.broker_type=leader.num_threads=3.sleep_time_secs=120.metadata_quorum=COMBINED_KRAFT.group_protocol=streams status: PASS run time: 6 minutes 10.349 seconds {"Client closed": "4ad4c294-fb1a-4531-b5a1-864052b42d71: SMOKE-TEST-CLIENT-CLOSED\n", "Records Delivered": "ALL-RECORDS-DELIVERED\n", "Logic Success/Failure": "FAILURE\n"} ---------------------------------------------------------------------------------------------------- ``` ``` ==================================================================================================== SESSION REPORT (ALL TESTS) ducktape version: 0.12.0 session_id: 2025-06-12--001 run time: 11 minutes 25.674 seconds tests run: 2 passed: 2 flaky: 0 failed: 0 ignored: 0 ==================================================================================================== test_id: kafkatest.tests.streams.streams_broker_bounce_test.StreamsBrokerBounceTest.test_broker_type_bounce.failure_mode=clean_bounce.broker_type=leader.num_threads=3.sleep_time_secs=120.metadata_quorum=COMBINED_KRAFT.group_protocol=classic status: PASS run time: 5 minutes 15.559 seconds {"Client closed": "31d57670-706d-4d89-930e-639908682644: SMOKE-TEST-CLIENT-CLOSED\n", "Records Delivered": "ALL-RECORDS-DELIVERED\n", "Logic Success/Failure": "FAILURE\n"} ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_bounce_test.StreamsBrokerBounceTest.test_broker_type_bounce.failure_mode=hard_shutdown.broker_type=leader.num_threads=1.sleep_time_secs=120.metadata_quorum=COMBINED_KRAFT.group_protocol=classic status: PASS run time: 6 minutes 9.777 seconds {"Client closed": "a0cd90f7-283c-4533-a0c5-39674e73ac61: SMOKE-TEST-CLIENT-CLOSED\n", "Records Delivered": "ALL-RECORDS-DELIVERED\n", "Logic Success/Failure": "FAILURE\n"} ---------------------------------------------------------------------------------------------------- ``` ``` ==================================================================================================== SESSION REPORT (ALL TESTS) ducktape version: 0.12.0 session_id: 2025-06-12--001 run time: 11 minutes 24.328 seconds tests run: 2 passed: 2 flaky: 0 failed: 0 ignored: 0 ==================================================================================================== test_id: kafkatest.tests.streams.streams_broker_bounce_test.StreamsBrokerBounceTest.test_broker_type_bounce.failure_mode=clean_bounce.broker_type=leader.num_threads=3.sleep_time_secs=120.metadata_quorum=COMBINED_KRAFT.group_protocol=streams status: PASS run time: 5 minutes 13.092 seconds {"Client closed": "b7ebc7a1-2631-4d72-b125-dc83210f2e70: SMOKE-TEST-CLIENT-CLOSED\n", "Records Delivered": "ALL-RECORDS-DELIVERED\n", "Logic Success/Failure": "FAILURE\n"} ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_bounce_test.StreamsBrokerBounceTest.test_broker_type_bounce.failure_mode=hard_shutdown.broker_type=leader.num_threads=1.sleep_time_secs=120.metadata_quorum=COMBINED_KRAFT.group_protocol=streams status: PASS run time: 6 minutes 10.895 seconds {"Client closed": "75dd2e61-d9d4-48de-bf60-359701296765: SMOKE-TEST-CLIENT-CLOSED\n", "Records Delivered": "ALL-RECORDS-DELIVERED\n", "Logic Success/Failure": "FAILURE\n"} ---------------------------------------------------------------------------------------------------- ``` ``` ==================================================================================================== SESSION REPORT (ALL TESTS) ducktape version: 0.12.0 session_id: 2025-06-12--001 run time: 12 minutes 20.935 seconds tests run: 2 passed: 2 flaky: 0 failed: 0 ignored: 0 ==================================================================================================== test_id: kafkatest.tests.streams.streams_broker_bounce_test.StreamsBrokerBounceTest.test_broker_type_bounce.failure_mode=clean_shutdown.broker_type=leader.num_threads=1.sleep_time_secs=120.metadata_quorum=COMBINED_KRAFT.group_protocol=classic status: PASS run time: 6 minutes 11.460 seconds {"Client closed": "bd8af166-15ea-40ad-8c2b-9f82b2d349c0: SMOKE-TEST-CLIENT-CLOSED\n", "Records Delivered": "ALL-RECORDS-DELIVERED\n", "Logic Success/Failure": "FAILURE\n"} ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_bounce_test.StreamsBrokerBounceTest.test_broker_type_bounce.failure_mode=hard_shutdown.broker_type=leader.num_threads=3.sleep_time_secs=120.metadata_quorum=COMBINED_KRAFT.group_protocol=classic status: PASS run time: 6 minutes 9.132 seconds {"Client closed": "1329264a-fe06-4d4b-932f-6714cee1993f: SMOKE-TEST-CLIENT-CLOSED\n", "Records Delivered": "ALL-RECORDS-DELIVERED\n", "Logic Success/Failure": "FAILURE\n"} ---------------------------------------------------------------------------------------------------- ``` ``` ==================================================================================================== SESSION REPORT (ALL TESTS) ducktape version: 0.12.0 session_id: 2025-06-12--001 run time: 12 minutes 19.997 seconds tests run: 2 passed: 2 flaky: 0 failed: 0 ignored: 0 ==================================================================================================== test_id: kafkatest.tests.streams.streams_broker_bounce_test.StreamsBrokerBounceTest.test_broker_type_bounce.failure_mode=clean_shutdown.broker_type=leader.num_threads=1.sleep_time_secs=120.metadata_quorum=COMBINED_KRAFT.group_protocol=streams status: PASS run time: 6 minutes 11.284 seconds {"Client closed": "0db5e39d-e2ad-4abf-96c8-db5e22baa948: SMOKE-TEST-CLIENT-CLOSED\n", "Records Delivered": "ALL-RECORDS-DELIVERED\n", "Logic Success/Failure": "FAILURE\n"} ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_bounce_test.StreamsBrokerBounceTest.test_broker_type_bounce.failure_mode=hard_shutdown.broker_type=leader.num_threads=3.sleep_time_secs=120.metadata_quorum=COMBINED_KRAFT.group_protocol=streams status: PASS run time: 6 minutes 8.390 seconds {"Client closed": "8ee7f085-7a31-4ee1-a637-a42942425c22: SMOKE-TEST-CLIENT-CLOSED\n", "Records Delivered": "ALL-RECORDS-DELIVERED\n", "Logic Success/Failure": "FAILURE\n"} ---------------------------------------------------------------------------------------------------- ``` ``` ==================================================================================================== SESSION REPORT (ALL TESTS) ducktape version: 0.12.0 session_id: 2025-06-12--001 run time: 7 minutes 58.749 seconds tests run: 2 passed: 2 flaky: 0 failed: 0 ignored: 0 ==================================================================================================== test_id: kafkatest.tests.streams.streams_broker_down_resilience_test.StreamsBrokerDownResilience.test_streams_should_failover_while_brokers_down.metadata_quorum=COMBINED_KRAFT.group_protocol=classic status: PASS run time: 1 minute 49.473 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_bounce_test.StreamsBrokerBounceTest.test_broker_type_bounce.failure_mode=clean_shutdown.broker_type=leader.num_threads=3.sleep_time_secs=120.metadata_quorum=COMBINED_KRAFT.group_protocol=classic status: PASS run time: 6 minutes 8.951 seconds {"Client closed": "89f2e480-0b9e-4a0c-a708-581d44672aac: SMOKE-TEST-CLIENT-CLOSED\n", "Records Delivered": "ALL-RECORDS-DELIVERED\n", "Logic Success/Failure": "FAILURE\n"} ---------------------------------------------------------------------------------------------------- ``` ``` ==================================================================================================== SESSION REPORT (ALL TESTS) ducktape version: 0.12.0 session_id: 2025-06-12--001 run time: 7 minutes 38.649 seconds tests run: 2 passed: 2 flaky: 0 failed: 0 ignored: 0 ==================================================================================================== test_id: kafkatest.tests.streams.streams_broker_down_resilience_test.StreamsBrokerDownResilience.test_streams_should_failover_while_brokers_down.metadata_quorum=COMBINED_KRAFT.group_protocol=streams status: PASS run time: 1 minute 27.272 seconds ---------------------------------------------------------------------------------------------------- test_id: kafkatest.tests.streams.streams_broker_bounce_test.StreamsBrokerBounceTest.test_broker_type_bounce.failure_mode=clean_shutdown.broker_type=leader.num_threads=3.sleep_time_secs=120.metadata_quorum=COMBINED_KRAFT.group_protocol=streams status: PASS run time: 6 minutes 11.040 seconds {"Client closed": "420bda3a-d666-4962-af72-91c001b61e2c: SMOKE-TEST-CLIENT-CLOSED\n", "Records Delivered": "ALL-RECORDS-DELIVERED\n", "Logic Success/Failure": "FAILURE\n"} ---------------------------------------------------------------------------------------------------- ``` ``` ==================================================================================================== SESSION REPORT (ALL TESTS) ducktape version: 0.12.0 session_id: 2025-06-12--001 run time: 6 minutes 25.510 seconds tests run: 1 passed: 1 flaky: 0 failed: 0 ignored: 0 ==================================================================================================== test_id: kafkatest.tests.streams.streams_broker_bounce_test.StreamsBrokerBounceTest.test_broker_type_bounce.failure_mode=hard_bounce.broker_type=leader.num_threads=1.sleep_time_secs=120.metadata_quorum=COMBINED_KRAFT.group_protocol=classic status: PASS run time: 6 minutes 25.240 seconds {"Client closed": "b0f4bba0-13bf-4988-83a3-3fe9c1513711: SMOKE-TEST-CLIENT-CLOSED\n", "Records Delivered": "ALL-RECORDS-DELIVERED\n", "Logic Success/Failure": "FAILURE\n"} ---------------------------------------------------------------------------------------------------- ``` ``` ==================================================================================================== SESSION REPORT (ALL TESTS) ducktape version: 0.12.0 session_id: 2025-06-12--001 run time: 6 minutes 17.457 seconds tests run: 1 passed: 1 flaky: 0 failed: 0 ignored: 0 ==================================================================================================== test_id: kafkatest.tests.streams.streams_broker_bounce_test.StreamsBrokerBounceTest.test_broker_type_bounce.failure_mode=hard_bounce.broker_type=leader.num_threads=1.sleep_time_secs=120.metadata_quorum=COMBINED_KRAFT.group_protocol=streams status: PASS run time: 6 minutes 17.243 seconds {"Client closed": "2796eb44-c29e-4f3c-b13f-6d8e4c81c26c: SMOKE-TEST-CLIENT-CLOSED\n", "Records Delivered": "ALL-RECORDS-DELIVERED\n", "Logic Success/Failure": "FAILURE\n"} ---------------------------------------------------------------------------------------------------- ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org