majialoong commented on PR #23334:
URL: https://github.com/apache/kafka/pull/23334#issuecomment-5513036208
Tested locally after passing `compression.type` through `settings`:
```
TC_PATHS='tests/kafkatest/benchmarks/core/benchmark_test.py::Benchmark.test_end_to_end_latency
tests/kafkatest/sanity_checks/test_performance_services.py' \
REBUILD=t \
bash tests/docker/run_tests.sh
```
Result:
```
================================================================================
SESSION REPORT (ALL TESTS)
ducktape version: 0.14.0
session_id: 2026-09-02--003
run time: 20 minutes 57.514 seconds
tests run: 24
passed: 24
flaky: 0
failed: 0
ignored: 0
================================================================================
test_id:
kafkatest.benchmarks.core.benchmark_test.Benchmark.test_end_to_end_latency.security_protocol=PLAINTEXT.compression_type=none.metadata_quorum=ISOLATED_KRAFT.group_protocol=classic
status: PASS
run time: 48.136 seconds
{"latency_50th_ms": 0.0, "latency_99th_ms": 2.0, "latency_999th_ms": 6.0}
--------------------------------------------------------------------------------
test_id:
kafkatest.benchmarks.core.benchmark_test.Benchmark.test_end_to_end_latency.security_protocol=PLAINTEXT.compression_type=none.metadata_quorum=ISOLATED_KRAFT.group_protocol=consumer
status: PASS
run time: 47.419 seconds
{"latency_50th_ms": 0.0, "latency_99th_ms": 2.0, "latency_999th_ms": 5.0}
--------------------------------------------------------------------------------
test_id:
kafkatest.benchmarks.core.benchmark_test.Benchmark.test_end_to_end_latency.security_protocol=PLAINTEXT.compression_type=snappy.metadata_quorum=ISOLATED_KRAFT.group_protocol=classic
status: PASS
run time: 48.119 seconds
{"latency_50th_ms": 0.0, "latency_99th_ms": 2.0, "latency_999th_ms": 4.0}
--------------------------------------------------------------------------------
test_id:
kafkatest.benchmarks.core.benchmark_test.Benchmark.test_end_to_end_latency.security_protocol=PLAINTEXT.compression_type=snappy.metadata_quorum=ISOLATED_KRAFT.group_protocol=consumer
status: PASS
run time: 47.421 seconds
{"latency_50th_ms": 0.0, "latency_99th_ms": 2.0, "latency_999th_ms": 5.0}
--------------------------------------------------------------------------------
test_id:
kafkatest.benchmarks.core.benchmark_test.Benchmark.test_end_to_end_latency.security_protocol=SASL_PLAINTEXT.compression_type=none.metadata_quorum=ISOLATED_KRAFT.group_protocol=classic
status: PASS
run time: 59.238 seconds
{"latency_50th_ms": 0.0, "latency_99th_ms": 3.0, "latency_999th_ms": 6.0}
--------------------------------------------------------------------------------
test_id:
kafkatest.benchmarks.core.benchmark_test.Benchmark.test_end_to_end_latency.security_protocol=SASL_PLAINTEXT.compression_type=none.metadata_quorum=ISOLATED_KRAFT.group_protocol=consumer
status: PASS
run time: 58.859 seconds
{"latency_50th_ms": 0.0, "latency_99th_ms": 4.0, "latency_999th_ms": 7.0}
--------------------------------------------------------------------------------
test_id:
kafkatest.benchmarks.core.benchmark_test.Benchmark.test_end_to_end_latency.security_protocol=SASL_PLAINTEXT.compression_type=snappy.metadata_quorum=ISOLATED_KRAFT.group_protocol=classic
status: PASS
run time: 1 minute 1.894 seconds
{"latency_50th_ms": 0.0, "latency_99th_ms": 3.0, "latency_999th_ms": 7.0}
--------------------------------------------------------------------------------
test_id:
kafkatest.benchmarks.core.benchmark_test.Benchmark.test_end_to_end_latency.security_protocol=SASL_PLAINTEXT.compression_type=snappy.metadata_quorum=ISOLATED_KRAFT.group_protocol=consumer
status: PASS
run time: 1 minute 3.564 seconds
{"latency_50th_ms": 0.0, "latency_99th_ms": 4.0, "latency_999th_ms": 8.0}
--------------------------------------------------------------------------------
test_id:
kafkatest.benchmarks.core.benchmark_test.Benchmark.test_end_to_end_latency.security_protocol=SASL_SSL.compression_type=none.metadata_quorum=ISOLATED_KRAFT.group_protocol=classic
status: PASS
run time: 1 minute 9.773 seconds
{"latency_50th_ms": 0.0, "latency_99th_ms": 4.0, "latency_999th_ms": 10.0}
--------------------------------------------------------------------------------
test_id:
kafkatest.benchmarks.core.benchmark_test.Benchmark.test_end_to_end_latency.security_protocol=SASL_SSL.compression_type=none.metadata_quorum=ISOLATED_KRAFT.group_protocol=consumer
status: PASS
run time: 1 minute 9.800 seconds
{"latency_50th_ms": 0.0, "latency_99th_ms": 4.0, "latency_999th_ms": 8.0}
--------------------------------------------------------------------------------
test_id:
kafkatest.benchmarks.core.benchmark_test.Benchmark.test_end_to_end_latency.security_protocol=SASL_SSL.compression_type=snappy.metadata_quorum=ISOLATED_KRAFT.group_protocol=classic
status: PASS
run time: 1 minute 5.864 seconds
{"latency_50th_ms": 0.0, "latency_99th_ms": 4.0, "latency_999th_ms": 9.0}
--------------------------------------------------------------------------------
test_id:
kafkatest.benchmarks.core.benchmark_test.Benchmark.test_end_to_end_latency.security_protocol=SASL_SSL.compression_type=snappy.metadata_quorum=ISOLATED_KRAFT.group_protocol=consumer
status: PASS
run time: 1 minute 6.804 seconds
{"latency_50th_ms": 0.0, "latency_99th_ms": 5.0, "latency_999th_ms": 9.0}
--------------------------------------------------------------------------------
test_id:
kafkatest.benchmarks.core.benchmark_test.Benchmark.test_end_to_end_latency.security_protocol=SSL.interbroker_security_protocol=PLAINTEXT.tls_version=TLSv1.2.compression_type=none.metadata_quorum=ISOLATED_KRAFT.group_protocol=classic
status: PASS
run time: 53.779 seconds
{"latency_50th_ms": 0.0, "latency_99th_ms": 3.0, "latency_999th_ms": 6.0}
--------------------------------------------------------------------------------
test_id:
kafkatest.benchmarks.core.benchmark_test.Benchmark.test_end_to_end_latency.security_protocol=SSL.interbroker_security_protocol=PLAINTEXT.tls_version=TLSv1.2.compression_type=none.metadata_quorum=ISOLATED_KRAFT.group_protocol=consumer
status: PASS
run time: 53.082 seconds
{"latency_50th_ms": 0.0, "latency_99th_ms": 3.0, "latency_999th_ms": 9.0}
--------------------------------------------------------------------------------
test_id:
kafkatest.benchmarks.core.benchmark_test.Benchmark.test_end_to_end_latency.security_protocol=SSL.interbroker_security_protocol=PLAINTEXT.tls_version=TLSv1.2.compression_type=snappy.metadata_quorum=ISOLATED_KRAFT.group_protocol=classic
status: PASS
run time: 55.309 seconds
{"latency_50th_ms": 0.0, "latency_99th_ms": 3.0, "latency_999th_ms": 13.0}
--------------------------------------------------------------------------------
test_id:
kafkatest.benchmarks.core.benchmark_test.Benchmark.test_end_to_end_latency.security_protocol=SSL.interbroker_security_protocol=PLAINTEXT.tls_version=TLSv1.2.compression_type=snappy.metadata_quorum=ISOLATED_KRAFT.group_protocol=consumer
status: PASS
run time: 53.865 seconds
{"latency_50th_ms": 0.0, "latency_99th_ms": 4.0, "latency_999th_ms": 7.0}
--------------------------------------------------------------------------------
test_id:
kafkatest.benchmarks.core.benchmark_test.Benchmark.test_end_to_end_latency.security_protocol=SSL.interbroker_security_protocol=PLAINTEXT.tls_version=TLSv1.3.compression_type=none.metadata_quorum=ISOLATED_KRAFT.group_protocol=classic
status: PASS
run time: 53.357 seconds
{"latency_50th_ms": 0.0, "latency_99th_ms": 3.0, "latency_999th_ms": 6.0}
--------------------------------------------------------------------------------
test_id:
kafkatest.benchmarks.core.benchmark_test.Benchmark.test_end_to_end_latency.security_protocol=SSL.interbroker_security_protocol=PLAINTEXT.tls_version=TLSv1.3.compression_type=none.metadata_quorum=ISOLATED_KRAFT.group_protocol=consumer
status: PASS
run time: 52.981 seconds
{"latency_50th_ms": 0.0, "latency_99th_ms": 3.0, "latency_999th_ms": 7.0}
--------------------------------------------------------------------------------
test_id:
kafkatest.benchmarks.core.benchmark_test.Benchmark.test_end_to_end_latency.security_protocol=SSL.interbroker_security_protocol=PLAINTEXT.tls_version=TLSv1.3.compression_type=snappy.metadata_quorum=ISOLATED_KRAFT.group_protocol=classic
status: PASS
run time: 55.256 seconds
{"latency_50th_ms": 0.0, "latency_99th_ms": 7.0, "latency_999th_ms": 16.0}
--------------------------------------------------------------------------------
test_id:
kafkatest.benchmarks.core.benchmark_test.Benchmark.test_end_to_end_latency.security_protocol=SSL.interbroker_security_protocol=PLAINTEXT.tls_version=TLSv1.3.compression_type=snappy.metadata_quorum=ISOLATED_KRAFT.group_protocol=consumer
status: PASS
run time: 51.988 seconds
{"latency_50th_ms": 0.0, "latency_99th_ms": 3.0, "latency_999th_ms": 7.0}
--------------------------------------------------------------------------------
test_id:
kafkatest.sanity_checks.test_performance_services.PerformanceServiceTest.test_version.version=2.1.1.metadata_quorum=COMBINED_KRAFT
status: PASS
run time: 22.472 seconds
{"producer_performance": {"records_per_sec": 65789.473684, "mb_per_sec":
6.27}, "end_to_end_latency": {"latency_50th_ms": 0.0, "latency_99th_ms": 1.0,
"latency_999th_ms": 2.0}, "consumer_performance": {"records_per_sec":
56892.0455, "mb_per_sec": 5.4201}}
--------------------------------------------------------------------------------
test_id:
kafkatest.sanity_checks.test_performance_services.PerformanceServiceTest.test_version.version=2.1.1.metadata_quorum=ISOLATED_KRAFT
status: PASS
run time: 27.123 seconds
{"producer_performance": {"records_per_sec": 63291.139241, "mb_per_sec":
6.04}, "end_to_end_latency": {"latency_50th_ms": 0.0, "latency_99th_ms": 1.0,
"latency_999th_ms": 2.0}, "consumer_performance": {"records_per_sec":
57245.7143, "mb_per_sec": 5.4516}}
--------------------------------------------------------------------------------
test_id:
kafkatest.sanity_checks.test_performance_services.PerformanceServiceTest.test_version.version=dev.metadata_quorum=COMBINED_KRAFT
status: PASS
run time: 31.505 seconds
{"producer_performance": {"records_per_sec": 42372.881356, "mb_per_sec":
4.04}, "end_to_end_latency": {"latency_50th_ms": 0.0, "latency_99th_ms": 1.0,
"latency_999th_ms": 2.0}, "consumer_performance": {"records_per_sec":
37134.7518, "mb_per_sec": 3.4153}, "share_consumer_performance":
{"records_per_sec": 3092.7033, "mb_per_sec": 0.2872}}
--------------------------------------------------------------------------------
test_id:
kafkatest.sanity_checks.test_performance_services.PerformanceServiceTest.test_version.version=dev.metadata_quorum=ISOLATED_KRAFT
status: PASS
run time: 36.852 seconds
{"producer_performance": {"records_per_sec": 40160.64257, "mb_per_sec":
3.83}, "end_to_end_latency": {"latency_50th_ms": 0.0, "latency_99th_ms": 1.0,
"latency_999th_ms": 2.0}, "consumer_performance": {"records_per_sec":
37534.0502, "mb_per_sec": 3.4521}, "share_consumer_performance":
{"records_per_sec": 3090.8548, "mb_per_sec": 0.2871}}
--------------------------------------------------------------------------------
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
