kowshik commented on pull request #10280: URL: https://github.com/apache/kafka/pull/10280#issuecomment-865332690
@junrao @dhruvilshah3 I ran a perf test against a Broker build with and without this PR. The test involved the following: 1. Created a test topic with 1 partition and replication factor 1 using the command: `$> ./bin/kafka-topics.sh --bootstrap-server localhost:9092 --create --topic kowshik-test-1 --partitions 1 --replication-factor 1`. 2. Ran `kafka-producer-perf-test.sh` to produce 10M messages each of size 1KB and with max producer throughput 100K to the above topic. Command: `$> ./bin/kafka-producer-perf-test.sh --num-records 10000000 --print-metrics --producer-props bootstrap.servers=localhost:9092 --record-size 1024 --throughput 100000 --topic kowshik-test-1`. 3. In parallel, ran `kafka-consumer-perf-test.sh` to consume the 10M messages that were produced in (2) using the command: `$> bin/kafka-consumer-perf-test.sh --topic kowshik-test-1 --bootstrap-server localhost:9092 --messages 10000000 --print-metrics --show-detailed-stats` The tests have similar results, meaning that the performance with and without this PR looks similar. Here are the results: **log.segment.bytes=10MB** - Without this PR on top of c333bfd41766bf33f41b5d32d8959ebbeff240b4: https://gist.github.com/kowshik/0ea1ae9ac8210f4bba49967727ddb475 - With this PR on top of c333bfd41766bf33f41b5d32d8959ebbeff240b4: https://gist.github.com/kowshik/c5ec0fb92679bd91613f520455446bf5 **log.segment.bytes=100MB** - Without this PR on top of c333bfd41766bf33f41b5d32d8959ebbeff240b4: https://gist.github.com/kowshik/2aaa7113fd05e10721c60aaf9bf8c654 - With this PR on top of c333bfd41766bf33f41b5d32d8959ebbeff240b4: https://gist.github.com/kowshik/b09882c2b13930be2efc69554c31aded **log.segment.bytes=1GB** - Without this PR on top of c333bfd41766bf33f41b5d32d8959ebbeff240b4: https://gist.github.com/kowshik/ea36153c9751180c5dbe383b189d50df - With this PR on top of c333bfd41766bf33f41b5d32d8959ebbeff240b4: https://gist.github.com/kowshik/133803d10d510df93f1d15858e91035a -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
