Re: [PR] KAFKA-19735: Add automatic commit offset caching in subscribe mode [kafka]

[via GitHub]

TaiJuWu commented on PR #20669:
URL: https://github.com/apache/kafka/pull/20669#issuecomment-3385877424

   > @TaiJuWu I conducted a simple benchmark test. First, I launched a cluster 
consisting of 3 brokers, then created a topic with 12 partitions named topic12 
using the following command:
   > 
   > ```
   > sh kafka-topics.sh --bootstrap-server 10.255.225.107:9092 --create --topic 
topic12 --partitions 12 --replication-factor 2
   > ```
   > 
   > Next, I sent a sufficient amount of data to topic12—each message was 1MB, 
with a total size of approximately 100GB. After that, I performed consumer 
stress tests using the trunk branch and the 19735 branch respectively, using 
the command:
   > 
   > ```
   > sh kafka-consumer-perf-test.sh --bootstrap-server 10.255.225.107:9092 
--topic topic12 --command-property auto.offset.reset=earliest --num-records 
1000000 --group groupXX
   > ```
   > 
   > The aggregated consumer throughput results are as follows:
   > 
   > <img alt="image" width="1096" height="560" 
src="https://private-user-images.githubusercontent.com/19780771/499366720-be6a45df-6f61-47f6-b30a-eede1ed42b64.png?jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3NjAwMTYzMDAsIm5iZiI6MTc2MDAxNjAwMCwicGF0aCI6Ii8xOTc4MDc3MS80OTkzNjY3MjAtYmU2YTQ1ZGYtNmY2MS00N2Y2LWIzMGEtZWVkZTFlZDQyYjY0LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTEwMDklMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUxMDA5VDEzMjAwMFomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTBjNGVhOGMwNTVhNWEyZjQxZWRjMTQwM2E4OWI1NTUwODUzODQ1MmMxOWZiZTY0MWM4MjIxNWUzYWY5ZjhiZDkmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.swRMkN8TI6-pGkIrD9daz4fLOLSFMfRqkQbRHh1N_xM";>
   > The performance of the two is nearly identical.
   
   The result LGTM. Thanks for your sharing and hard work.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org