gaborgsomogyi commented on issue #25853: [WIP][SPARK-21869][SS] Apply Apache Commons Pool to Kafka producer URL: https://github.com/apache/spark/pull/25853#issuecomment-541778927 The single node streaming test scenario can be found here: https://gist.github.com/gaborgsomogyi/a5ed370e009b65a716d85f642fad21d9 I've executed 50 times without the change and 50 times with the change. Both cases the execution time was between `24 and 32 seconds`. Without change average: `27.2 seconds` With change average: `27.7 seconds` So all in all I've measured the `new approach is ~1.83% slower`. Since the minimum and maximum execution time is floating heavily not sure how exact is this number. I've seen similar numbers when the number of processed data has been increased.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
