[
https://issues.apache.org/jira/browse/KAFKA-15402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17758966#comment-17758966
]
Benoit Delbosc commented on KAFKA-15402:
----------------------------------------
It appears that {{KafkaConsumer#close}} in 3.5.1 takes between 300 to 400
milliseconds while in 3.4.1 it is always below 10 milliseconds.
On a single unit test with 50 consumers this costs the 10 additional seconds,
on our CI pipeline an extra hour.
This regression is caused by the time spent on
{{AbstractFetch#maybeCloseFetchSessions}}, skipping this call - just for
testing purpose - does resolve the regression.
> Performance Regression after Upgrading to 3.5.0
> -----------------------------------------------
>
> Key: KAFKA-15402
> URL: https://issues.apache.org/jira/browse/KAFKA-15402
> Project: Kafka
> Issue Type: Bug
> Components: consumer, producer
> Affects Versions: 3.5.0, 3.5.1
> Reporter: Benoit Delbosc
> Priority: Major
> Attachments: image-2023-08-24-18-51-21-720.png,
> image-2023-08-24-18-51-57-435.png
>
>
> Hi,
> After upgrading to Kafka client version 3.5.0, we have observed a significant
> increase in the duration of our Java unit tests. These unit tests heavily
> rely on the Kafka Admin, Producer, and Consumer API.
> When using Kafka server version 3.4.1, the duration of the unit tests
> increased from 8 seconds (with Kafka client 3.4.1) to 18 seconds (with Kafka
> client 3.5.0).
> Similarly, when using Kafka server version 3.5.1, the duration of the unit
> tests increased from 16 seconds (with Kafka client 3.4.1) to 25 seconds (with
> Kafka client 3.5.0).
> The performance regression is observed when either the client or server is
> upgraded to version 3.5.0 (or 3.5.1).
> I have come across the issue KAFKA-15178, which could be the culprit. I will
> attempt to test the proposed patch.
> In the meantime, if you have any ideas that could help identify and address
> the regression, please let me know.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
