[
https://issues.apache.org/jira/browse/KAFKA-15402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17762453#comment-17762453
]
Benoit Delbosc commented on KAFKA-15402:
----------------------------------------
I think that the main problem lies in the slow performance of the
maybeCloseFetchSessions method. It is not simply a matter of an additional
round trip, which should only take a few milliseconds. I have added a timer
around this method, and it consistently shows a duration around 300
milliseconds. This aligns with the observed slowness of ~10 seconds when
closing 50 consumers.
I agree that closing consumers is rather infrequent in a production but we have
numerous unit tests that stress this code path, It is possible that this issue
is also noticeable in your CI pipeline. It could be easy to comment the method
and see if you observe a gain.
> Performance regression on close consumer after upgrading to 3.5.0
> -----------------------------------------------------------------
>
> Key: KAFKA-15402
> URL: https://issues.apache.org/jira/browse/KAFKA-15402
> Project: Kafka
> Issue Type: Bug
> Components: consumer
> Affects Versions: 3.5.0, 3.5.1
> Reporter: Benoit Delbosc
> Priority: Major
> Attachments: image-2023-08-24-18-51-21-720.png,
> image-2023-08-24-18-51-57-435.png, image-2023-08-25-10-50-28-079.png
>
>
> Hi,
> After upgrading to Kafka client version 3.5.0, we have observed a significant
> increase in the duration of our Java unit tests. These unit tests heavily
> rely on the Kafka Admin, Producer, and Consumer API.
> When using Kafka server version 3.4.1, the duration of the unit tests
> increased from 8 seconds (with Kafka client 3.4.1) to 18 seconds (with Kafka
> client 3.5.0).
> Upgrading the Kafka server to 3.5.1 show similar results.
> I have come across the issue KAFKA-15178, which could be the culprit. I will
> attempt to test the proposed patch.
> In the meantime, if you have any ideas that could help identify and address
> the regression, please let me know.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
