[
https://issues.apache.org/jira/browse/KAFKA-15402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17758966#comment-17758966
]
Benoit Delbosc edited comment on KAFKA-15402 at 8/25/23 8:50 AM:
-----------------------------------------------------------------
It appears that {{KafkaConsumer#close}} in 3.5.1 takes between 300 to 400
milliseconds while in 3.4.1 it is always below 10 milliseconds.
On a single unit test with 50 consumers this costs the 10 additional seconds,
on our CI pipeline an extra hour.
This regression is caused by the time spent on
{{{}AbstractFetch#maybeCloseFetchSessions{}}}, skipping this call - just for
testing purpose - does resolve the regression.
!image-2023-08-25-10-50-28-079.png!
was (Author: bdelbosc):
It appears that {{KafkaConsumer#close}} in 3.5.1 takes between 300 to 400
milliseconds while in 3.4.1 it is always below 10 milliseconds.
On a single unit test with 50 consumers this costs the 10 additional seconds,
on our CI pipeline an extra hour.
This regression is caused by the time spent on
{{AbstractFetch#maybeCloseFetchSessions}}, skipping this call - just for
testing purpose - does resolve the regression.
> Performance regression on close consumer after upgrading to 3.5.0
> -----------------------------------------------------------------
>
> Key: KAFKA-15402
> URL: https://issues.apache.org/jira/browse/KAFKA-15402
> Project: Kafka
> Issue Type: Bug
> Components: consumer, producer
> Affects Versions: 3.5.0, 3.5.1
> Reporter: Benoit Delbosc
> Priority: Major
> Attachments: image-2023-08-24-18-51-21-720.png,
> image-2023-08-24-18-51-57-435.png, image-2023-08-25-10-50-28-079.png
>
>
> Hi,
> After upgrading to Kafka client version 3.5.0, we have observed a significant
> increase in the duration of our Java unit tests. These unit tests heavily
> rely on the Kafka Admin, Producer, and Consumer API.
> When using Kafka server version 3.4.1, the duration of the unit tests
> increased from 8 seconds (with Kafka client 3.4.1) to 18 seconds (with Kafka
> client 3.5.0).
> Upgrading the Kafka server to 3.5.1 show similar results.
> I have come across the issue KAFKA-15178, which could be the culprit. I will
> attempt to test the proposed patch.
> In the meantime, if you have any ideas that could help identify and address
> the regression, please let me know.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
