[
https://issues.apache.org/jira/browse/KAFKA-13772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Feiyan Yu updated KAFKA-13772:
------------------------------
Description:
The method 'resizeThreadPool' is suppose to redistributed all topic partitions
to threads based on the new thread number, and they should be distributed
evenly.
However, the resizing process which has a logic to add fetcher to
'fetcherThreadMap' is within the iteration of 'fetcherThreadMap' all fetchers,
which could lead to skipping some fetchers and these fetchers remain their
topic partition assignment.
The affected scenario: someone wants to add threads to improve fetch-thread
performance(eg. replica fetch threads), but the performance improvement is not
as expect.
was:
The method 'resizeThreadPool' is suppose to redistributed all topic partitions
to threads based on the new thread number, and they should be distributed
evenly.
However, the resizing process which has a logic to add fetcher to
'fetcherThreadMap' is within the iteration of 'fetcherThreadMap' all fetchers,
which could lead to skipping some fetchers and these fetchers remain their
topic partition assignment.
The affected senario is
> Unevenly distribute topic partitions for threads after resizing thread number
> ------------------------------------------------------------------------------
>
> Key: KAFKA-13772
> URL: https://issues.apache.org/jira/browse/KAFKA-13772
> Project: Kafka
> Issue Type: Bug
> Components: core
> Affects Versions: 1.1.0, 3.0.1
> Reporter: Feiyan Yu
> Priority: Minor
> Fix For: 3.3.0
>
>
> The method 'resizeThreadPool' is suppose to redistributed all topic
> partitions to threads based on the new thread number, and they should be
> distributed evenly.
>
> However, the resizing process which has a logic to add fetcher to
> 'fetcherThreadMap' is within the iteration of 'fetcherThreadMap' all
> fetchers, which could lead to skipping some fetchers and these fetchers
> remain their topic partition assignment.
>
> The affected scenario: someone wants to add threads to improve fetch-thread
> performance(eg. replica fetch threads), but the performance improvement is
> not as expect.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
