[ 
https://issues.apache.org/jira/browse/KAFKA-13555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lorcan reassigned KAFKA-13555:
------------------------------

    Assignee: Lorcan

> Consider number if input topic partitions for task assignment
> -------------------------------------------------------------
>
>                 Key: KAFKA-13555
>                 URL: https://issues.apache.org/jira/browse/KAFKA-13555
>             Project: Kafka
>          Issue Type: Improvement
>          Components: streams
>            Reporter: Matthias J. Sax
>            Assignee: Lorcan
>            Priority: Major
>
> StreamsAssignor tries to distribute tasks evenly across all instances/threads 
> of a Kafka Streams application. It knows about instances/thread (to give more 
> capacity to instances with more thread), and it distinguishes between 
> stateless and stateful tasks. We also try to not move state around but to use 
> a sticky assignment if possible. However, the assignment does not take the 
> number of input topic partitions into account.
> For example, an upstream tasks could compute two joins, and thus has 3 input 
> partitions, while a downstream task compute a follow up aggregation with a 
> single input partitions (from the repartition topic). It could happen that 
> one thread gets the 3 input partition tasks assigned, while the other thread 
> get the single input partition tasks assigned resulting to an uneven 
> partition assignment across both threads.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to