raphael auv created KAFKA-13136:
-----------------------------------
Summary: kafka-connect task.max : active task in consumer group is
limited by the bigger topic to consume
Key: KAFKA-13136
URL: https://issues.apache.org/jira/browse/KAFKA-13136
Project: Kafka
Issue Type: Improvement
Reporter: raphael auv
In kafka-connect 2.7
*The maximum number of active task for a sink connector is equal to the topic
with the biggest number of partitions to consume*
An active task is a task with partitions attributed in the consumer-group of
the sink connector
example :
With 2 topics where each have 10 partitions ( 20 partitions in total )
The maximum number of active task is 10 ( if I set task.max at 12 ,there is 10
members of the consumer group consuming partitions and 2 members in the
consumer-group that do not have partitions to consume).
If I add a third topic with 15 partitions to the connector conf then the 12
members of the consumer group are consuming partitions, and then if I set now
task.max at 17 only 15 members are active in the consumer-group.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
