[
https://issues.apache.org/jira/browse/KAFKA-9989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17106853#comment-17106853
]
Boyang Chen commented on KAFKA-9989:
------------------------------------
Looks like it is determined by the assignor: (the latest added consumer gets 0
partition assigned)
[2020-05-07 07:53:15,487] DEBUG stream-thread
[StreamsUpgradeTest-0626d80d-03ed-4cf9-95a2-d778a791394f-StreamThread-1-consumer]
Assigning tasks [0_0, 0_1, 0_2, 0_3, 0_4] to clients
\{0626d80d-03ed-4cf9-95a2-d778a791394f=[activeTasks: ([]) standbyTasks: ([])
assignedTasks: ([]) prevActiveTasks: ([0_1, 0_3]) prevStandbyTasks: ([])
prevAssignedTasks: ([0_1, 0_3]) prevOwnedPartitionsByConsumerId: ([data-1,
data-3]) changelogOffsetTotalsByTask: ([]) capacity: 1],
3405b9f3-7f28-454a-9a00-906f8c1b520f=[activeTasks: ([]) standbyTasks: ([])
assignedTasks: ([]) prevActiveTasks: ([]) prevStandbyTasks: ([])
prevAssignedTasks: ([]) prevOwnedPartitionsByConsumerId: ([])
changelogOffsetTotalsByTask: ([]) capacity: 1],
8611ff87-6782-4c27-b93e-c145b0bacccd=[activeTasks: ([]) standbyTasks: ([])
assignedTasks: ([]) prevActiveTasks: ([0_0, 0_2, 0_4]) prevStandbyTasks: ([])
prevAssignedTasks: ([0_0, 0_2, 0_4]) prevOwnedPartitionsByConsumerId: ([data-0,
data-2, data-4]) changelogOffsetTotalsByTask: ([]) capacity: 1]} with number of
replicas 0
(org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor)
[2020-05-07 07:53:15,487] DEBUG [AdminClient
clientId=StreamsUpgradeTest-0626d80d-03ed-4cf9-95a2-d778a791394f-admin] Sending
MetadataRequestData(topics=[], allowAutoTopicCreation=false,
includeClusterAuthorizedOperations=false,
includeTopicAuthorizedOperations=false) to worker2:9092 (id: 1 rack: null).
correlationId=7 (org.apache.kafka.clients.admin.KafkaAdminClient)
[2020-05-07 07:53:15,487] INFO stream-thread
[StreamsUpgradeTest-0626d80d-03ed-4cf9-95a2-d778a791394f-StreamThread-1-consumer]
Assigned tasks to clients as
0626d80d-03ed-4cf9-95a2-d778a791394f=[activeTasks: ([0_1, 0_3]) standbyTasks:
([]) assignedTasks: ([0_1, 0_3]) prevActiveTasks: ([0_1, 0_3])
prevStandbyTasks: ([]) prevAssignedTasks: ([0_1, 0_3])
prevOwnedPartitionsByConsumerId: ([data-1, data-3])
changelogOffsetTotalsByTask: ([]) capacity: 1]
3405b9f3-7f28-454a-9a00-906f8c1b520f=[activeTasks: ([]) standbyTasks: ([])
assignedTasks: ([]) prevActiveTasks: ([]) prevStandbyTasks: ([])
prevAssignedTasks: ([]) prevOwnedPartitionsByConsumerId: ([])
changelogOffsetTotalsByTask: ([]) capacity: 1]
8611ff87-6782-4c27-b93e-c145b0bacccd=[activeTasks: ([0_0, 0_2, 0_4])
standbyTasks: ([]) assignedTasks: ([0_0, 0_2, 0_4]) prevActiveTasks: ([0_0,
0_2, 0_4]) prevStandbyTasks: ([]) prevAssignedTasks: ([0_0, 0_2, 0_4])
prevOwnedPartitionsByConsumerId: ([data-0, data-2, data-4])
changelogOffsetTotalsByTask: ([]) capacity: 1].
(org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor)
> StreamsUpgradeTest.test_metadata_upgrade could not guarantee all processor
> gets assigned task
> ---------------------------------------------------------------------------------------------
>
> Key: KAFKA-9989
> URL: https://issues.apache.org/jira/browse/KAFKA-9989
> Project: Kafka
> Issue Type: Bug
> Components: streams, system tests
> Reporter: Boyang Chen
> Assignee: Boyang Chen
> Priority: Major
>
> System test StreamsUpgradeTest.test_metadata_upgrade could fail due to:
> "Never saw output 'processed [0-9]* records' on ubuntu@worker6"
> which if we take a closer look at, the rebalance happens but has no task
> assignment. We should fix this problem by making the rebalance result as part
> of the check, and skip the record processing validation when the assignment
> is empty.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
