cadonna opened a new pull request, #12730: URL: https://github.com/apache/kafka/pull/12730
Updating the input partitions of tasks also updates the mapping from source nodes to input topics in the processor topology within the task. The mapping is updated with the topics from the topology metadata. The topology metadata does not prefix intermediate internal topics with the application ID. Thus, if a standby task has input partitions from an intermediate internal topic the update of the mapping in the processor topology leads to an invalid topology exception during recycling of a standby task to an active task when the input queues are created. This is because the input topics in the processor topology and the input partitions of the task do not match because the former miss the application ID prefix. The added verification to only update input partitions of standby tasks if they really changed avoids the invalid topology exception if the standby task only has input partitions from intermediate internal topics since they should never change. If the standby task has input partitions from intermediate internal topics and external topics subscribed to via a regex pattern, the invalid topology exception might still be triggered. ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify test coverage and CI build status - [ ] Verify documentation (including upgrade notes) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
