philipnee opened a new pull request, #12619: URL: https://github.com/apache/kafka/pull/12619
In KAFKA-14196 we discovered that rebalance can possibly causes some of the fetched offset being lost when autocommit was enabled, and thus causing duplication. The reason being the fetcher continues to make progress while the async commit is trying to complete. Our solution is to mark consumer partitions unconsumable, to stop the fetcher. ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify test coverage and CI build status - [ ] Verify documentation (including upgrade notes) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
