lianetm opened a new pull request, #21464: URL: https://github.com/apache/kafka/pull/21464
Fix to ensure consumer poll/committed do not fail fatally on retriable partition-level errors when fetching committed offsets for a topic that is not known to the GC. This issue didn't happen before using topic IDs on offset fetch, because when fetching with topic names the GC returns no error for unknown partitions (just includes offset -1). But with topic IDs (OffsetFetch v10+), if a topic is not known to the GC, the OffsetFetch response includes UNKNOWN_TOPIC_ID as error. The fix is to let poll/committed retry while there is time. If the error does not recover, fetch offsets still returns gracefully (offsets for the partitions that have, null for the partitions that were deleted). This keeps the contract of the committed API, and ensures poll uses the committed offsets available (it will use partition offsets for partitions that still need positions) Added integration tests that fail without the fix, to show the gaps. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
