TheKnowles opened a new pull request #11382: URL: https://github.com/apache/kafka/pull/11382
This change allows Source Tasks the option to receive Producer Exceptions and decide what to do with them. Currently the task is just killed if the producer throws an exception via its callback. Subclasses of SourceTask can override ignoreNonRetriableProducerException(), returning true if Connect should simply ignore this record and continue processing. This is helpful is cases where we may want to write off a portion of the record/metadata (if it is too large to write) or log and continue processing rather than dying. A unit test has been added to validate the producer callback for failure being invoked. The sourceTask will ignore the exception and the task will not be killed. ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify test coverage and CI build status - [ ] Verify documentation (including upgrade notes) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
