[
https://issues.apache.org/jira/browse/KAFKA-10000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17163802#comment-17163802
]
Ning Zhang commented on KAFKA-10000:
------------------------------------
Hi Chris, the purpose of this ticket is very interesting. I wonder what is the
priority in the overall Kafka Connect backlog, or how is the progress so far
(needs-KIP)? Thanks
> Atomic commit of source connector records and offsets
> -----------------------------------------------------
>
> Key: KAFKA-10000
> URL: https://issues.apache.org/jira/browse/KAFKA-10000
> Project: Kafka
> Issue Type: New Feature
> Components: KafkaConnect
> Reporter: Chris Egerton
> Assignee: Chris Egerton
> Priority: Major
> Labels: needs-kip
>
> It'd be nice to be able to configure source connectors such that their
> offsets are committed if and only if all records up to that point have been
> ack'd by the producer. This would go a long way towards EOS for source
> connectors.
>
> This differs from https://issues.apache.org/jira/browse/KAFKA-6079, which is
> marked as {{WONTFIX}} since it only concerns enabling the idempotent producer
> for source connectors and is not concerned with source connector offsets.
> This also differs from https://issues.apache.org/jira/browse/KAFKA-6080,
> which had a lot of discussion around allowing connector-defined transaction
> boundaries. The suggestion in this ticket is to only use source connector
> offset commits as the transaction boundaries for connectors; allowing
> connector-specified transaction boundaries can be addressed separately.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
