[
https://issues.apache.org/jira/browse/KAFKA-10000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17566896#comment-17566896
]
Chris Egerton commented on KAFKA-10000:
---------------------------------------
Hi [~jagsancio]! We can keep it. All of the functional changes for this ticket
have been merged as well as integration tests for it; the only remaining PR is
one to add system tests: [https://github.com/apache/kafka/pull/11783], which
will likely be merged this week or next. If it makes for easier bookkeeping, I
can file a separate non-blocker ticket for those system tests and mark this one
done.
> Atomic commit of source connector records and offsets
> -----------------------------------------------------
>
> Key: KAFKA-10000
> URL: https://issues.apache.org/jira/browse/KAFKA-10000
> Project: Kafka
> Issue Type: New Feature
> Components: KafkaConnect
> Reporter: Chris Egerton
> Assignee: Chris Egerton
> Priority: Blocker
> Labels: needs-kip
> Fix For: 3.3.0
>
>
> It'd be nice to be able to configure source connectors such that their
> offsets are committed if and only if all records up to that point have been
> ack'd by the producer. This would go a long way towards EOS for source
> connectors.
>
> This differs from https://issues.apache.org/jira/browse/KAFKA-6079, which is
> marked as {{WONTFIX}} since it only concerns enabling the idempotent producer
> for source connectors and is not concerned with source connector offsets.
> This also differs from https://issues.apache.org/jira/browse/KAFKA-6080,
> which had a lot of discussion around allowing connector-defined transaction
> boundaries. The suggestion in this ticket is to only use source connector
> offset commits as the transaction boundaries for connectors; allowing
> connector-specified transaction boundaries can be addressed separately.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
