[
https://issues.apache.org/jira/browse/KAFKA-7815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16745281#comment-16745281
]
Jordan Moore commented on KAFKA-7815:
-------------------------------------
So, I was thinking about putting something like "recordLogged" as well into a
SinkTasks - a callback that the record reached the sink.
I understand that might need a new KIP, but I feel like the scope might be able
to be expanded to include that?
One use case - HDFS / S3 Connector, when a file is written, I want a callback
to register a Hive Metastore partition.
> SourceTask should expose ACK'd offsets, metadata
> ------------------------------------------------
>
> Key: KAFKA-7815
> URL: https://issues.apache.org/jira/browse/KAFKA-7815
> Project: Kafka
> Issue Type: Improvement
> Components: KafkaConnect
> Reporter: Ryanne Dolan
> Assignee: Ryanne Dolan
> Priority: Minor
> Fix For: 2.2.0
>
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> Add a new callback method, recordLogged(), to notify SourceTasks when a
> record is ACK'd by the downstream broker. Include offsets and metadata of
> ACK'd record.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
