[
https://issues.apache.org/jira/browse/FLINK-26126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17492390#comment-17492390
]
Hang Ruan commented on FLINK-26126:
-----------------------------------
The Kafka sink is already using the sink v2 interface in the master branch.
I think it should be fixed before the release. Am I right? Or do I need to
change the priority?
CC: [~fpaul]
> Sink V2 will cause error numRecordsOut metric
> ---------------------------------------------
>
> Key: FLINK-26126
> URL: https://issues.apache.org/jira/browse/FLINK-26126
> Project: Flink
> Issue Type: Bug
> Components: Connectors / Kafka
> Affects Versions: 1.15.0
> Reporter: Hang Ruan
> Priority: Blocker
>
> We found that the new sink v2 interface will have a wrong numRecordsOut
> metric for the sink writers. We send a fixed number of records to the source,
> but the numRecordsOut of the sink continues to increase by the time.
> The problem lies in the method `emitCommittables` in the class
> `SinkWriterOperator`. The field `output` in its parent class
> `AbstractStreamOperator` uses the same counter object as the `KafkaWriter`.
> It will cause the numRecordsOut increasing when doing the checkpoint.
> I found this problem when we implement the metric test in the testframe, now
> I disable this metric test in the
> [PR|https://github.com/apache/flink/pull/18496] We could reopen this test
> case after the fix.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
