[
https://issues.apache.org/jira/browse/FLINK-33681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17800174#comment-17800174
]
Zhanghao Chen commented on FLINK-33681:
---------------------------------------
After further investigation, it turned out that it is a bug introduced by
[FLINK-30536|https://issues.apache.org/jira/browse/FLINK-30536], which changed
the way to count task-level I/O metrics and accidentally stopped reusing
source/sink-writer operator I/O metrics for task I/O metrics. Converting the
issue to a bug.
> Display source/sink numRecordsIn/Out & numBytesIn/Out on UI
> -----------------------------------------------------------
>
> Key: FLINK-33681
> URL: https://issues.apache.org/jira/browse/FLINK-33681
> Project: Flink
> Issue Type: Improvement
> Components: Runtime / Metrics
> Reporter: Zhanghao Chen
> Priority: Major
> Attachments: image-2023-11-29-13-26-15-176.png
>
>
> Currently, the numRecordsIn & numBytesIn metrics for sources and the
> numRecordsOut & numBytesOut metrics for sinks are always 0 on the Flink web
> dashboard.
> [FLINK-11576|https://issues.apache.org/jira/browse/FLINK-11576] brings us
> these metrics on the opeartor level, but it does not integrate them on the
> task level. On the other hand, the summay metrics on the job overview page is
> based on the task level I/O metrics. As a result, even though new connectors
> supporting FLIP-33 metrics will report operator-level I/O metrics, we still
> cannot see the metrics on dashboard.
> This ticket serves as an umbrella issue to integrate standard source/sink I/O
> metrics with the corresponding task I/O metrics.
> !image-2023-11-29-13-26-15-176.png|width=590,height=252!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
