[ https://issues.apache.org/jira/browse/FLINK-33681 ]


    Zhanghao Chen deleted comment on FLINK-33681:
    ---------------------------------------

was (Author: zhanghao chen):
After further investigation, it turned out to be a bug introduced by 
FLINK-30536, which changed the way to count task-level I/O metrics and 
accidentally stopped reusing source/sink-writer operator I/O metrics for task 
I/O metrics. Converting the issue to a bug.

> Display source/sink numRecordsIn/Out & numBytesIn/Out on UI
> -----------------------------------------------------------
>
>                 Key: FLINK-33681
>                 URL: https://issues.apache.org/jira/browse/FLINK-33681
>             Project: Flink
>          Issue Type: Bug
>          Components: Runtime / Metrics
>    Affects Versions: 1.18.0, 1.17.2
>            Reporter: Zhanghao Chen
>            Priority: Major
>         Attachments: image-2023-11-29-13-26-15-176.png
>
>
> Currently, the numRecordsIn & numBytesIn metrics for sources and the 
> numRecordsOut & numBytesOut metrics for sinks are always 0 on the Flink web 
> dashboard.
> [FLINK-11576|https://issues.apache.org/jira/browse/FLINK-11576] brings us 
> these metrics on the opeartor level, but it does not integrate them on the 
> task level. On the other hand, the summay metrics on the job overview page is 
> based on the task level I/O metrics. As a result, even though new connectors 
> supporting FLIP-33 metrics will report operator-level I/O metrics, we still 
> cannot see the metrics on dashboard.
> This ticket serves as an umbrella issue to integrate standard source/sink I/O 
> metrics with the corresponding task I/O metrics. 
> !image-2023-11-29-13-26-15-176.png|width=590,height=252!



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to