Thanks for the proposal, Zhanghao. +1 on the proposal. It makes a lot of sense.
Thanks, Jiangjie (Becket) Qin On Tue, May 28, 2024 at 7:43 PM Zhanghao Chen <zhanghao.c...@outlook.com> wrote: > Hi all, > > I'd like start a discussion on FLIP-460: Display source/sink I/O metrics > on Flink Web UI [1]. > > Currently, the numRecordsIn & numBytesIn metrics for sources and the > numRecordsOut & numBytesOut metrics for sinks are always 0 on the Flink web > dashboard. It is especially confusing for simple ETL jobs where there's a > single chained operator with 0 input rate and 0 output rate. For years, > Flink newbies have been asking "Why my job has zero consumption rate and > zero production rate, is it actually working?" > > Connectors implementing FLIP-33 [2] have already exposed these metrics on > the operator level, this FLIP takes a further step to expose them on the > job overview page on Flink Web UI. > > Looking forward to everyone's feedback and suggestions. Thanks! > > [1] > https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=309496355 > [2] > https://cwiki.apache.org/confluence/display/FLINK/FLIP-33%3A+Standardize+Connector+Metrics > > Best, > Zhanghao Chen >
