Caizhi Weng created FLINK-24759:
-----------------------------------
Summary: Metrics on web UI is not correct in a filesystem source
to filesystem sink streaming job
Key: FLINK-24759
URL: https://issues.apache.org/jira/browse/FLINK-24759
Project: Flink
Issue Type: Bug
Components: Runtime / Metrics, Runtime / Web Frontend
Affects Versions: 1.14.0
Reporter: Caizhi Weng
Attachments: metrics.png
I'm running a yarn-per-job streaming job which reads a large csv file
(flights.csv in [Kaggle flight delay
data|https://www.kaggle.com/usdot/flight-delays], ~500MB) from HDFS and writes
to another location (csv format) on the same HDFS. The resulting file seems OK,
but the metrics on the web UI seems strage.
I've tried other formats like reading from csv and writing to avro and the
phenomenon is the same.
!metrics.png!
--
This message was sent by Atlassian Jira
(v8.3.4#803005)