[ 
https://issues.apache.org/jira/browse/FLINK-13813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16919160#comment-16919160
 ] 

lidesheng commented on FLINK-13813:
-----------------------------------

In my experiment, value displayed on UI(5,000,000) is correct. If rounding 
affected the metric value ,it will not be a number ended with 3(4084803).

I checked some source code and found that the value of UI is from IOMetrics of 
operator, but the metric is from other metric group. 
If this is the reason, why the value in metrics group is not correct?

> metrics is different between overview ui and metric response
> ------------------------------------------------------------
>
>                 Key: FLINK-13813
>                 URL: https://issues.apache.org/jira/browse/FLINK-13813
>             Project: Flink
>          Issue Type: Bug
>         Environment: Flink 1.8.1 with hdfs
>            Reporter: lidesheng
>            Priority: Major
>         Attachments: metrics.png, overview.png
>
>
> After a flink task is over, I get metrics by http request. The record count 
> in response is different with job overview.After a flink task is over, I get 
> metrics by http request. The record count in response is different with job 
> overview.
> get http://x.x.x.x:8081/jobs/57969f3978edf3115354fab1a72fd0c8 returns:
> { "jid": "57969f3978edf3115354fab1a72fd0c8", "name": 
> "3349_cjrw_1566177018152", "isStoppable": false, "state": "FINISHED", ... 
> "vertices": [ \{ "id": "d1cdde18b91ef6ce7c6a1cfdfa9e968d", "name": "CHAIN 
> DataSource (3349_cjrw_1566177018152/SOURCE/0) -> Map 
> (3349_cjrw_1566177018152/AUDIT/0)", "parallelism": 1, "status": "FINISHED", 
> ... "metrics": { "read-bytes": 0, "read-bytes-complete": true, "write-bytes": 
> 555941888, "write-bytes-complete": true, "read-records": 0, 
> "read-records-complete": true, "write-records": 5000000, 
> "write-records-complete": true } ... } ... ] }}
> But, the metrics by 
> http://x.x.x.x:8081/jobs/57969f3978edf3115354fab1a72fd0c8/vertices/d1cdde18b91ef6ce7c6a1cfdfa9e968d/metrics?get=0.numRecordsOut
>  returns
> [\{"id":"0.numRecordsOut","value":"4084803"}]
> The overview record count is different with task metrics, please view the 
> apppendix.



--
This message was sent by Atlassian Jira
(v8.3.2#803003)

Reply via email to