[ 
https://issues.apache.org/jira/browse/BEAM-7438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17143244#comment-17143244
 ] 

Akshay Iyangar commented on BEAM-7438:
--------------------------------------

[~mxm] - so gauges with the current code still didn't work for me, I had to 
change the return type from `GaugeResult` to `Long`  to see the values on the 
flink UI.

 

[https://github.com/apache/beam/blob/master/runners/flink/src/main/java/org/apache/beam/runners/flink/metrics/FlinkMetricContainer.java#L208]

 

Also for the Distribution, I think we will probably have to implement Flink's 
histogram

but I saw this effort which will probably make it easier to implement the 
distribution because while implementing I too observed the same problems 
mentioned below is that we need quantiles for calculating histogram in Flink 
and DistributionResult just doesn't give that and is pretty basic.

[https://docs.google.com/document/d/1kiNG2BAR-51pRdBCK4-XFmc0WuIkSuBzeb__Zv8owbU/edit]

Let me know, what you think.

 

 

> Distribution and Gauge metrics are not being exported to Flink dashboard 
> neither Prometheus IO
> ----------------------------------------------------------------------------------------------
>
>                 Key: BEAM-7438
>                 URL: https://issues.apache.org/jira/browse/BEAM-7438
>             Project: Beam
>          Issue Type: Bug
>          Components: runner-flink
>    Affects Versions: 2.12.0, 2.13.0
>            Reporter: Ricardo Bordon
>            Priority: P2
>         Attachments: image-2019-05-29-11-24-36-911.png, 
> image-2019-05-29-11-26-49-685.png
>
>
> Distributions and gauge metrics are not visible at Flink dashboard neither 
> Prometheus IO.
> I was able to debug the runner code and see that these metrics are being 
> update over *FlinkMetricContainer#updateDistributions()* and 
> *FlinkMetricContainer#updateGauges()* (meaning they are treated as "attempted 
> metrics") but these are not visible when looking them over the Flink 
> Dashboard or Prometheus. In the other hand, *Counter* metrics work as 
> expected.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to