[
https://issues.apache.org/jira/browse/BEAM-7438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16862135#comment-16862135
]
Ricardo Bordon commented on BEAM-7438:
--------------------------------------
Hello, [~mxm].
The issue is not only with the flink web UI, it also involves at least two
flink metric reporters (the ones I've tried, PrometheusExporter and
JmxExporter). To clarify, my expectation will be to define a Beam's
Distribution metric type, connect my flink cluster to PrometheusIO, run my beam
pipeline onto the flink cluster and then be able to see that metric being
consumed by PrometheusIO. All this workflow works fine with Beam's Counter
metric type, but Distribution neither Gauge metrics.
With regards to the provided options above, not sure to understand what (1)
means. For (2) I think the mentioned map it is already implemented over
[https://github.com/apache/beam/blob/release-2.13.0/runners/flink/src/main/java/org/apache/beam/runners/flink/metrics/FlinkMetricContainer.java#L127]
and
[https://github.com/apache/beam/blob/65dbb4d4f26cf88dd6bd639efc4bfa07cd3f5f1e/runners/flink/src/main/java/org/apache/beam/runners/flink/metrics/FlinkMetricContainer.java#L147],
it is very probably I'm missing something import.
I've just tried with version 2.13.0 and flink runner 1.8 and I'm still seeing
this issue.
Thanks a lot for your help.
> Distribution and Gauge metrics are not being exported to Flink dashboard
> neither Prometheus IO
> ----------------------------------------------------------------------------------------------
>
> Key: BEAM-7438
> URL: https://issues.apache.org/jira/browse/BEAM-7438
> Project: Beam
> Issue Type: Bug
> Components: runner-flink
> Affects Versions: 2.12.0
> Reporter: Ricardo Bordon
> Priority: Major
> Attachments: image-2019-05-29-11-24-36-911.png,
> image-2019-05-29-11-26-49-685.png
>
>
> Distributions and gauge metrics are not visible at Flink dashboard neither
> Prometheus IO.
> I was able to debug the runner code and see that these metrics are being
> update over *FlinkMetricContainer#updateDistributions()* and
> *FlinkMetricContainer#updateGauges()* (meaning they are treated as "attempted
> metrics") but these are not visible when looking them over the Flink
> Dashboard or Prometheus. In the other hand, *Counter* metrics work as
> expected.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
