Hello Apache Beam Community,

While working with the Flink Runner, I've noticed that custom metrics are not 
easily visible in the Flink UI.

(They can be checked in the Metrics tab of the Flink UI.)

Typical users would expect to see these metrics in the Accumulators tab as well.

However, in the current implementation, metrics can only be viewed in the 
distributed Accumulators tab as an Accumulator named "__metricscontainers" 
after the Flink job has completely finished.

I would like to propose giving users the option to expose metrics not only in 
the Metrics tab but also in the Accumulators tab.

Of course, users should be able to see individual metrics rather than just the 
"__metricscontainers" aggregate.

If the community thinks this is a good idea, would it be okay for me to work on 
this improvement?

Thank you.

PS: Additional GitHub context: 
https://github.com/apache/beam/issues/20691
Beam metrics should be displayed in Flink UI "Metrics" tab · Issue #20691 · 
apache/beam
github.com

Reply via email to