Thanks for offering your help with this! I've heard from a few users that Beam-on-Flink metrics could use improvement.
https://github.com/apache/beam/pull/10415 and https://github.com/apache/beam/pull/7183 seem to be the most recent significant changes to FlinkRunner metrics reporting. I know it has a blend of support for metrics and accumulators. It would be great to align things with what users would most expect. Kenn On Tue, Mar 4, 2025 at 9:31 AM LDesire <two_som...@icloud.com> wrote: > Hello Apache Beam Community, > > While working with the Flink Runner, I've noticed that custom metrics are > not easily visible in the Flink UI. > > (They can be checked in the Metrics tab of the Flink UI.) > > Typical users would expect to see these metrics in the Accumulators tab as > well. > > However, in the current implementation, metrics can only be viewed in the > distributed Accumulators tab as an Accumulator named "__metricscontainers" > after the Flink job has completely finished. > > I would like to propose giving users the option to expose metrics not only > in the Metrics tab but also in the Accumulators tab. > > Of course, users should be able to see individual metrics rather than just > the "__metricscontainers" aggregate. > > If the community thinks this is a good idea, would it be okay for me to > work on this improvement? > > Thank you. > > PS: Additional GitHub context: > [image: 20691.png] > > Beam metrics should be displayed in Flink UI "Metrics" tab · Issue #20691 > · apache/beam <https://github.com/apache/beam/issues/20691> > github.com <https://github.com/apache/beam/issues/20691> > <https://github.com/apache/beam/issues/20691> > >
