Hi,
I'm having an issue with Beam metrics not being passed from the Python
SDK on to my Flink cluster. None of the metrics I set in my Beam
pipeline show up in the Flink interface.
I found the following already resolved bug report about metrics on Flink
and added comment below, but haven't received an answer:
https://issues.apache.org/jira/browse/BEAM-6165
I retrieve a counter with
self.counter = Metrics.counter(self.__class__, 'my_counter')
in my ParDo and increment it with
self.counter.inc()
but nothing happens. Any idea what I may be doing wrong or this is a
(known) bug?
Janek