Hi, I want to get Kafka's backlog metrics. In apache beam code I saw beam is collecting that metrics in here[1] as Source Metrics. However I can not see those metrics on Dataflow's metrics explorer. Do you know is there anyway to get those metrics ?
Also I saw there is MetricsSink. But based on beam documentation it is not supported by Dataflow. Is there any ticket to give support MetrcisSink support to Dataflow Runner ? Thanks [1] https://github.com/apache/beam/blob/d309c1b7c39ba78aa0cbd5cad9cc7a256e3caa9f/sdks/java/io/kafka/src/main/java/org/apache/beam/sdk/io/kafka/KafkaUnboundedReader.java#L673
