Hello Beam, Robert Ryan and I have been designing a metric extraction API for Beam. Please take a look at this design, I would love to get more feedback on this to improve the design.
https://s.apache.org/get-metrics-api The primary goal of this proposal is to offer a simple way to obtain all the metrics for a job. The following issues are addressed: - The current design requires implementing metric querying for every runner+language combination. - Duplication of MetricResult related classes in each language. - The existing MetricResult format only allows querying metrics defined by a namespace, name and step, and does not allow generalized labelling as used by MonitoringInfos. - Enhance Beam’s ability to integration test new metrics Thank for taking a look, Alex
