Hi,
We have recently upgraded to the latest version of Apache Beam 2.22.0. We were
previously using version 2.13.0 .
We are using the SparkRunner.
I noticed that after the upgrade that the Metrics query has stop producing
values. Through debugging I can see that the metrics and distribution are
still being incremented as expected. Has the metrics interface changed at all?
This is currently how we querying the metrics.
PipelineResult result = p.run();
for(MetricResult r:
result.metrics().queryMetrics(MetricsFilter.builder().build()).getCounters()) {
LOGGER.info("n=" + r.getName() + " v=" +
r.getAttempted().toString());
}
for(MetricResult r:
result.metrics().queryMetrics(MetricsFilter.builder().build()).getDistributions())
{
LOGGER.info("n=" + r.getName() + " v=" +
r.getAttempted().toString());
}
result.waitUntilFinish();
Thanks,
Kyle