Hi,
We have a series of builtin PTransform/PCollection metrics:
https://github.com/apache/beam/blob/808cb35018cd228a59b152234b655948da2455fa/model/pipeline/src/main/proto/metrics.proto#L74
Why are those of counters ("beam:metrics:sum_int_64")? I think the
better default type for most users would be gauge
("beam:metrics:latest_int_64").
I understand that counters are useful because they retain the sum of all
reported values, but for getting an idea about the deviation of a
metric, gauges could be more useful.
Perhaps we could make this configurable?
Thanks,
Max