damccorm opened a new issue, #19753:
URL: https://github.com/apache/beam/issues/19753
The dataflow runner collects (and publishes to the dataflow service) a large
number of useful stats. While these can be polled from the dataflow service
via its API, there are a few downsides to this:
* it requires another process to poll and collect the stats
* the stats are aggregated across all workers, so per-worker stats are lost
It would be simple to provide a hook to allow users to receive stats updates
as well, and then do whatever they want with them.
Imported from Jira
[BEAM-7605](https://issues.apache.org/jira/browse/BEAM-7605). Original Jira may
contain additional context.
Reported by: SteveNiemitz.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
