Github user arunmahadevan commented on the issue:
https://github.com/apache/spark/pull/21721
@zsxwing @gatorsmile , this PR does not add new APIs as such. It builds on
the existing StreamingQueryProgress and adds custom metrics to it.
StreamingQueryProgress as such is not reported for continuous mode. When its
reported this would be part of that. Are you proposing to not report
StreamingQueryProgress at all for micro-batch until things are figured out for
continuous mode.? Otherwise I don't see how adding this would break things.
cc @jose-torres
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
