cloud-fan commented on issue #26127: [SPARK-29348][SQL] Add observable Metrics for Streaming queries URL: https://github.com/apache/spark/pull/26127#issuecomment-542634569 This seems nothing to do with DS v2, but a new API in `Dataset` that allows users to collect metrics. From the PR description, this should support both micro-batch and continuous streaming, as epoch is a general concept. I haven't looked into the code yet, but do we support continuous streaming in this PR?
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
