cloud-fan commented on pull request #31398: URL: https://github.com/apache/spark/pull/31398#issuecomment-771463490
The feature makes a lot of sense, but to me building the infra to report data source metrics is the most important thing here. @viirya can you add more details about the DS v2 API design, how it works with batch and streaming, how it is integrated into the batch and streaming execution? ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
