grundprinzip commented on PR #39091: URL: https://github.com/apache/spark/pull/39091#issuecomment-1356677876
> > @beliefer thanks for working on this. I have one question how are we going to get the observed metrics to the client? This seems to be missing from the implementation. One of the approaches would be to send it in a similar way as the metrics in the result code path. > > Good question. The result of datasets could passed by grpc server. But the `ObservationListener` runs on server, it seems we need another way to get. I think it would be possible to add another result batch type for observed metrics and simply pass them at the end. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
