phaniarnab commented on PR #1733: URL: https://github.com/apache/systemds/pull/1733#issuecomment-1317405848
> > This extension allows triggering a chain of Spark instructions asynchronously and seeking the results only when needed. > > This is really interesting @phaniarnab . Curious: is there a concrete use case for this feature? Yes. There are different use cases. They arise as we combine Spark's lazy execution with local eager execution. Currently, a chain of Spark operations is triggered only when we need the result locally---which leads to inefficient cluster utilization. @BACtaki -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
