mridulm commented on pull request #30486: URL: https://github.com/apache/spark/pull/30486#issuecomment-735209644
Thanks for the details @HyukjinKwon ! It would be good if @tgravescs can also take a look, I am a bit rusty on some of these now - and iirc there are a bunch of corner cases in this. So my understanding is that the PR is adding functionality which existing in yarn for archives into a general support for other cluster modes too - with spark on yarn continuing to rely on distributed cache (and there should be no functionality change in yarn mode). ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
