Kimahriman commented on PR #42301: URL: https://github.com/apache/spark/pull/42301#issuecomment-1662801850
@HeartSaVioR The config name is a little awkward and I hate adding more configs but I'm not familiar with other resource managers beyond yarn and any effects of making this change the default. I think on yarn there's no real drawbacks to this. The node manager picks one of the local dirs to put the container dir in, it just makes Spark deterministically use that same path instead of potentially a different configured local dir -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
