tgravescs commented on pull request #28656: URL: https://github.com/apache/spark/pull/28656#issuecomment-634847978
that isn't true if you are on something like YARN and HDFS where data can be on the node. Ideally I think we reset it when executor added if there aren't any or if it all executors were used and we added one, I just need time to look through the code. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
