tomvanbussel commented on pull request #29785: URL: https://github.com/apache/spark/pull/29785#issuecomment-698836144
@cloud-fan I don't really see a way to simply this without making invasive changes to memory management in Spark. For instance we could simplify this if we had some way to reserve memory up front. That seems like a lot of work though, so for now I have tried to keep it understand by adding lots of comments. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
