Kimahriman commented on pull request #35504: URL: https://github.com/apache/spark/pull/35504#issuecomment-1039064063
> Memory overhead is not specific to yarn, but applies to all resource managers. Also, split it by driver and executor as well, to independently control them. > > See all usages of `EXECUTOR_MEMORY_OVERHEAD` and `DRIVER_MEMORY_OVERHEAD` So are you saying to just use this opportunity to unify all the difference resource managers with this config? Currently they all have their slight own ways of dealing with it but I can try to -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
