tgravescs commented on issue #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with URL: https://github.com/apache/spark/pull/26682#issuecomment-573052392 I updated to pass the ResourceProfile itself in the RetrieveSparkAppConfig message and removed all the resource profile internal confs. This did require a bit of change, especially in the tests. This makes it more consistent where that same message will work for all cluster managers, the only thing that is cluster manager specific is it still has to launch the executor with the resource profile id. Note that things are hardcoded to the default resource profile (which is the same as reading from the application level configs) for this pr and future prs will add in support for others.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
