tgravescs commented on PR #36716: URL: https://github.com/apache/spark/pull/36716#issuecomment-1154005738
assuming we would allow this with dynamic allocation doc updates, it needs doc updates for stage level scheduling sections and be sure to talk about None cores option and perhaps how cores work in general. I'm assuming if a user uses the core option with the ResourceProfile they are going to get the same behavior as https://issues.apache.org/jira/browse/SPARK-30299 which means it doesn't really work, correct? If the answer is the user has to specify EXECUTOR_CORES and then everything works fine again I guess I'm ok with it as long as its documented and it would be nice if we could catch this case and error or at least warn the user -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
