tgravescs commented on issue #26614: [SPARK-29976] New conf for single task stage speculation URL: https://github.com/apache/spark/pull/26614#issuecomment-558223041 note I realize there are a bunch of corner cases here, but take back my suggestion of the number of executors, you could have 1 executor but run 10000 tasks on it and you still might want to use the regular logic. I think our best bet is either leave at 1, a config, or tasks <= the number that can fix on a single executor makes more sense to me.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
