tgravescs commented on issue #26614: [SPARK-29976][CORE] New conf for single task stage speculation URL: https://github.com/apache/spark/pull/26614#issuecomment-558833126 original speculation logic doesn't including pending because it can only use the time of successful tasks. Unless you are referring to something else. I'm ok with any of these as they will be better then what we have now. If you look at running, it could change very quickly, because with dynamic allocation I might have 1 executor, start 4 tasks on it, but then some time later get another executor so then I no longer apply the timeout and use the original speculation logic
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
