jiangxb1987 commented on issue #26614: [SPARK-29976][CORE] Trigger speculation for stages with too few tasks URL: https://github.com/apache/spark/pull/26614#issuecomment-561791270 Now I agree, we shall be conservative on the behavior change and limit it only on "small" TaskSet (that contains less tasks than the slots per executor), thus we'd better use `numTasks` instead of `numUnfinishedTasks` when comparing with `speculationTaskNumThres`.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
