[GitHub] [spark] LuciferYang commented on a diff in pull request #38711: [SPARK-41192][CORE] Remove unscheduled speculative tasks when task finished to obtain better dynamic

LuciferYang commented on code in PR #38711: URL: https://github.com/apache/spark/pull/38711#discussion_r1046674086 ## project/MimaExcludes.scala: ## @@ -122,6 +122,13 @@ object MimaExcludes { // [SPARK-41072][SS] Add the error class STREAM_FAILED to

[GitHub] [spark] LuciferYang commented on a diff in pull request #38711: [SPARK-41192][Core] Remove unscheduled speculative tasks when task finished to obtain better dynamic

LuciferYang commented on code in PR #38711: URL: https://github.com/apache/spark/pull/38711#discussion_r1039157936 ## core/src/main/scala/org/apache/spark/scheduler/SparkListener.scala: ## @@ -55,7 +55,8 @@ case class SparkListenerTaskGettingResult(taskInfo: TaskInfo) extends

[GitHub] [spark] LuciferYang commented on a diff in pull request #38711: [SPARK-41192][Core] Remove unscheduled speculative tasks when task finished to obtain better dynamic

LuciferYang commented on code in PR #38711: URL: https://github.com/apache/spark/pull/38711#discussion_r1037869060 ## core/src/main/scala/org/apache/spark/scheduler/SparkListener.scala: ## @@ -55,7 +55,8 @@ case class SparkListenerTaskGettingResult(taskInfo: TaskInfo) extends

[GitHub] [spark] LuciferYang commented on a diff in pull request #38711: [SPARK-41192][Core] Remove unscheduled speculative tasks when task finished to obtain better dynamic

LuciferYang commented on code in PR #38711: URL: https://github.com/apache/spark/pull/38711#discussion_r1037165963 ## core/src/main/scala/org/apache/spark/scheduler/SparkListener.scala: ## @@ -55,7 +55,8 @@ case class SparkListenerTaskGettingResult(taskInfo: TaskInfo) extends

[GitHub] [spark] LuciferYang commented on a diff in pull request #38711: [SPARK-41192][Core] Remove unscheduled speculative tasks when task finished to obtain better dynamic

LuciferYang commented on code in PR #38711: URL: https://github.com/apache/spark/pull/38711#discussion_r1037142914 ## core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala: ## @@ -843,9 +847,9 @@ private[spark] class ExecutorAllocationManager( def

[GitHub] [spark] LuciferYang commented on a diff in pull request #38711: [SPARK-41192][Core] Remove unscheduled speculative tasks when task finished to obtain better dynamic

LuciferYang commented on code in PR #38711: URL: https://github.com/apache/spark/pull/38711#discussion_r1037089750 ## core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala: ## @@ -722,9 +724,9 @@ private[spark] class ExecutorAllocationManager( // because

[GitHub] [spark] LuciferYang commented on a diff in pull request #38711: [SPARK-41192][Core] Remove unscheduled speculative tasks when task finished to obtain better dynamic

LuciferYang commented on code in PR #38711: URL: https://github.com/apache/spark/pull/38711#discussion_r1037085777 ## core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala: ## @@ -643,10 +643,12 @@ private[spark] class ExecutorAllocationManager( // Should be

[GitHub] [spark] LuciferYang commented on a diff in pull request #38711: [SPARK-41192][Core] Remove unscheduled speculative tasks when task finished to obtain better dynamic

LuciferYang commented on code in PR #38711: URL: https://github.com/apache/spark/pull/38711#discussion_r1028823929 ## core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala: ## @@ -749,8 +749,10 @@ private[spark] class ExecutorAllocationManager(

[GitHub] [spark] LuciferYang commented on a diff in pull request #38711: [SPARK-41192][Core] Remove unscheduled speculative tasks when task finished to obtain better dynamic

LuciferYang commented on code in PR #38711: URL: https://github.com/apache/spark/pull/38711#discussion_r1028821337 ## core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala: ## @@ -749,8 +749,10 @@ private[spark] class ExecutorAllocationManager(

[GitHub] [spark] LuciferYang commented on a diff in pull request #38711: [SPARK-41192][Core] Remove unscheduled speculative tasks when task finished to obtain better dynamic

LuciferYang commented on code in PR #38711: URL: https://github.com/apache/spark/pull/38711#discussion_r1028804426 ## core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala: ## @@ -749,8 +749,10 @@ private[spark] class ExecutorAllocationManager(

[GitHub] [spark] LuciferYang commented on a diff in pull request #38711: [SPARK-41192][Core] Remove unscheduled speculative tasks when task finished to obtain better dynamic

LuciferYang commented on code in PR #38711: URL: https://github.com/apache/spark/pull/38711#discussion_r1028803675 ## core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala: ## @@ -749,8 +749,10 @@ private[spark] class ExecutorAllocationManager(

[GitHub] [spark] LuciferYang commented on a diff in pull request #38711: [SPARK-41192][Core] Remove unscheduled speculative tasks when task finished to obtain better dynamic

LuciferYang commented on code in PR #38711: URL: https://github.com/apache/spark/pull/38711#discussion_r1028802840 ## core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala: ## @@ -749,8 +749,10 @@ private[spark] class ExecutorAllocationManager(

[GitHub] [spark] LuciferYang commented on a diff in pull request #38711: [SPARK-41192][Core] Remove unscheduled speculative tasks when task finished to obtain better dynamic

LuciferYang commented on code in PR #38711: URL: https://github.com/apache/spark/pull/38711#discussion_r1028783234 ## core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala: ## @@ -774,17 +776,16 @@ private[spark] class ExecutorAllocationManager(