[jira] [Updated] (SPARK-34000) ExecutorAllocationListener threw an exception java.util.NoSuchElementException
[ https://issues.apache.org/jira/browse/SPARK-34000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34000: - Fix Version/s: (was: 3.1.1) 3.1.0 > ExecutorAllocationListener threw an exception java.util.NoSuchElementException > -- > > Key: SPARK-34000 > URL: https://issues.apache.org/jira/browse/SPARK-34000 > Project: Spark > Issue Type: Bug > Components: Spark Core >Affects Versions: 3.0.1, 3.1.0, 3.2.0 >Reporter: Lantao Jin >Assignee: Lantao Jin >Priority: Major > Fix For: 3.0.2, 3.1.0 > > > 21/01/04 03:00:32,259 WARN [task-result-getter-2] scheduler.TaskSetManager:69 > : Lost task 306.1 in stage 600.0 (TID 283610, > hdc49-mcc10-01-0510-4108-039-tess0097.stratus.rno.ebay.com, executor 27): > TaskKilled (another attempt succeeded) > 21/01/04 03:00:32,259 INFO [task-result-getter-2] scheduler.TaskSetManager:57 > : Task 306.1 in stage 600.0 (TID 283610) failed, but the task will not be > re-executed (either because the task failed with a shuffle data fetch > failure, so the > previous stage needs to be re-run, or because a different copy of the task > has already succeeded). > 21/01/04 03:00:32,259 INFO [task-result-getter-2] > cluster.YarnClusterScheduler:57 : Removed TaskSet 600.0, whose tasks have all > completed, from pool default > 21/01/04 03:00:32,259 INFO [HiveServer2-Handler-Pool: Thread-5853] > thriftserver.SparkExecuteStatementOperation:190 : Returning result set with > 50 rows from offsets [5378600, 5378650) with > 1fe245f8-a7f9-4ec0-bcb5-8cf324cbbb47 > 21/01/04 03:00:32,260 ERROR [spark-listener-group-executorManagement] > scheduler.AsyncEventQueue:94 : Listener ExecutorAllocationListener threw an > exception > java.util.NoSuchElementException: key not found: Stage 600 (Attempt 0) > at scala.collection.MapLike.default(MapLike.scala:235) > at scala.collection.MapLike.default$(MapLike.scala:234) > at scala.collection.AbstractMap.default(Map.scala:63) > at scala.collection.mutable.HashMap.apply(HashMap.scala:69) > at > org.apache.spark.ExecutorAllocationManager$ExecutorAllocationListener.onTaskEnd(ExecutorAllocationManager.scala:621) > at > org.apache.spark.scheduler.SparkListenerBus.doPostEvent(SparkListenerBus.scala:45) > at > org.apache.spark.scheduler.SparkListenerBus.doPostEvent$(SparkListenerBus.scala:28) > at > org.apache.spark.scheduler.AsyncEventQueue.doPostEvent(AsyncEventQueue.scala:38) > at > org.apache.spark.scheduler.AsyncEventQueue.doPostEvent(AsyncEventQueue.scala:38) > at org.apache.spark.util.ListenerBus.postToAll(ListenerBus.scala:115) > at org.apache.spark.util.ListenerBus.postToAll$(ListenerBus.scala:99) > at > org.apache.spark.scheduler.AsyncEventQueue.super$postToAll(AsyncEventQueue.scala:116) > at > org.apache.spark.scheduler.AsyncEventQueue.$anonfun$dispatch$1(AsyncEventQueue.scala:116) > at scala.util.DynamicVariable.withValue(DynamicVariable.scala:62) > at > org.apache.spark.scheduler.AsyncEventQueue.org$apache$spark$scheduler$AsyncEventQueue$$dispatch(AsyncEventQueue.scala:102) > at > org.apache.spark.scheduler.AsyncEventQueue$$anon$2.$anonfun$run$1(AsyncEventQueue.scala:97) > at > org.apache.spark.util.Utils$.tryOrStopSparkContext(Utils.scala:1320) > at > org.apache.spark.scheduler.AsyncEventQueue$$anon$2.run(AsyncEventQueue.scala:97) -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-34000) ExecutorAllocationListener threw an exception java.util.NoSuchElementException
[ https://issues.apache.org/jira/browse/SPARK-34000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34000: -- Fix Version/s: (was: 3.1.0) 3.1.1 > ExecutorAllocationListener threw an exception java.util.NoSuchElementException > -- > > Key: SPARK-34000 > URL: https://issues.apache.org/jira/browse/SPARK-34000 > Project: Spark > Issue Type: Bug > Components: Spark Core >Affects Versions: 3.0.1, 3.1.0, 3.2.0 >Reporter: Lantao Jin >Assignee: Lantao Jin >Priority: Major > Fix For: 3.0.2, 3.1.1 > > > 21/01/04 03:00:32,259 WARN [task-result-getter-2] scheduler.TaskSetManager:69 > : Lost task 306.1 in stage 600.0 (TID 283610, > hdc49-mcc10-01-0510-4108-039-tess0097.stratus.rno.ebay.com, executor 27): > TaskKilled (another attempt succeeded) > 21/01/04 03:00:32,259 INFO [task-result-getter-2] scheduler.TaskSetManager:57 > : Task 306.1 in stage 600.0 (TID 283610) failed, but the task will not be > re-executed (either because the task failed with a shuffle data fetch > failure, so the > previous stage needs to be re-run, or because a different copy of the task > has already succeeded). > 21/01/04 03:00:32,259 INFO [task-result-getter-2] > cluster.YarnClusterScheduler:57 : Removed TaskSet 600.0, whose tasks have all > completed, from pool default > 21/01/04 03:00:32,259 INFO [HiveServer2-Handler-Pool: Thread-5853] > thriftserver.SparkExecuteStatementOperation:190 : Returning result set with > 50 rows from offsets [5378600, 5378650) with > 1fe245f8-a7f9-4ec0-bcb5-8cf324cbbb47 > 21/01/04 03:00:32,260 ERROR [spark-listener-group-executorManagement] > scheduler.AsyncEventQueue:94 : Listener ExecutorAllocationListener threw an > exception > java.util.NoSuchElementException: key not found: Stage 600 (Attempt 0) > at scala.collection.MapLike.default(MapLike.scala:235) > at scala.collection.MapLike.default$(MapLike.scala:234) > at scala.collection.AbstractMap.default(Map.scala:63) > at scala.collection.mutable.HashMap.apply(HashMap.scala:69) > at > org.apache.spark.ExecutorAllocationManager$ExecutorAllocationListener.onTaskEnd(ExecutorAllocationManager.scala:621) > at > org.apache.spark.scheduler.SparkListenerBus.doPostEvent(SparkListenerBus.scala:45) > at > org.apache.spark.scheduler.SparkListenerBus.doPostEvent$(SparkListenerBus.scala:28) > at > org.apache.spark.scheduler.AsyncEventQueue.doPostEvent(AsyncEventQueue.scala:38) > at > org.apache.spark.scheduler.AsyncEventQueue.doPostEvent(AsyncEventQueue.scala:38) > at org.apache.spark.util.ListenerBus.postToAll(ListenerBus.scala:115) > at org.apache.spark.util.ListenerBus.postToAll$(ListenerBus.scala:99) > at > org.apache.spark.scheduler.AsyncEventQueue.super$postToAll(AsyncEventQueue.scala:116) > at > org.apache.spark.scheduler.AsyncEventQueue.$anonfun$dispatch$1(AsyncEventQueue.scala:116) > at scala.util.DynamicVariable.withValue(DynamicVariable.scala:62) > at > org.apache.spark.scheduler.AsyncEventQueue.org$apache$spark$scheduler$AsyncEventQueue$$dispatch(AsyncEventQueue.scala:102) > at > org.apache.spark.scheduler.AsyncEventQueue$$anon$2.$anonfun$run$1(AsyncEventQueue.scala:97) > at > org.apache.spark.util.Utils$.tryOrStopSparkContext(Utils.scala:1320) > at > org.apache.spark.scheduler.AsyncEventQueue$$anon$2.run(AsyncEventQueue.scala:97) -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-34000) ExecutorAllocationListener threw an exception java.util.NoSuchElementException
[ https://issues.apache.org/jira/browse/SPARK-34000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lantao Jin updated SPARK-34000: --- Affects Version/s: 3.0.1 > ExecutorAllocationListener threw an exception java.util.NoSuchElementException > -- > > Key: SPARK-34000 > URL: https://issues.apache.org/jira/browse/SPARK-34000 > Project: Spark > Issue Type: Bug > Components: Spark Core >Affects Versions: 3.0.1, 3.1.0, 3.2.0 >Reporter: Lantao Jin >Priority: Major > > 21/01/04 03:00:32,259 WARN [task-result-getter-2] scheduler.TaskSetManager:69 > : Lost task 306.1 in stage 600.0 (TID 283610, > hdc49-mcc10-01-0510-4108-039-tess0097.stratus.rno.ebay.com, executor 27): > TaskKilled (another attempt succeeded) > 21/01/04 03:00:32,259 INFO [task-result-getter-2] scheduler.TaskSetManager:57 > : Task 306.1 in stage 600.0 (TID 283610) failed, but the task will not be > re-executed (either because the task failed with a shuffle data fetch > failure, so the > previous stage needs to be re-run, or because a different copy of the task > has already succeeded). > 21/01/04 03:00:32,259 INFO [task-result-getter-2] > cluster.YarnClusterScheduler:57 : Removed TaskSet 600.0, whose tasks have all > completed, from pool default > 21/01/04 03:00:32,259 INFO [HiveServer2-Handler-Pool: Thread-5853] > thriftserver.SparkExecuteStatementOperation:190 : Returning result set with > 50 rows from offsets [5378600, 5378650) with > 1fe245f8-a7f9-4ec0-bcb5-8cf324cbbb47 > 21/01/04 03:00:32,260 ERROR [spark-listener-group-executorManagement] > scheduler.AsyncEventQueue:94 : Listener ExecutorAllocationListener threw an > exception > java.util.NoSuchElementException: key not found: Stage 600 (Attempt 0) > at scala.collection.MapLike.default(MapLike.scala:235) > at scala.collection.MapLike.default$(MapLike.scala:234) > at scala.collection.AbstractMap.default(Map.scala:63) > at scala.collection.mutable.HashMap.apply(HashMap.scala:69) > at > org.apache.spark.ExecutorAllocationManager$ExecutorAllocationListener.onTaskEnd(ExecutorAllocationManager.scala:621) > at > org.apache.spark.scheduler.SparkListenerBus.doPostEvent(SparkListenerBus.scala:45) > at > org.apache.spark.scheduler.SparkListenerBus.doPostEvent$(SparkListenerBus.scala:28) > at > org.apache.spark.scheduler.AsyncEventQueue.doPostEvent(AsyncEventQueue.scala:38) > at > org.apache.spark.scheduler.AsyncEventQueue.doPostEvent(AsyncEventQueue.scala:38) > at org.apache.spark.util.ListenerBus.postToAll(ListenerBus.scala:115) > at org.apache.spark.util.ListenerBus.postToAll$(ListenerBus.scala:99) > at > org.apache.spark.scheduler.AsyncEventQueue.super$postToAll(AsyncEventQueue.scala:116) > at > org.apache.spark.scheduler.AsyncEventQueue.$anonfun$dispatch$1(AsyncEventQueue.scala:116) > at scala.util.DynamicVariable.withValue(DynamicVariable.scala:62) > at > org.apache.spark.scheduler.AsyncEventQueue.org$apache$spark$scheduler$AsyncEventQueue$$dispatch(AsyncEventQueue.scala:102) > at > org.apache.spark.scheduler.AsyncEventQueue$$anon$2.$anonfun$run$1(AsyncEventQueue.scala:97) > at > org.apache.spark.util.Utils$.tryOrStopSparkContext(Utils.scala:1320) > at > org.apache.spark.scheduler.AsyncEventQueue$$anon$2.run(AsyncEventQueue.scala:97) -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-34000) ExecutorAllocationListener threw an exception java.util.NoSuchElementException
[ https://issues.apache.org/jira/browse/SPARK-34000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lantao Jin updated SPARK-34000: --- Affects Version/s: (was: 3.0.1) > ExecutorAllocationListener threw an exception java.util.NoSuchElementException > -- > > Key: SPARK-34000 > URL: https://issues.apache.org/jira/browse/SPARK-34000 > Project: Spark > Issue Type: Bug > Components: Spark Core >Affects Versions: 3.1.0, 3.2.0 >Reporter: Lantao Jin >Priority: Major > > 21/01/04 03:00:32,259 WARN [task-result-getter-2] scheduler.TaskSetManager:69 > : Lost task 306.1 in stage 600.0 (TID 283610, > hdc49-mcc10-01-0510-4108-039-tess0097.stratus.rno.ebay.com, executor 27): > TaskKilled (another attempt succeeded) > 21/01/04 03:00:32,259 INFO [task-result-getter-2] scheduler.TaskSetManager:57 > : Task 306.1 in stage 600.0 (TID 283610) failed, but the task will not be > re-executed (either because the task failed with a shuffle data fetch > failure, so the > previous stage needs to be re-run, or because a different copy of the task > has already succeeded). > 21/01/04 03:00:32,259 INFO [task-result-getter-2] > cluster.YarnClusterScheduler:57 : Removed TaskSet 600.0, whose tasks have all > completed, from pool default > 21/01/04 03:00:32,259 INFO [HiveServer2-Handler-Pool: Thread-5853] > thriftserver.SparkExecuteStatementOperation:190 : Returning result set with > 50 rows from offsets [5378600, 5378650) with > 1fe245f8-a7f9-4ec0-bcb5-8cf324cbbb47 > 21/01/04 03:00:32,260 ERROR [spark-listener-group-executorManagement] > scheduler.AsyncEventQueue:94 : Listener ExecutorAllocationListener threw an > exception > java.util.NoSuchElementException: key not found: Stage 600 (Attempt 0) > at scala.collection.MapLike.default(MapLike.scala:235) > at scala.collection.MapLike.default$(MapLike.scala:234) > at scala.collection.AbstractMap.default(Map.scala:63) > at scala.collection.mutable.HashMap.apply(HashMap.scala:69) > at > org.apache.spark.ExecutorAllocationManager$ExecutorAllocationListener.onTaskEnd(ExecutorAllocationManager.scala:621) > at > org.apache.spark.scheduler.SparkListenerBus.doPostEvent(SparkListenerBus.scala:45) > at > org.apache.spark.scheduler.SparkListenerBus.doPostEvent$(SparkListenerBus.scala:28) > at > org.apache.spark.scheduler.AsyncEventQueue.doPostEvent(AsyncEventQueue.scala:38) > at > org.apache.spark.scheduler.AsyncEventQueue.doPostEvent(AsyncEventQueue.scala:38) > at org.apache.spark.util.ListenerBus.postToAll(ListenerBus.scala:115) > at org.apache.spark.util.ListenerBus.postToAll$(ListenerBus.scala:99) > at > org.apache.spark.scheduler.AsyncEventQueue.super$postToAll(AsyncEventQueue.scala:116) > at > org.apache.spark.scheduler.AsyncEventQueue.$anonfun$dispatch$1(AsyncEventQueue.scala:116) > at scala.util.DynamicVariable.withValue(DynamicVariable.scala:62) > at > org.apache.spark.scheduler.AsyncEventQueue.org$apache$spark$scheduler$AsyncEventQueue$$dispatch(AsyncEventQueue.scala:102) > at > org.apache.spark.scheduler.AsyncEventQueue$$anon$2.$anonfun$run$1(AsyncEventQueue.scala:97) > at > org.apache.spark.util.Utils$.tryOrStopSparkContext(Utils.scala:1320) > at > org.apache.spark.scheduler.AsyncEventQueue$$anon$2.run(AsyncEventQueue.scala:97) -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
