Michael Armbrust created SPARK-3021:
---------------------------------------
Summary: Job remains in Active Stages after failing
Key: SPARK-3021
URL: https://issues.apache.org/jira/browse/SPARK-3021
Project: Spark
Issue Type: Bug
Components: Web UI
Affects Versions: 1.1.0
Reporter: Michael Armbrust
It died with the following exception, but i still hanging out in the UI.
{code}
org.apache.spark.SparkException: Job aborted due to stage failure: Task 20 in
stage 8.1 failed 4 times, most recent failure: Lost task 20.3 in stage 8.1 (TID
710, ip-10-0-166-165.us-west-2.compute.internal): ExecutorLostFailure (executor
lost)
Driver stacktrace:
at
org.apache.spark.scheduler.DAGScheduler.org$apache$spark$scheduler$DAGScheduler$$failJobAndIndependentStages(DAGScheduler.scala:1153)
at
org.apache.spark.scheduler.DAGScheduler$$anonfun$abortStage$1.apply(DAGScheduler.scala:1142)
at
org.apache.spark.scheduler.DAGScheduler$$anonfun$abortStage$1.apply(DAGScheduler.scala:1141)
at
scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59)
at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:47)
{code}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]