Josh Rosen created SPARK-8606:
---------------------------------
Summary: Exceptions in RDD.getPreferredLocations() and
getPartitions() should not be able to crash DAGScheduler
Key: SPARK-8606
URL: https://issues.apache.org/jira/browse/SPARK-8606
Project: Spark
Issue Type: Bug
Components: Scheduler
Affects Versions: 1.4.0, 1.3.0, 1.2.0, 1.5.0
Reporter: Josh Rosen
Assignee: Josh Rosen
Priority: Critical
RDD.getPreferredLocations() and RDD.getPartitions() may throw exceptions but
the DAGScheduler does not guard against this, leaving it vulnerable to crashing
and stopping the SparkContext if exceptions occur there.
We should fix this by adding more try blocks around these calls in DAGScheduler.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
