[
https://issues.apache.org/jira/browse/SPARK-6414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-6414:
-----------------------------------
Description:
When a job group is cancelled, we scan through all jobs to determine which are
members of the group. This scan assumes that the job group property is always
set. If 'properties' is null in an active job, you get an NPE.
We just need to make sure we ignore ones where activeJob.properties is null. We
should also make sure it works if the particular property is missing.
https://github.com/apache/spark/blob/branch-1.3/core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala#L678
was:Spark failed with NPE in DAGScheduler.handleJobGroupCancelled:681 when
there are some active jobs which don't have any properties (i.e.
activeJob.properties is null)
> Spark driver failed with NPE on job cancelation
> -----------------------------------------------
>
> Key: SPARK-6414
> URL: https://issues.apache.org/jira/browse/SPARK-6414
> Project: Spark
> Issue Type: Bug
> Components: Scheduler
> Affects Versions: 1.3.0, 1.2.1
> Reporter: Yuri Makhno
>
> When a job group is cancelled, we scan through all jobs to determine which
> are members of the group. This scan assumes that the job group property is
> always set. If 'properties' is null in an active job, you get an NPE.
> We just need to make sure we ignore ones where activeJob.properties is null.
> We should also make sure it works if the particular property is missing.
> https://github.com/apache/spark/blob/branch-1.3/core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala#L678
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
