[
https://issues.apache.org/jira/browse/SPARK-12812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-12812.
------------------------------------
Resolution: Invalid
Hi, we don't use JIRA for questions (and we unfortunately don't have permission
to remove that option). Please follow the instructions at
http://spark.apache.org/community.html and use the mailing lists for that.
Just in case it might fix your problem quickly, though, make sure you're
running the Spark job in yarn-cluster mode. yarn-client does not report errors.
> exceptions in spark jobs in oozie on yarn cluster does not fail the workflow
> ----------------------------------------------------------------------------
>
> Key: SPARK-12812
> URL: https://issues.apache.org/jira/browse/SPARK-12812
> Project: Spark
> Issue Type: Question
> Reporter: Ravi Hunt
>
> I am running a oozie workflow on yarn which contains a spark job. When there
> is a exception in one of the spark executors, the workflow still thinks the
> spark job is successful and moves to the next job. How do i configure to let
> the workflow know that there is an exception in the spark job and the
> workflow needs to fail. I even propagate the error to the spark driver, but
> still the workflow does not fail.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
