[
https://issues.apache.org/jira/browse/YARN-8979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16677493#comment-16677493
]
Subru Krishnan commented on YARN-8979:
--------------------------------------
[~shenyinjie], thanks for reporting this. This is a known issue caused by
YARN-4083.
We work around this by separating the client configuration (i.e. Spark, Tez,
MR) from server configuration (i.e. NM, RM, Router, etc). Unfortunately this
involves a code change that will require to have an independent conf dir for
clients which might break existing deployments (as everyone will need to clone
their conf dirs), so has never been committed.
> Spark on yarn job failed with yarn federation enabled
> ------------------------------------------------------
>
> Key: YARN-8979
> URL: https://issues.apache.org/jira/browse/YARN-8979
> Project: Hadoop YARN
> Issue Type: Bug
> Affects Versions: 3.1.0
> Reporter: Shen Yinjie
> Priority: Major
>
> when I ran spark job on yarn with yarn federation enabled,job failed and
> throw Exception as snapshot.
> ps: MR and Tez jobs are OK.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
