[
https://issues.apache.org/jira/browse/SPARK-4696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-4696.
-----------------------------------
Resolution: Implemented
We have {{spark.yarn.am.extraJavaOptions}} and
{{spark.yarn.am.extraLibraryPath}} now. Classpath is currently shared between
driver and client AM, which is kinda divergent from the other two, but also
probably too late to change now.
> Yarn: spark.driver.extra* variables not applied consistently to yarn client
> mode AM
> -----------------------------------------------------------------------------------
>
> Key: SPARK-4696
> URL: https://issues.apache.org/jira/browse/SPARK-4696
> Project: Spark
> Issue Type: Bug
> Components: YARN
> Affects Versions: 1.1.0
> Reporter: Thomas Graves
>
> Currently the configs to set the driver options (spark.driver.extra* -> java
> options, classpath, library path) are not applied consistently by yarn to the
> yarn client mode application master. Right now the classpath is applied but
> the java options and library path aren't. We should make it consistent.
> Note this is a result of discussions on the pull request for
> https://issues.apache.org/jira/browse/SPARK-4461
> so this might be affected by the outcome of that.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
