[
https://issues.apache.org/jira/browse/SPARK-16744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15394812#comment-15394812
]
Kevin Grealish commented on SPARK-16744:
----------------------------------------
Issue discovered when doing narrower fix for SPARK-16110
> spark.yarn.appMasterEnv handling assumes values should be appended
> ------------------------------------------------------------------
>
> Key: SPARK-16744
> URL: https://issues.apache.org/jira/browse/SPARK-16744
> Project: Spark
> Issue Type: Bug
> Components: YARN
> Affects Versions: 1.6.0, 1.6.1, 1.6.2, 2.0.0
> Environment: YARN
> Reporter: Kevin Grealish
>
> When processing environment variables set via the conf setting
> spark.yarn.appMasterEnv.*, if there is an existing value the new value is
> appended assuming it is a CLASSPATH like value. This does not work for most
> environment variables, for example PYSPARK_PYTHON.
> Related:
> https://issues.apache.org/jira/browse/MAPREDUCE-6491
> https://issues.apache.org/jira/browse/SPARK-16110
> https://github.com/apache/spark/pull/13824
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
