[
https://issues.apache.org/jira/browse/SPARK-3374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15169068#comment-15169068
]
Thomas Graves commented on SPARK-3374:
--------------------------------------
Just adding some more detail:
Note we should remove all environment variable configs. These were mostly used
in yarn-client mode (see YarnClientSchedulerBackend). We should check all yarn
code for deprecated configs and remove. We should also look at the
yarn.ClientArguments and ApplicationMasterArguments to see if we really need
these or if we can just do it through configs.
> Spark on Yarn remove deprecated configs for 2.0
> -----------------------------------------------
>
> Key: SPARK-3374
> URL: https://issues.apache.org/jira/browse/SPARK-3374
> Project: Spark
> Issue Type: Sub-task
> Components: YARN
> Affects Versions: 1.1.0
> Reporter: Thomas Graves
>
> The configs in yarn have gotten scattered and inconsistent between cluster
> and client modes and supporting backwards compatibility. We should try to
> clean this up, move things to common places and support configs across both
> cluster and client modes where we want to make them public.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
