[
https://issues.apache.org/jira/browse/SPARK-3374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15123043#comment-15123043
]
Saisai Shao commented on SPARK-3374:
------------------------------------
+1 to address this in the upcoming 2.0 release.
1. Currently in the Yarn client there has several ways of configuration,
SparkConf, cmdline properties and system environments, there is no centralized
place to manage all of the configurations. Also several different ways of
configurations makes it hard to cover all the test, easily introduce bugs.
2. In the Yarn side, we separate the configurations to driver and AM specific,
this is quite complex for new user to understand, also increase the management
complexity. It would be better to unify them.
> Spark on Yarn remove deprecated configs for 2.0
> -----------------------------------------------
>
> Key: SPARK-3374
> URL: https://issues.apache.org/jira/browse/SPARK-3374
> Project: Spark
> Issue Type: Sub-task
> Components: YARN
> Affects Versions: 1.1.0
> Reporter: Thomas Graves
>
> The configs in yarn have gotten scattered and inconsistent between cluster
> and client modes and supporting backwards compatibility. We should try to
> clean this up, move things to common places and support configs across both
> cluster and client modes where we want to make them public.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
