Github user pwendell commented on a diff in the pull request:
https://github.com/apache/spark/pull/578#discussion_r12036009
--- Diff: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala ---
@@ -124,6 +124,8 @@ object SparkSubmit {
}
} else if (clusterManager == YARN) {
childMainClass = "org.apache.spark.deploy.yarn.Client"
+ // Special flag to avoid deprecation warnings at the client
+ sysProps("SPARK_SUBMIT_YARN") = "true"
--- End diff --
One problem we have with existing configs and envs is that someone creates
it for one purpose and then it gets used for a zillion other purposes and it
becomes really hard to understand what it's for.
So in general I'm biased at this point towards creating fairly narrowly
scoped internal options whenever possible and generalizing them (lazily) when
it's necessary. In this case I'd actually hope we can just remove this thing
if/when we decide to remove the YARN clients.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
