Github user tgravescs commented on a diff in the pull request:
https://github.com/apache/spark/pull/649#discussion_r12358286
--- Diff:
yarn/common/src/main/scala/org/apache/spark/deploy/yarn/ExecutorRunnableUtil.scala
---
@@ -56,10 +56,16 @@ trait ExecutorRunnableUtil extends Logging {
JAVA_OPTS += opts
}
- JAVA_OPTS += " -Djava.io.tmpdir=" +
- new Path(Environment.PWD.$(),
YarnConfiguration.DEFAULT_CONTAINER_TEMP_DIR) + " "
+ JAVA_OPTS += "-Djava.io.tmpdir=" +
+ new Path(Environment.PWD.$(),
YarnConfiguration.DEFAULT_CONTAINER_TEMP_DIR)
JAVA_OPTS += ClientBase.getLog4jConfiguration(localResources)
+ // This is needed for the authentication configs because the Executor
has to
+ // know whether to use authentication before it registers with the
Scheduler.
+ for ((k, v) <- sparkConf.getAll.filter{case (k, v) =>
k.startsWith("spark.auth")}) {
--- End diff --
spark.core.connection.auth.wait.timeout isn't needed as its for the
connectionManager and not created until after the initial registration and
transfer of sparkConf. Any of the akka settings are needed though. Let me
make another pass through the code to see if I see any others.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
