Repository: spark Updated Branches: refs/heads/branch-2.1 c3316743e -> 6edf02a8b
[SPARK-19626][YARN] Using the correct config to set credentials update time ## What changes were proposed in this pull request? In https://github.com/apache/spark/pull/14065, we introduced a configurable credential manager for Spark running on YARN. Also two configs `spark.yarn.credentials.renewalTime` and `spark.yarn.credentials.updateTime` were added, one is for the credential renewer and the other updater. But now we just query `spark.yarn.credentials.renewalTime` by mistake during CREDENTIALS UPDATING, where should be actually `spark.yarn.credentials.updateTime` . This PR fixes this mistake. ## How was this patch tested? existing test cc jerryshao vanzin Author: Kent Yao <[email protected]> Closes #16955 from yaooqinn/cred_update. (cherry picked from commit 7363dde6348fd70d67a13bb4644baca7c77ac241) Signed-off-by: Marcelo Vanzin <[email protected]> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/6edf02a8 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/6edf02a8 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/6edf02a8 Branch: refs/heads/branch-2.1 Commit: 6edf02a8b8e9b5f4526311f218d425d30b607b2f Parents: c331674 Author: Kent Yao <[email protected]> Authored: Tue Feb 21 09:57:40 2017 -0800 Committer: Marcelo Vanzin <[email protected]> Committed: Tue Feb 21 09:57:50 2017 -0800 ---------------------------------------------------------------------- .../org/apache/spark/deploy/yarn/security/CredentialUpdater.scala | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/spark/blob/6edf02a8/yarn/src/main/scala/org/apache/spark/deploy/yarn/security/CredentialUpdater.scala ---------------------------------------------------------------------- diff --git a/yarn/src/main/scala/org/apache/spark/deploy/yarn/security/CredentialUpdater.scala b/yarn/src/main/scala/org/apache/spark/deploy/yarn/security/CredentialUpdater.scala index 5df4fbd..2fdb70a 100644 --- a/yarn/src/main/scala/org/apache/spark/deploy/yarn/security/CredentialUpdater.scala +++ b/yarn/src/main/scala/org/apache/spark/deploy/yarn/security/CredentialUpdater.scala @@ -55,7 +55,7 @@ private[spark] class CredentialUpdater( /** Start the credential updater task */ def start(): Unit = { - val startTime = sparkConf.get(CREDENTIALS_RENEWAL_TIME) + val startTime = sparkConf.get(CREDENTIALS_UPDATE_TIME) val remainingTime = startTime - System.currentTimeMillis() if (remainingTime <= 0) { credentialUpdater.schedule(credentialUpdaterRunnable, 1, TimeUnit.MINUTES) --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
