[ https://issues.apache.org/jira/browse/SPARK-19688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15882027#comment-15882027 ]
Saisai Shao commented on SPARK-19688: ------------------------------------- According to my test, "spark.yarn.credentials.file" will be overwritten in yarn-client to point to a correct path when launching application (https://github.com/apache/spark/blob/master/resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala#L737). So even Spark Streaming checkpoint still keeps the old configuration, it will be overwritten when the new application is started. So I don't see an issue here except this weird setting. > Spark on Yarn Credentials File set to different application directory > --------------------------------------------------------------------- > > Key: SPARK-19688 > URL: https://issues.apache.org/jira/browse/SPARK-19688 > Project: Spark > Issue Type: Bug > Components: DStreams, YARN > Affects Versions: 1.6.3 > Reporter: Devaraj Jonnadula > Priority: Minor > > spark.yarn.credentials.file property is set to different application Id > instead of actual Application Id -- This message was sent by Atlassian JIRA (v6.3.15#6346) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org