[ https://issues.apache.org/jira/browse/SPARK-19688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15988421#comment-15988421 ]
Jiasheng Wang commented on SPARK-19688: --------------------------------------- [~jerryshao] I did not test this in Spark 2.1+, but I wrote a test suite and the result showed that it seemed the issue still exist. ``` test("temp test") { ssc = new StreamingContext(master, framework, batchDuration) ssc.conf.set("spark.yarn.credentials.file", "tmp1") val cp = new Checkpoint(ssc, Time(1000)) val newCp = Utils.deserialize[Checkpoint](Utils.serialize(cp)) val newCpConf = newCp.createSparkConf() assert(newCpConf.get("spark.yarn.credentials.file") === "tmp1") System.setProperty("spark.yarn.credentials.file", "tmp2") val newCpConf2 = newCp.createSparkConf() assert(newCpConf2.get("spark.yarn.credentials.file") === "tmp2") } ``` > Spark on Yarn Credentials File set to different application directory > --------------------------------------------------------------------- > > Key: SPARK-19688 > URL: https://issues.apache.org/jira/browse/SPARK-19688 > Project: Spark > Issue Type: Bug > Components: DStreams, YARN > Affects Versions: 1.6.3 > Reporter: Devaraj Jonnadula > Priority: Minor > > spark.yarn.credentials.file property is set to different application Id > instead of actual Application Id -- This message was sent by Atlassian JIRA (v6.3.15#6346) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org