[
https://issues.apache.org/jira/browse/SPARK-19688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15988421#comment-15988421
]
Jiasheng Wang commented on SPARK-19688:
---------------------------------------
[~jerryshao]
I did not test this in Spark 2.1+, but I wrote a test suite and the result
showed that it seemed the issue still exist.
```
test("temp test") {
ssc = new StreamingContext(master, framework, batchDuration)
ssc.conf.set("spark.yarn.credentials.file", "tmp1")
val cp = new Checkpoint(ssc, Time(1000))
val newCp = Utils.deserialize[Checkpoint](Utils.serialize(cp))
val newCpConf = newCp.createSparkConf()
assert(newCpConf.get("spark.yarn.credentials.file") === "tmp1")
System.setProperty("spark.yarn.credentials.file", "tmp2")
val newCpConf2 = newCp.createSparkConf()
assert(newCpConf2.get("spark.yarn.credentials.file") === "tmp2")
}
```
> Spark on Yarn Credentials File set to different application directory
> ---------------------------------------------------------------------
>
> Key: SPARK-19688
> URL: https://issues.apache.org/jira/browse/SPARK-19688
> Project: Spark
> Issue Type: Bug
> Components: DStreams, YARN
> Affects Versions: 1.6.3
> Reporter: Devaraj Jonnadula
> Priority: Minor
>
> spark.yarn.credentials.file property is set to different application Id
> instead of actual Application Id
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
