Github user skonto commented on a diff in the pull request:
https://github.com/apache/spark/pull/20945#discussion_r178859087
--- Diff: core/src/main/scala/org/apache/spark/rdd/HadoopRDD.scala ---
@@ -197,6 +197,7 @@ class HadoopRDD[K, V](
val jobConf = getJobConf()
// add the credentials here as this can be called before SparkContext
initialized
SparkHadoopUtil.get.addCredentials(jobConf)
+ logInfo(s"HadoopRDD credentials:
${SparkHadoopUtil.get.dumpTokens(jobConf.getCredentials)}")
--- End diff --
ok.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
