Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/20657#discussion_r172325576
--- Diff: core/src/main/scala/org/apache/spark/deploy/SparkHadoopUtil.scala
---
@@ -144,7 +145,8 @@ class SparkHadoopUtil extends Logging {
private[spark] def addDelegationTokens(tokens: Array[Byte], sparkConf:
SparkConf) {
UserGroupInformation.setConfiguration(newConfiguration(sparkConf))
val creds = deserialize(tokens)
- logInfo(s"Adding/updating delegation tokens ${dumpTokens(creds)}")
+ logInfo("Updating delegation tokens for current user.")
--- End diff --
just a thought -- rather than just serializing the Credentials, would it be
helpful to serialize a timestamp when the tokens were obtained and when they
will be refreshed as well, so it could be logged here?
you have spent more time debugging cases with problems so you will probably
have a better idea if that would be helpful
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
