Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/16432
@tgravescs thanks for your comments, I also tested with webhdfs with
configuration like:
```
--conf spark.yarn.access.namenodes=webhdfs://c6402.ambari.apache.org:50070/
```
And the related logs are:
```
17/01/09 03:15:49 INFO HadoopFSCredentialProvider: getting token for:
webhdfs://c6402.ambari.apache.org:50070/
17/01/09 03:15:50 INFO HadoopFSCredentialProvider: getting token for:
hdfs://c6402.ambari.apache.org:8020/user/spark
17/01/09 03:15:50 INFO DFSClient: Created HDFS_DELEGATION_TOKEN token 138
for spark on 192.168.64.102:8020
17/01/09 03:15:50 INFO DFSClient: Created HDFS_DELEGATION_TOKEN token 140
for spark on 192.168.64.102:8020
17/01/09 03:15:50 INFO HadoopFSCredentialProvider: Renewal interval is
86400112 for token WEBHDFS delegation
17/01/09 03:15:50 INFO HadoopFSCredentialProvider: Renewal interval is
86400146 for token HDFS_DELEGATION_TOKEN
```
As you could see also get tokens and token renewal interval from webhdfs
token.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
