Github user harishreedharan commented on the pull request:
https://github.com/apache/spark/pull/8942#issuecomment-149787894
If the current user's ugi is what is used by the FileSystem cache, this
should not really be an issue no? Because we actually do update the current
user's credentials. I am ok with doing something like this, but I'd rather know
why before adding this. Why would new tokens not work? That seems like an HDFS
issue no? Let me test this out with @SaintBacchus's other PR.
In client mode, that would really mean that tokens are used by executors
and keytab used by AM and the driver. I am in half a mind to suggest not
supporting long-running apps in client mode on secure HDFS.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
