Github user tgravescs commented on the pull request:
https://github.com/apache/spark/pull/8942#issuecomment-149603677
@harishreedharan Can you clarify what is going on? You should not have
to replace the FileSystem.
The EventLogListener is created in SparkContext and just does a
FileSystem.get(). Which should get the cached filesystem or create a new one if
one doesn't exist. In updateCredentialsIfRequired it just adds the new
credentials to the current user.
The filesystem just uses the current user (even the cached one - this.ugi
= UserGroupInformation.getCurrentUser();) . Although I do see some stuff about
using the ticket cache in the code if that config is set but I didn't think it
generally was.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
