Github user harishreedharan commented on the pull request:
https://github.com/apache/spark/pull/7158#issuecomment-119024955
From what I can see this is not a real issue in Cluster mode. The
re-started app will actually be able to read from HDFS using the credentials
created for it by Client.scala here:
https://github.com/apache/spark/blob/master/yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala#L795
In Client mode though, this is an issue - but that is actually a bug, since
in Client mode - Client.scala does not do a login because of what presumably is
a bug. I am opening a PR for that soon.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
