Github user tgravescs commented on the pull request:
https://github.com/apache/spark/pull/7255#issuecomment-120014816
I totally missed that. Basically the problem is that the AM is the one
that re-logs in and the executors do to, but in the client mode the driver
never does, correct?
The exception you report is after 24 hours? hdfs client will re-login from
keytab if the original login if based on a keytab. With this patch and not
logging in via kinit before launching does that exception still occur?
We should fix it so driver re-logs in. Did you look to see if its possible
just to have the driver login similar to the executors? Like in the
YarnClientSchedulerBackend.
On this patch I'm a bit torn. We didn't document that we would
automatically login for you when keytab specified did we? If we can't make
it reliably work all the time in a clean manner I'm almost at the point of we
just close it as won't fix and require user to kinit.
@SaintBacchus how much of an issue is there really for you?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
