Github user vanzin commented on the pull request:
https://github.com/apache/spark/pull/4405#issuecomment-73558881
Hi @chesterxgchen.
Assumption 1 and 3 wrong: the code doesn't assume that. Proxy users work
just fine without kerberos as long as the configuration allows it (in fact I
just tested it). You may argue that it's useless in non-kerberos mode (where
you can just use `UserGroupInfomation.createRemoteUser()` and achieve the
same), but that's beyond the point of this patch.
Errors, just like any other error when submitting the app to Yarn, are
reported as exceptions thrown by the Yarn client code. I assume that standalone
and mesos have no notion of proxy users, so they wouldn't ever complain about
it.
> For spark jobs, should one need to add delegation token to the job's
credential ?
Delegation tokens are only needed with kerberos, which is only supported by
Yarn currently, which as you already noticed already handles them.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
