Github user tgravescs commented on the pull request:
https://github.com/apache/spark/pull/9859#issuecomment-158964727
so Spark has never officially supported this outside of YARN - local mode,
standalone, etc. So this isn't a bug, but would be an improvement.
--keytab and --principal options are under the YARN only section,
documentation is for yarn only, etc..
I'm fine if you want to take this on but I think if you make it more then
YARN you need to make sure it works in all the environments or at least the one
we intend to support and its all documented, tested, etc.
There have been attempts at adding this to standalone in the past but have
always had various issues. cc @pwendell as he might remember more about that
mode.
I also don't like forcing the HADOOP_SECURITY_AUTHENTICATION setting for
all environments to kerberos. For YARN this should be picked up from the
hadoop configuration if other modes require it thats fine but at the same time
if other modes are using hadoop and kerberos perhaps they should pick up the
proper hadoop configuration instead of hardcoding it.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
