GitHub user mgummelt opened a pull request:
https://github.com/apache/spark/pull/17665
[SPARK-16742] Mesos Kerberos Support
cc @skonto @vanzin
## What changes were proposed in this pull request?
Mesos Kerberos Support. This does not yet include support for cluster
mode, or for delegation token renewal. That will come in a future PR.
The delegation tokens are passed to the executors via RPC. The driver sets
the tokens as a configuration property, which the executors then read by
issuing the `RetrieveSparkAppConfig` RPC call (I did not add this call. It
already existed).
`ConfigurableCredentialProvider` and all of the `CredentialProvider`
classes have been moved from the `yarn` to `core` module so that they may be
shared by Mesos.
## How was this patch tested?
Manually against a kerberized HDFS cluster. Verified that the job failed
w/o `kinit` and succeeded w/ `kinit`
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/mesosphere/spark SPARK-16742-kerberos
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/17665.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #17665
----
commit 4f646ff089f7202efc6e3bc5fac922e87ee0ba6c
Author: Dr. Stefan Schimanski <[email protected]>
Date: 2016-02-10T17:09:46Z
[Mesosphere SPARK-126] Move YarnSparkHadoopUtil token helpers into the
generic SparkHadoopUtil class
commit 60293f916a296cc9ae1f4d7271ac93c8da02187a
Author: Dr. Stefan Schimanski <[email protected]>
Date: 2016-02-10T17:11:20Z
[Mesosphere SPARK-126] Add Mesos Kerberos support
commit 7d7a83e51bf4db9f01ba7ccde50938d8de9f3784
Author: Michael Gummelt <[email protected]>
Date: 2017-04-17T22:31:25Z
Par down kerberos support
commit 6b07d806dde5ad09624916a447493142e00d6d6d
Author: Michael Gummelt <[email protected]>
Date: 2017-04-17T22:57:51Z
cleanup
commit b1e322d880947f6cc704357eb9ecb7832edad811
Author: Michael Gummelt <[email protected]>
Date: 2017-04-17T23:14:05Z
style
commit 72bbe55068be1d2b3247afc533c5453a3bec648f
Author: Michael Gummelt <[email protected]>
Date: 2017-04-18T00:27:28Z
Add MesosSecurityManager
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
