GitHub user mgummelt opened a pull request:
https://github.com/apache/spark/pull/17723
[SPARK-20434] Move kerberos delegation token code from yarn to core
## What changes were proposed in this pull request?
Move kerberos delegation token code from yarn to core, so that other
schedulers (such as Mesos), may use it.
## How was this patch tested?
unit tests
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/mesosphere/spark SPARK-20434-refactor-kerberos
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/17723.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #17723
----
commit ce63a9b6399176b8fa2c59c1004d796ef77c3d71
Author: Dr. Stefan Schimanski <[email protected]>
Date: 2016-02-10T17:09:46Z
[Mesosphere SPARK-126] Move YarnSparkHadoopUtil token helpers into the
generic SparkHadoopUtil class
commit 75d849a494519a5af97bf22df7676b336746ac92
Author: Dr. Stefan Schimanski <[email protected]>
Date: 2016-02-10T17:11:20Z
[Mesosphere SPARK-126] Add Mesos Kerberos support
commit 35002f2bd2e906bf1c6e6800f1f346e962edca75
Author: Michael Gummelt <[email protected]>
Date: 2017-04-17T22:31:25Z
Par down kerberos support
commit 13981c8fe7934a8cee53be4cfd59fb14c8d9b07c
Author: Michael Gummelt <[email protected]>
Date: 2017-04-17T22:57:51Z
cleanup
commit af4a3e4f53509ee1bee714d0846518d2696e0800
Author: Michael Gummelt <[email protected]>
Date: 2017-04-17T23:14:05Z
style
commit 5cc66dc91e7684c582b08a84b4901541dd60e38b
Author: Michael Gummelt <[email protected]>
Date: 2017-04-18T00:27:28Z
Add MesosSecurityManager
commit a47c9c04f61dce38f64e291c66793742239761b7
Author: Michael Gummelt <[email protected]>
Date: 2017-04-18T00:43:18Z
info logs
commit c8ec0496ca1c12e5eb43c530f08cb033a7c862fa
Author: Michael Gummelt <[email protected]>
Date: 2017-04-18T20:24:11Z
style
commit 954eeffda336bbbf6d5a588a38c95f092ecf1679
Author: Michael Gummelt <[email protected]>
Date: 2017-04-18T21:34:14Z
Re-add org.apache.spark.deploy.yarn.security.ServiceCredentialProvider for
backwards compatibility
commit 2d769287edd2ac6867e9696798c116fdf9165411
Author: Michael Gummelt <[email protected]>
Date: 2017-04-18T21:43:56Z
move YARNHadoopFSCredentialProviderSuite
commit d8a968d66c577cc702d00e980c968a57c3f12565
Author: Michael Gummelt <[email protected]>
Date: 2017-04-19T17:35:03Z
Move hive test deps to the core module
commit b8093c863ce9af3eadc3fd2b371e1bafe4cf4a47
Author: Michael Gummelt <[email protected]>
Date: 2017-04-19T22:10:25Z
remove test scope
commit 25d508823d238d905b102196962f39900b5c526a
Author: Michael Gummelt <[email protected]>
Date: 2017-04-19T22:50:10Z
remove test scope
commit 4c387ebcb584732d0d67e83c0b9d5f4cfd1db247
Author: Michael Gummelt <[email protected]>
Date: 2017-04-20T22:15:51Z
Removed MesosSecurityManager, added RPC call, removed META-INF
ServiceCredentialProvider from core
commit e32afeeac95883138751c060a3ebfaf309e3d22f
Author: Michael Gummelt <[email protected]>
Date: 2017-04-20T22:17:37Z
add InterfaceStability annotation to ServiceCredentialProvider
commit be69f5a639caad0abadafcae471e71847fc9f935
Author: Michael Gummelt <[email protected]>
Date: 2017-04-21T01:00:52Z
Add HadoopAccessManager
commit 55616da9f0fd15f1594233b5fe43b04ef1c901c8
Author: Michael Gummelt <[email protected]>
Date: 2017-04-21T19:28:43Z
Remove mesos code
commit 240df317dd42584349a3c4a0bf6f7d78a4fbe0e6
Author: Michael Gummelt <[email protected]>
Date: 2017-04-21T19:38:07Z
re-add mistakenly removed files
commit 810c6b26e3830e0f4e08e66df2d6a6f50cc65c7b
Author: Michael Gummelt <[email protected]>
Date: 2017-04-21T20:14:16Z
test ConfigurableCredentialManager.obtainUserTokens
commit ad4e33b9f379538ddcbdb9468f4bb39cafc46057
Author: Michael Gummelt <[email protected]>
Date: 2017-04-21T21:03:41Z
add tests
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
