GitHub user harishreedharan opened a pull request:
https://github.com/apache/spark/pull/7255
[SPARK-8851][YARN] In Yarn client mode, Client.scala does not login even
when credentials are specified
Client.scala does not login since we check if args.principal is null before
logging in, which it is since it is passed via SparkConf.
This PR addresses this by ensuring that we login in Client.scala in either
case, and also pass the credentials correctly.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/harishreedharan/spark yarn-client-login
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/7255.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #7255
----
commit 728affde997aea17855fa1376b4d41b89622bd85
Author: Hari Shreedharan <[email protected]>
Date: 2015-07-07T06:04:21Z
[SPARK-8851][YARN] In Yarn client mode, Client.scala does not login even
when credentials are specified
* Client.scala does not login since we check if args.principal is null
before logging in, which it is since it is passed via SparkConf
* The keytab file may not be accessible since the localized path would have
the full path of the file, since the full path would not be replaced just by
the name due to the above issue.
This PR addresses this by ensuring that we login in Client.scala in either
case, and also pass the credentials correctly.
commit d4390da84e8d66ebefaaffb4f3c1fa87b3744003
Author: Hari Shreedharan <[email protected]>
Date: 2015-07-07T06:26:24Z
Make sure the correct file is localized.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
