GitHub user steveloughran opened a pull request:
https://github.com/apache/spark/pull/9232
Stevel/patches/spark 11265 hive tokens
This is just the first "it compiles" stage of the patch: it doesn't contain
any fixes
I've just pulled the current code out of the yarn client class into
{{YarnSparkHadoopUtil}}, split it into an inner exception-throwing method and
an outer some-exception-swallowing class, so that the inner class can be used
in tests. And, taking advantage of the fact that {{HiveConf extends
Configuration}}, avoiding so much introspection.
Todo
1. Test suite to verify that things fail
1. fix the test
This may need the yarn tests to depend on hive-1.2.1 core JAR at *test* only
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/steveloughran/spark
stevel/patches/SPARK-11265-hive-tokens
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/9232.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #9232
----
commit 3bb1b921fd229aff17bfe7860f479959987c0736
Author: Steve Loughran <[email protected]>
Date: 2015-10-22T21:08:26Z
SPARK-11265 YarnClient can't get tokens to talk to Hive in a secure
cluster. This is just the first "it compiles" stage of the patch: no tests or
attempts to run things yet
commit 1fcb42ec819052f1c3dd70c7543eaa824c3be23c
Author: Steve Loughran <[email protected]>
Date: 2015-10-22T21:15:07Z
SPARK-11265 reduce size of patch on imports, even though the existing set
doesn't follow the current rules precisely
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
