GitHub user sjrand opened a pull request:
https://github.com/apache/spark/pull/19540
[SPARK-22319][Core] call loginUserFromKeytab before accessing hdfs
## What changes were proposed in this pull request?
In `SparkSubmit`, call `loginUserFromKeytab` before attempting to make RPC
calls to the NameNode.
## How was this patch tested?
I manually tested this patch by:
1. Confirming that my Spark application failed to launch with the error
reported in https://issues.apache.org/jira/browse/SPARK-22319.
2. Applying this patch and confirming that the app no longer fails to
launch, even when I have not manually run `kinit` on the host.
Presumably we also want integration tests for secure clusters so that we
catch this sort of thing. I'm happy to take a shot at this if it's feasible and
someone can point me in the right direction.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/sjrand/spark SPARK-22319
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/19540.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #19540
----
commit 08240f368fdde6cf3ce02b50b7e7405a00f15fa4
Author: Steven Rand <[email protected]>
Date: 2017-10-19T04:51:26Z
call loginUserFromKeytab before accessing hdfs
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
