Todd Lipcon has submitted this change and it was merged. Change subject: mapreduce: support for running on secure clusters ......................................................................
mapreduce: support for running on secure clusters This adds the appropriate hooks to grab authentication credentials at job submission time and add them to the job's Credentials object as a Hadoop "Token". The tasks then grab the Token and import it into the client they create before using it. It's not possible to test this since we don't have support for running Kerberized Yarn clusters in the MiniCluster environment. I tested manually on a secure cluster using ImportTsv, ITBLL, and RowCounter jobs. Change-Id: Ieed43b9c8646aaee549078a26850e7e7bdecd802 Reviewed-on: http://gerrit.cloudera.org:8080/6237 Tested-by: Kudu Jenkins Reviewed-by: Jean-Daniel Cryans <[email protected]> --- M java/kudu-client-tools/src/main/java/org/apache/kudu/mapreduce/tools/IntegrationTestBigLinkedList.java M java/kudu-client/src/main/java/org/apache/kudu/client/AsyncKuduClient.java M java/kudu-client/src/main/java/org/apache/kudu/client/KuduClient.java M java/kudu-mapreduce/src/main/java/org/apache/kudu/mapreduce/CommandLineParser.java M java/kudu-mapreduce/src/main/java/org/apache/kudu/mapreduce/KuduTableInputFormat.java M java/kudu-mapreduce/src/main/java/org/apache/kudu/mapreduce/KuduTableMapReduceUtil.java M java/kudu-mapreduce/src/main/java/org/apache/kudu/mapreduce/KuduTableOutputFormat.java 7 files changed, 128 insertions(+), 2 deletions(-) Approvals: Jean-Daniel Cryans: Looks good to me, approved Kudu Jenkins: Verified -- To view, visit http://gerrit.cloudera.org:8080/6237 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-MessageType: merged Gerrit-Change-Id: Ieed43b9c8646aaee549078a26850e7e7bdecd802 Gerrit-PatchSet: 2 Gerrit-Project: kudu Gerrit-Branch: master Gerrit-Owner: Todd Lipcon <[email protected]> Gerrit-Reviewer: Dan Burkert <[email protected]> Gerrit-Reviewer: Jean-Daniel Cryans <[email protected]> Gerrit-Reviewer: Kudu Jenkins Gerrit-Reviewer: Todd Lipcon <[email protected]>
