[
https://issues.apache.org/jira/browse/MAPREDUCE-3499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13194326#comment-13194326
]
Alejandro Abdelnur commented on MAPREDUCE-3499:
-----------------------------------------------
I've applied this patch locally and tested Oozie with it. The patch seems to do
the trick to pass the proxyuser issue.
However I'm not running into the following error when trying run an Oozie
testcase that submits a MR job to MiniMR:
{code}
testRecovery(org.apache.oozie.action.hadoop.TestJavaActionExecutor) Time
elapsed: 0.994 sec <<< ERROR!
org.apache.oozie.action.ActionExecutorException: NullPointerException: null
at
org.apache.oozie.action.ActionExecutor.convertException(ActionExecutor.java:386)
at
org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:670)
at
org.apache.oozie.action.hadoop.TestJavaActionExecutor.submitAction(TestJavaActionExecutor.java:326)
at
org.apache.oozie.action.hadoop.TestJavaActionExecutor.testRecovery(TestJavaActionExecutor.java:578)
Caused by: java.lang.NullPointerException
at
org.apache.hadoop.mapred.YARNRunner.getDelegationTokenFromHS(YARNRunner.java:193)
at org.apache.hadoop.mapred.YARNRunner.submitJob(YARNRunner.java:270)
at
org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:379)
at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1215)
at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1212)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1177)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:1212)
at org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:611)
at org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:606)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1177)
at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:606)
at
org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:655)
... 30 more
{code}
Is this still related or ...?
> New MiniMR does not setup proxyuser configuration correctly, thus tests using
> doAs do not work
> ----------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3499
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3499
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, test
> Affects Versions: 0.23.1, 0.24.0
> Reporter: Alejandro Abdelnur
> Assignee: John George
> Priority: Critical
> Labels: bigtop
> Fix For: 0.23.1, 0.24.0
>
> Attachments: MR-3499.patch, TestForMAPREDUCE-3499.patch
>
>
> The new MiniMR implementation is not taking proxyuser settings.
> Because of this, testcases using/testing doAs functionality fail.
> This affects all Oozie testcases that use MiniMR.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
