Oozie question
I'm trying to run an Oozie workflow (sqoop action) from the Hue console and it
fails every time. No exception in the oozie log but I see this in the Job
Tracker log file.
Two primary issues seem to be
1. Client mapred tries to renew a token with renewer specified as mr token
And
2. Cannot find class for token kind MAPREDUCE_DELEGATION_TOKEN
Any ideas how to get past this?
Full Stacktrace:
2013-01-29 17:11:28,860 INFO
org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager:
Creating password for identifier: owner=hdfs, renewer=mr token,
realUser=oozie, issueDate=1359501088860, maxDate=1360105888860,
sequenceNumber=75, masterKeyId=8
2013-01-29 17:11:28,871 INFO
org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager:
Creating password for identifier: owner=hdfs, renewer=mr token,
realUser=oozie, issueDate=1359501088871, maxDate=1360105888871,
sequenceNumber=76, masterKeyId=8
2013-01-29 17:11:29,202 INFO
org.apache.hadoop.mapreduce.security.token.DelegationTokenRenewal: registering
token for renewal for service =10.204.12.62:8021 and jobID =
job_201301231648_0029
2013-01-29 17:11:29,211 INFO
org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager:
Token renewal requested for identifier: owner=hdfs, renewer=mr token,
realUser=oozie, issueDate=1359501088871, maxDate=1360105888871,
sequenceNumber=76, masterKeyId=8
2013-01-29 17:11:29,211 ERROR org.apache.hadoop.security.UserGroupInformation:
PriviledgedActionException as:mapred (auth:SIMPLE)
cause:org.apache.hadoop.security.AccessControlException: Client mapred tries to
renew a token with renewer specified as mr token
2013-01-29 17:11:29,211 WARN org.apache.hadoop.security.token.Token: Cannot
find class for token kind MAPREDUCE_DELEGATION_TOKEN
2013-01-29 17:11:29,211 INFO org.apache.hadoop.ipc.Server: IPC Server handler 9
on 8021, call renewDelegationToken(Kind: MAPREDUCE_DELEGATION_TOKEN, Service:
10.204.12.62:8021, Ident: 00 04 68 64 66 73 08 6d 72 20 74 6f 6b 65 6e 05 6f 6f
7a 69 65 8a 01 3c 88 94 58 67 8a 01 3c ac a0 dc 67 4c 08), rpc version=2,
client version=28, methodsFingerPrint=1830206421 from 10.204.12.62:9706: error:
org.apache.hadoop.security.AccessControlException: Client mapred tries to renew
a token with renewer specified as mr token
org.apache.hadoop.security.AccessControlException: Client mapred tries to renew
a token with renewer specified as mr token
at
org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager.renewToken(AbstractDelegationTokenSecretManager.java:274)
at
org.apache.hadoop.mapred.JobTracker.renewDelegationToken(JobTracker.java:3738)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.apache.hadoop.ipc.WritableRpcEngine$Server$WritableRpcInvoker.call(WritableRpcEngine.java:474)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:898)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1693)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1689)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1332)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1687)
2013-01-29 17:11:29,212 ERROR org.apache.hadoop.security.UserGroupInformation:
PriviledgedActionException as:mapred (auth:SIMPLE)
cause:org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.AccessControlException):
Client mapred tries to renew a token with renewer specified as mr token
at
org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager.renewToken(AbstractDelegationTokenSecretManager.java:274)
at
org.apache.hadoop.mapred.JobTracker.renewDelegationToken(JobTracker.java:3738)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.apache.hadoop.ipc.WritableRpcEngine$Server$WritableRpcInvoker.call(WritableRpcEngine.java:474)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:898)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1693)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1689)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1332)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1687)
2013-01-29 17:11:29,212 WARN org.apache.hadoop.security.token.Token: Cannot
find class for token kind MAPREDUCE_DELEGATION_TOKEN
2013-01-29 17:11:29,212 ERROR
org.apache.hadoop.mapreduce.security.token.DelegationTokenRenewal: Exception
renewing tokenKind: MAPREDUCE_DELEGATION_TOKEN, Service: 10.204.12.62:8021,
Ident: 00 04 68 64 66 73 08 6d 72 20 74 6f 6b 65 6e 05 6f 6f 7a 69 65 8a 01 3c
88 94 58 67 8a 01 3c ac a0 dc 67 4c 08. Not rescheduled
org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.AccessControlException):
Client mapred tries to renew a token with renewer specified as mr token
at
org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager.renewToken(AbstractDelegationTokenSecretManager.java:274)
at
org.apache.hadoop.mapred.JobTracker.renewDelegationToken(JobTracker.java:3738)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.apache.hadoop.ipc.WritableRpcEngine$Server$WritableRpcInvoker.call(WritableRpcEngine.java:474)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:898)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1693)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1689)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1332)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1687)
at org.apache.hadoop.ipc.Client.call(Client.java:1160)
at
org.apache.hadoop.ipc.WritableRpcEngine$Invoker.invoke(WritableRpcEngine.java:225)
at org.apache.hadoop.mapred.$Proxy12.renewDelegationToken(Unknown
Source)
at
org.apache.hadoop.mapred.JobClient$Renewer.renew(JobClient.java:541)
at org.apache.hadoop.security.token.Token.renew(Token.java:372)
at
org.apache.hadoop.mapreduce.security.token.DelegationTokenRenewal$RenewalTimerTask$1.run(DelegationTokenRenewal.java:218)
at
org.apache.hadoop.mapreduce.security.token.DelegationTokenRenewal$RenewalTimerTask$1.run(DelegationTokenRenewal.java:214)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1332)
at
org.apache.hadoop.mapreduce.security.token.DelegationTokenRenewal$RenewalTimerTask.run(DelegationTokenRenewal.java:213)
at java.util.TimerThread.mainLoop(Timer.java:512)
at java.util.TimerThread.run(Timer.java:462)
~Corbett Martin
Software Architect
AbsoluteAR Accounts Receivable Services - An NHIN Solution
________________________________
This message and its contents (to include attachments) are the property of
National Health Systems, Inc. and may contain confidential and proprietary
information. This email and any files transmitted with it are intended solely
for the use of the individual or entity to whom they are addressed. You are
hereby notified that any unauthorized disclosure, copying, or distribution of
this message, or the taking of any unauthorized action based on information
contained herein is strictly prohibited. Unauthorized use of information
contained herein may subject you to civil and criminal prosecution and
penalties. If you are not the intended recipient, you should delete this
message immediately and notify the sender immediately by telephone or by
replying to this transmission.
