Andrejs Dubovskis created OOZIE-2049:
----------------------------------------
Summary: got exception while using Hive2Credentials
Key: OOZIE-2049
URL: https://issues.apache.org/jira/browse/OOZIE-2049
Project: Oozie
Issue Type: Bug
Components: security
Affects Versions: 4.0.0
Environment: CDH5.2 + CM + Kerberos
Reporter: Andrejs Dubovskis
Priority: Minor
workflow.xml contains has hive2 credentials and java action links to it.
oozie-site.xml mentions hive2 in oozie.credentials.credentialclasses
{code}
2014-10-29 12:11:03,765 DEBUG
org.apache.oozie.action.hadoop.JavaActionExecutor: SERVER[idctst054]
USER[catalyst] GROUP[-] TOKEN[] APP[${appName}]
JOB[0000004-141024125828670-oozie-oozi-W]
ACTION[0000004-141024125828670-oozie-oozi-W@UpdateImpalaCat] Get credential
'hive2auth' properties for action :
0000004-141024125828670-oozie-oozi-W@UpdateImpalaCat
2014-10-29 12:11:03,774 DEBUG
org.apache.oozie.action.hadoop.JavaActionExecutor: SERVER[idctst054]
USER[catalyst] GROUP[-] TOKEN[] APP[${appName}]
JOB[0000004-141024125828670-oozie-oozi-W]
ACTION[0000004-141024125828670-oozie-oozi-W@UpdateImpalaCat] getCredProperties:
Name: hbaseauth, Type: hbase
2014-10-29 12:11:03,774 DEBUG
org.apache.oozie.action.hadoop.JavaActionExecutor: SERVER[idctst054]
USER[catalyst] GROUP[-] TOKEN[] APP[${appName}]
JOB[0000004-141024125828670-oozie-oozi-W]
ACTION[0000004-141024125828670-oozie-oozi-W@UpdateImpalaCat] getCredProperties:
Name: hive2auth, Type: hive2
2014-10-29 12:11:03,774 DEBUG
org.apache.oozie.action.hadoop.JavaActionExecutor: SERVER[idctst054]
USER[catalyst] GROUP[-] TOKEN[] APP[${appName}]
JOB[0000004-141024125828670-oozie-oozi-W]
ACTION[0000004-141024125828670-oozie-oozi-W@UpdateImpalaCat] getCredProperties:
Properties name :'hive2.server.principal', Value :
'impala/[email protected]'
2014-10-29 12:11:03,775 DEBUG
org.apache.oozie.action.hadoop.JavaActionExecutor: SERVER[idctst054]
USER[catalyst] GROUP[-] TOKEN[] APP[${appName}]
JOB[0000004-141024125828670-oozie-oozi-W]
ACTION[0000004-141024125828670-oozie-oozi-W@UpdateImpalaCat] getCredProperties:
Properties name :'hive2.jdbc.url', Value : 'jdbc:hive2://idctst050:21050/'
2014-10-29 12:11:03,775 DEBUG
org.apache.oozie.action.hadoop.JavaActionExecutor: SERVER[idctst054]
USER[catalyst] GROUP[-] TOKEN[] APP[${appName}]
JOB[0000004-141024125828670-oozie-oozi-W]
ACTION[0000004-141024125828670-oozie-oozi-W@UpdateImpalaCat] Credential
Properties set for action : 0000004-141024125828670-oozie-oozi-W@UpdateImpalaCat
2014-10-29 12:11:03,775 DEBUG
org.apache.oozie.action.hadoop.JavaActionExecutor: SERVER[idctst054]
USER[catalyst] GROUP[-] TOKEN[] APP[${appName}]
JOB[0000004-141024125828670-oozie-oozi-W]
ACTION[0000004-141024125828670-oozie-oozi-W@UpdateImpalaCat] property :
'hive2.server.principal', value : 'impala/[email protected]'
2014-10-29 12:11:03,775 DEBUG
org.apache.oozie.action.hadoop.JavaActionExecutor: SERVER[idctst054]
USER[catalyst] GROUP[-] TOKEN[] APP[${appName}]
JOB[0000004-141024125828670-oozie-oozi-W]
ACTION[0000004-141024125828670-oozie-oozi-W@UpdateImpalaCat] property :
'hive2.jdbc.url', value : 'jdbc:hive2://idctst050:21050/'
2014-10-29 12:11:03,776 DEBUG
org.apache.oozie.action.hadoop.CredentialsProvider: SERVER[idctst054]
USER[catalyst] GROUP[-] TOKEN[] APP[${appName}]
JOB[0000000-141024125828670-oozie-oozi-W]
ACTION[0000000-141024125828670-oozie-oozi-W@LogWorkflowStart] Credentials
Provider is created for Type: hive2
2014-10-29 12:11:03,776 DEBUG
org.apache.oozie.action.hadoop.CredentialsProvider: SERVER[idctst054]
USER[catalyst] GROUP[-] TOKEN[] APP[${appName}]
JOB[0000000-141024125828670-oozie-oozi-W]
ACTION[0000000-141024125828670-oozie-oozi-W@LogWorkflowStart] Creating
Credential class for : hcat=org.apache.oozie.action.hadoop.HCatCredentials
2014-10-29 12:11:03,776 DEBUG
org.apache.oozie.action.hadoop.CredentialsProvider: SERVER[idctst054]
USER[catalyst] GROUP[-] TOKEN[] APP[${appName}]
JOB[0000000-141024125828670-oozie-oozi-W]
ACTION[0000000-141024125828670-oozie-oozi-W@LogWorkflowStart] Creating
Credential type : 'hcat', class Name :
'org.apache.oozie.action.hadoop.HCatCredentials'
2014-10-29 12:11:03,776 DEBUG
org.apache.oozie.action.hadoop.CredentialsProvider: SERVER[idctst054]
USER[catalyst] GROUP[-] TOKEN[] APP[${appName}]
JOB[0000000-141024125828670-oozie-oozi-W]
ACTION[0000000-141024125828670-oozie-oozi-W@LogWorkflowStart] Creating
Credential class for : hbase=org.apache.oozie.action.hadoop.HbaseCredentials
2014-10-29 12:11:03,776 DEBUG
org.apache.oozie.action.hadoop.CredentialsProvider: SERVER[idctst054]
USER[catalyst] GROUP[-] TOKEN[] APP[${appName}]
JOB[0000000-141024125828670-oozie-oozi-W]
ACTION[0000000-141024125828670-oozie-oozi-W@LogWorkflowStart] Creating
Credential type : 'hbase', class Name :
'org.apache.oozie.action.hadoop.HbaseCredentials'
2014-10-29 12:11:03,776 DEBUG
org.apache.oozie.action.hadoop.CredentialsProvider: SERVER[idctst054]
USER[catalyst] GROUP[-] TOKEN[] APP[${appName}]
JOB[0000000-141024125828670-oozie-oozi-W]
ACTION[0000000-141024125828670-oozie-oozi-W@LogWorkflowStart] Creating
Credential class for : hive2=org.apache.oozie.action.hadoop.Hive2Credentials
2014-10-29 12:11:03,776 DEBUG
org.apache.oozie.action.hadoop.CredentialsProvider: SERVER[idctst054]
USER[catalyst] GROUP[-] TOKEN[] APP[${appName}]
JOB[0000000-141024125828670-oozie-oozi-W]
ACTION[0000000-141024125828670-oozie-oozi-W@LogWorkflowStart] Creating
Credential type : 'hive2', class Name :
'org.apache.oozie.action.hadoop.Hive2Credentials'
2014-10-29 12:11:03,787 DEBUG org.apache.thrift.transport.TSaslClientTransport:
SERVER[idctst054] Sending mechanism name GSSAPI and initial response of length
656
2014-10-29 12:11:04,105 DEBUG org.apache.oozie.action.hadoop.Hive2Credentials:
SERVER[idctst054] USER[catalyst] GROUP[-] TOKEN[] APP[${appName}]
JOB[0000004-141024125828670-oozie-oozi-W]
ACTION[0000004-141024125828670-oozie-oozi-W@UpdateImpalaCat] Connected
successfully to
jdbc:hive2://idctst050:21050/;principal=impala/[email protected]
2014-10-29 12:11:04,122 DEBUG org.apache.oozie.action.hadoop.Hive2Credentials:
SERVER[idctst054] USER[catalyst] GROUP[-] TOKEN[] APP[${appName}]
JOB[0000004-141024125828670-oozie-oozi-W]
ACTION[0000004-141024125828670-oozie-oozi-W@UpdateImpalaCat] Got token
2014-10-29 12:11:04,138 WARN org.apache.oozie.action.hadoop.Hive2Credentials:
SERVER[idctst054] USER[catalyst] GROUP[-] TOKEN[] APP[${appName}]
JOB[0000004-141024125828670-oozie-oozi-W]
ACTION[0000004-141024125828670-oozie-oozi-W@UpdateImpalaCat] Exception in
addtoJobConf
java.lang.NullPointerException
at org.apache.hadoop.security.token.Token.decodeWritable(Token.java:256)
at
org.apache.hadoop.security.token.Token.decodeFromUrlString(Token.java:275)
at
org.apache.oozie.action.hadoop.Hive2Credentials.addtoJobConf(Hive2Credentials.java:70)
at
org.apache.oozie.action.hadoop.JavaActionExecutor.setCredentialTokens(JavaActionExecutor.java:1054)
at
org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:914)
at
org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:1135)
at
org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:228)
at
org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:63)
at org.apache.oozie.command.XCommand.call(XCommand.java:281)
at
org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:323)
at
org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:252)
at
org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:174)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)