[
https://issues.apache.org/jira/browse/HIVE-18363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16310767#comment-16310767
]
Anuradha Gadge commented on HIVE-18363:
---------------------------------------
fs.default.name/fs.defaultFS is set to hdfs://<ip>:8020, which means default fs
is hdfs.
But continuation to above issue, even if I try command with file prefix it is
not working.
Command: add jar
file:///home/anuradha/shareinsights/udfs/hivexmlserde-1.0.5.3.jar;
Log trace on hiveserver2:
2018-01-04 11:06:00,881 INFO [HiveServer2-Handler-Pool: Thread-36]:
session.HiveSessionImpl (HiveSessionImpl.java:acquire(304)) - We are setting
the hadoop caller context to 5b895579-78f7-4057-b289-b4e4e7dbd16b for thread
HiveServer2-Handler-Pool: Thread-36
2018-01-04 11:06:00,881 INFO [HiveServer2-Handler-Pool: Thread-36]:
operation.Operation (HiveCommandOperation.java:setupSessionIO(69)) - Putting
temp output to file
/tmp/hive/5b895579-78f7-4057-b289-b4e4e7dbd16b5283435069997218995.pipeout
2018-01-04 11:06:00,882 DEBUG [HiveServer2-Handler-Pool: Thread-36]:
parse.VariableSubstitution (VariableSubstitution.java:substitute(53)) -
Substitution is on: jar
file:///home/anuradha/shareinsights/udfs/hivexmlserde-1.0.5.3.jar
2018-01-04 11:06:00,882 INFO [HiveServer2-Handler-Pool: Thread-36]:
sqlstd.SQLStdHiveAccessController (SQLStdHiveAccessController.java:<init>(95))
- Created SQLStdHiveAccessController for session context :
HiveAuthzSessionContext [sessionString=5b895579-78f7-4057-b289-b4e4e7dbd16b,
clientType=HIVESERVER2]
2018-01-04 11:06:00,882 DEBUG [HiveServer2-Handler-Pool: Thread-36]:
session.SessionState (SessionState.java:setupAuth(721)) - Session is using
authorization class class
org.apache.hadoop.hive.ql.security.authorization.plugin.HiveAuthorizerImpl
2018-01-04 11:06:00,883 ERROR [HiveServer2-Handler-Pool: Thread-36]:
SessionState (SessionState.java:printError(932)) -
file:///home/anuradha/shareinsights/udfs/hivexmlserde-1.0.5.3.jar does not exist
java.lang.IllegalArgumentException:
file:///home/anuradha/shareinsights/udfs/hivexmlserde-1.0.5.3.jar does not exist
at
org.apache.hadoop.hive.ql.session.SessionState.validateFiles(SessionState.java:970)
at
org.apache.hadoop.hive.ql.session.SessionState$ResourceType.preHook(SessionState.java:1074)
at
org.apache.hadoop.hive.ql.session.SessionState$ResourceType$1.preHook(SessionState.java:1063)
at
org.apache.hadoop.hive.ql.session.SessionState.add_resources(SessionState.java:1163)
at
org.apache.hadoop.hive.ql.session.SessionState.add_resources(SessionState.java:1121)
at
org.apache.hadoop.hive.ql.processors.AddResourceProcessor.run(AddResourceProcessor.java:67)
at
org.apache.hive.service.cli.operation.HiveCommandOperation.runInternal(HiveCommandOperation.java:105)
at
org.apache.hive.service.cli.operation.Operation.run(Operation.java:257)
at
org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementInternal(HiveSessionImpl.java:419)
at
org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementAsync(HiveSessionImpl.java:406)
at
org.apache.hive.service.cli.CLIService.executeStatementAsync(CLIService.java:274)
at
org.apache.hive.service.cli.thrift.ThriftCLIService.ExecuteStatement(ThriftCLIService.java:486)
at
org.apache.hive.service.cli.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1317)
at
org.apache.hive.service.cli.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1302)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
at
org.apache.hive.service.auth.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:56)
at
org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:285)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2018-01-04 11:06:00,884 INFO [HiveServer2-Handler-Pool: Thread-36]:
session.HiveSessionImpl (HiveSessionImpl.java:release(318)) - We are resetting
the hadoop caller context for thread HiveServer2-Handler-Pool: Thread-36
2018-01-04 11:06:00,884 WARN [HiveServer2-Handler-Pool: Thread-36]:
thrift.ThriftCLIService (ThriftCLIService.java:ExecuteStatement(492)) - Error
executing statement:
org.apache.hive.service.cli.HiveSQLException: Error while processing statement:
file:///home/anuradha/shareinsights/udfs/hivexmlserde-1.0.5.3.jar does not exist
at
org.apache.hive.service.cli.operation.Operation.toSQLException(Operation.java:315)
at
org.apache.hive.service.cli.operation.HiveCommandOperation.runInternal(HiveCommandOperation.java:108)
at
org.apache.hive.service.cli.operation.Operation.run(Operation.java:257)
at
org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementInternal(HiveSessionImpl.java:419)
at
org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementAsync(HiveSessionImpl.java:406)
at
org.apache.hive.service.cli.CLIService.executeStatementAsync(CLIService.java:274)
at
org.apache.hive.service.cli.thrift.ThriftCLIService.ExecuteStatement(ThriftCLIService.java:486)
at
org.apache.hive.service.cli.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1317)
at
org.apache.hive.service.cli.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1302)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
at
org.apache.hive.service.auth.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:56)
at
org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:285)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2018-01-04 11:06:00,885 DEBUG [HiveServer2-Handler-Pool: Thread-36]:
transport.TSaslTransport (TSaslTransport.java:flush(498)) - writing data
length: 1745
> Not able to add jar from local path other than HIVE_HOME' path using beeline
> ----------------------------------------------------------------------------
>
> Key: HIVE-18363
> URL: https://issues.apache.org/jira/browse/HIVE-18363
> Project: Hive
> Issue Type: Bug
> Components: Beeline, HiveServer2, Thrift API
> Affects Versions: 1.2.1
> Reporter: Anuradha Gadge
> Priority: Critical
>
> When I tried to add jar from local path to hive using beeline it fails. When
> I put jar in some directory in HIVE_HOME, I could add it using that local
> path. But for paths other than HIVE_HOME it did not worked.
> Note: For hive-cli I could add jar from any local paths.
> Command I tried : add jar
> /home/anuradha/shareinsights/udfs/hivexmlserde-1.0.5.3.jar;
> Stack Trace for Hiveserver2:
> 2018-01-03 18:43:03,086 DEBUG [HiveServer2-Handler-Pool: Thread-41]:
> transport.TSaslTransport (TSaslTransport.java:readFrame(459)) - SERVER:
> reading data length: 173
> 2018-01-03 18:43:03,087 INFO [HiveServer2-Handler-Pool: Thread-41]:
> session.HiveSessionImpl (HiveSessionImpl.java:acquire(304)) - We are setting
> the hadoop caller context to ea0f9b24-89ff-4225-9948-6112bbb29189 for thread
> HiveServer2-Handler-Pool: Thread-41
> 2018-01-03 18:43:03,087 INFO [HiveServer2-Handler-Pool: Thread-41]:
> operation.Operation (HiveCommandOperation.java:setupSessionIO(69)) - Putting
> temp output to file
> /tmp/hive/ea0f9b24-89ff-4225-9948-6112bbb291891944312414426376214.pipeout
> 2018-01-03 18:43:03,088 DEBUG [HiveServer2-Handler-Pool: Thread-41]:
> parse.VariableSubstitution (VariableSubstitution.java:substitute(53)) -
> Substitution is on: jar
> /home/anuradha/shareinsights/udfs/hivexmlserde-1.0.5.3.jar
> 2018-01-03 18:43:03,089 ERROR [HiveServer2-Handler-Pool: Thread-41]:
> SessionState (SessionState.java:printError(932)) -
> /home/anuradha/shareinsights/udfs/hivexmlserde-1.0.5.3.jar does not exist
> java.lang.IllegalArgumentException:
> /home/anuradha/shareinsights/udfs/hivexmlserde-1.0.5.3.jar does not exist
> at
> org.apache.hadoop.hive.ql.session.SessionState.validateFiles(SessionState.java:970)
> at
> org.apache.hadoop.hive.ql.session.SessionState$ResourceType.preHook(SessionState.java:1074)
> at
> org.apache.hadoop.hive.ql.session.SessionState$ResourceType$1.preHook(SessionState.java:1063)
> at
> org.apache.hadoop.hive.ql.session.SessionState.add_resources(SessionState.java:1163)
> at
> org.apache.hadoop.hive.ql.session.SessionState.add_resources(SessionState.java:1121)
> at
> org.apache.hadoop.hive.ql.processors.AddResourceProcessor.run(AddResourceProcessor.java:67)
> at
> org.apache.hive.service.cli.operation.HiveCommandOperation.runInternal(HiveCommandOperation.java:105)
> at
> org.apache.hive.service.cli.operation.Operation.run(Operation.java:257)
> at
> org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementInternal(HiveSessionImpl.java:419)
> at
> org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementAsync(HiveSessionImpl.java:406)
> at
> org.apache.hive.service.cli.CLIService.executeStatementAsync(CLIService.java:274)
> at
> org.apache.hive.service.cli.thrift.ThriftCLIService.ExecuteStatement(ThriftCLIService.java:486)
> at
> org.apache.hive.service.cli.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1317)
> at
> org.apache.hive.service.cli.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1302)
> at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
> at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
> at
> org.apache.hive.service.auth.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:56)
> at
> org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:285)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> 2018-01-03 18:43:03,089 INFO [HiveServer2-Handler-Pool: Thread-41]:
> session.HiveSessionImpl (HiveSessionImpl.java:release(318)) - We are
> resetting the hadoop caller context for thread HiveServer2-Handler-Pool:
> Thread-41
> 2018-01-03 18:43:03,089 WARN [HiveServer2-Handler-Pool: Thread-41]:
> thrift.ThriftCLIService (ThriftCLIService.java:ExecuteStatement(492)) - Error
> executing statement:
> org.apache.hive.service.cli.HiveSQLException: Error while processing
> statement: /home/anuradha/shareinsights/udfs/hivexmlserde-1.0.5.3.jar does
> not exist
> at
> org.apache.hive.service.cli.operation.Operation.toSQLException(Operation.java:315)
> at
> org.apache.hive.service.cli.operation.HiveCommandOperation.runInternal(HiveCommandOperation.java:108)
> at
> org.apache.hive.service.cli.operation.Operation.run(Operation.java:257)
> at
> org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementInternal(HiveSessionImpl.java:419)
> at
> org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementAsync(HiveSessionImpl.java:406)
> at
> org.apache.hive.service.cli.CLIService.executeStatementAsync(CLIService.java:274)
> at
> org.apache.hive.service.cli.thrift.ThriftCLIService.ExecuteStatement(ThriftCLIService.java:486)
> at
> org.apache.hive.service.cli.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1317)
> at
> org.apache.hive.service.cli.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1302)
> at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
> at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
> at
> org.apache.hive.service.auth.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:56)
> at
> org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:285)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> 2018-01-03 18:43:03,090 DEBUG [HiveServer2-Handler-Pool: Thread-41]:
> transport.TSaslTransport (TSaslTransport.java:flush(498)) - writing data
> length: 1731
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
