Dileep Kumar Chiguruvada created HIVE-20105:
-----------------------------------------------
Summary: Druid-Hive: tpcds query on timestamp throws
java.lang.IllegalArgumentException: Cannot create timestamp, parsing error
Key: HIVE-20105
URL: https://issues.apache.org/jira/browse/HIVE-20105
Project: Hive
Issue Type: Bug
Components: Hive
Affects Versions: 3.0.0
Reporter: Dileep Kumar Chiguruvada
Fix For: 3.0.0
Druid-Hive: tpcds query on timestamp trows java.lang.IllegalArgumentException:
Cannot create timestamp, parsing error.
{code}
SELECT `__time`, max(ss_quantity), sum(ss_wholesale_cost)
FROM misc_store_sales_denormalized_subset
GROUP BY `__time`;
INFO : Compiling
command(queryId=hive_20180705123007_dd94e295-9e3e-440e-9818-2e7f8458f06d):
SELECT `__time`, max(ss_quantity), sum(ss_wholesale_cost)
FROM misc_store_sales_denormalized_subset
GROUP BY `__time`
INFO : Semantic Analysis Completed (retrial = false)
INFO : Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:__time,
type:timestamp, comment:null), FieldSchema(name:$f1, type:int, comment:null),
FieldSchema(name:$f2, type:double, comment:null)], properties:null)
INFO : Completed compiling
command(queryId=hive_20180705123007_dd94e295-9e3e-440e-9818-2e7f8458f06d); Time
taken: 0.143 seconds
INFO : Executing
command(queryId=hive_20180705123007_dd94e295-9e3e-440e-9818-2e7f8458f06d):
SELECT `__time`, max(ss_quantity), sum(ss_wholesale_cost)
FROM misc_store_sales_denormalized_subset
GROUP BY `__time`
INFO : Completed executing
command(queryId=hive_20180705123007_dd94e295-9e3e-440e-9818-2e7f8458f06d); Time
taken: 0.003 seconds
INFO : OK
org.apache.hive.service.cli.HiveSQLException: java.io.IOException:
java.lang.IllegalArgumentException: Cannot create timestamp, parsing error
Closing: 0:
jdbc:hive2://ctr-e138-1518143905142-397384-01-000006.hwx.site:2181,ctr-e138-1518143905142-397384-01-000005.hwx.site:2181,ctr-e138-1518143905142-397384-01-000004.hwx.site:2181,ctr-e138-1518143905142-397384-01-000007.hwx.site:2181,ctr-e138-1518143905142-397384-01-000008.hwx.site:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2-interactive;principal=hive/_h...@hwqe.hortonworks.com
{code}
Facing this issue after removed condition to create Druid Hive table with
(TIMESTAMP with local time zone)
{code}
-SELECT CAST(d_date AS TIMESTAMP with local time zone) AS `__time`,
+SELECT CAST(d_date AS TIMESTAMP) AS `__time`,
{code}
create table with
SELECT CAST(d_date AS TIMESTAMP with local time zone) AS `__time . works fine
HSI log:
{code}
2018-07-05T12:30:08,297 INFO [6b9ca95f-3aee-44cc-b2eb-2aa9bdec2b38
HiveServer2-Handler-Pool: Thread-326]: session.SessionState
(SessionState.java:resetThreadName(449)) - Resetting thread name to
HiveServer2-Handler-Pool: Thread-326
2018-07-05T12:30:08,297 WARN [HiveServer2-Handler-Pool: Thread-326]:
thrift.ThriftCLIService (ThriftCLIService.java:FetchResults(795)) - Error
fetching results:
org.apache.hive.service.cli.HiveSQLException: java.io.IOException:
java.lang.IllegalArgumentException: Cannot create timestamp, parsing error
at
org.apache.hive.service.cli.operation.SQLOperation.getNextRowSet(SQLOperation.java:465)
~[hive-service-3.1.0.3.0.0.0-1602.jar:3.1.0.3.0.0.0-1602]
at
org.apache.hive.service.cli.operation.OperationManager.getOperationNextRowSet(OperationManager.java:309)
~[hive-service-3.1.0.3.0.0.0-1602.jar:3.1.0.3.0.0.0-1602]
at
org.apache.hive.service.cli.session.HiveSessionImpl.fetchResults(HiveSessionImpl.java:905)
~[hive-service-3.1.0.3.0.0.0-1602.jar:3.1.0.3.0.0.0-1602]
at
org.apache.hive.service.cli.CLIService.fetchResults(CLIService.java:561)
~[hive-service-3.1.0.3.0.0.0-1602.jar:3.1.0.3.0.0.0-1602]
at
org.apache.hive.service.cli.thrift.ThriftCLIService.FetchResults(ThriftCLIService.java:786)
[hive-service-3.1.0.3.0.0.0-1602.jar:3.1.0.3.0.0.0-1602]
at
org.apache.hive.service.rpc.thrift.TCLIService$Processor$FetchResults.getResult(TCLIService.java:1837)
[hive-exec-3.1.0.3.0.0.0-1602.jar:3.1.0.3.0.0.0-1602]
at
org.apache.hive.service.rpc.thrift.TCLIService$Processor$FetchResults.getResult(TCLIService.java:1822)
[hive-exec-3.1.0.3.0.0.0-1602.jar:3.1.0.3.0.0.0-1602]
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
[hive-exec-3.1.0.3.0.0.0-1602.jar:3.1.0.3.0.0.0-1602]
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
[hive-exec-3.1.0.3.0.0.0-1602.jar:3.1.0.3.0.0.0-1602]
at
org.apache.hadoop.hive.metastore.security.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor.process(HadoopThriftAuthBridge.java:647)
[hive-exec-3.1.0.3.0.0.0-1602.jar:3.1.0.3.0.0.0-1602]
at
org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286)
[hive-exec-3.1.0.3.0.0.0-1602.jar:3.1.0.3.0.0.0-1602]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[?:1.8.0_112]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[?:1.8.0_112]
at java.lang.Thread.run(Thread.java:745) [?:1.8.0_112]
Caused by: java.io.IOException: java.lang.IllegalArgumentException: Cannot
create timestamp, parsing error
at
org.apache.hadoop.hive.ql.exec.FetchOperator.getNextRow(FetchOperator.java:602)
~[hive-exec-3.1.0.3.0.0.0-1602.jar:3.1.0.3.0.0.0-1602]
at
org.apache.hadoop.hive.ql.exec.FetchOperator.pushRow(FetchOperator.java:509)
~[hive-exec-3.1.0.3.0.0.0-1602.jar:3.1.0.3.0.0.0-1602]
at org.apache.hadoop.hive.ql.exec.FetchTask.fetch(FetchTask.java:146)
~[hive-exec-3.1.0.3.0.0.0-1602.jar:3.1.0.3.0.0.0-1602]
at org.apache.hadoop.hive.ql.Driver.getResults(Driver.java:2695)
~[hive-exec-3.1.0.3.0.0.0-1602.jar:3.1.0.3.0.0.0-1602]
at
org.apache.hadoop.hive.ql.reexec.ReExecDriver.getResults(ReExecDriver.java:229)
~[hive-exec-3.1.0.3.0.0.0-1602.jar:3.1.0.3.0.0.0-1602]
at
org.apache.hive.service.cli.operation.SQLOperation.getNextRowSet(SQLOperation.java:460)
~[hive-service-3.1.0.3.0.0.0-1602.jar:3.1.0.3.0.0.0-1602]
... 13 more
Caused by: java.lang.IllegalArgumentException: Cannot create timestamp, parsing
error
at
org.apache.hadoop.hive.common.type.Timestamp.valueOf(Timestamp.java:163)
~[hive-common-3.1.0.3.0.0.0-1602.jar:3.1.0.3.0.0.0-1602]
at
org.apache.hadoop.hive.druid.serde.DruidSerDe.deserialize(DruidSerDe.java:403)
~[hive-druid-handler-3.1.0.3.0.0.0-1602.jar:3.1.0.3.0.0.0-1602]
at
org.apache.hadoop.hive.ql.exec.FetchOperator.getNextRow(FetchOperator.java:583)
~[hive-exec-3.1.0.3.0.0.0-1602.jar:3.1.0.3.0.0.0-1602]
at
org.apache.hadoop.hive.ql.exec.FetchOperator.pushRow(FetchOperator.java:509)
~[hive-exec-3.1.0.3.0.0.0-1602.jar:3.1.0.3.0.0.0-1602]
at org.apache.hadoop.hive.ql.exec.FetchTask.fetch(FetchTask.java:146)
~[hive-exec-3.1.0.3.0.0.0-1602.jar:3.1.0.3.0.0.0-1602]
at org.apache.hadoop.hive.ql.Driver.getResults(Driver.java:2695)
~[hive-exec-3.1.0.3.0.0.0-1602.jar:3.1.0.3.0.0.0-1602]
at
org.apache.hadoop.hive.ql.reexec.ReExecDriver.getResults(ReExecDriver.java:229)
~[hive-exec-3.1.0.3.0.0.0-1602.jar:3.1.0.3.0.0.0-1602]
at
org.apache.hive.service.cli.operation.SQLOperation.getNextRowSet(SQLOperation.java:460)
~[hive-service-3.1.0.3.0.0.0-1602.jar:3.1.0.3.0.0.0-1602]
... 13 more
{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
