[
https://issues.apache.org/jira/browse/HIVE-21702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16835709#comment-16835709
]
Igor Bezuglyi commented on HIVE-21702:
--------------------------------------
>From the metastore log:
2019-05-08T15:58:49,663 DEBUG [pool-6-thread-6] pool.PoolBase: HikariPool-1 -
Reset (autoCommit) on connection org.postgresql.jdbc.PgConnection@1c8323b9
2019-05-08T15:58:49,664 ERROR [pool-6-thread-6] metastore.RetryingHMSHandler:
MetaException(message:java.lang.UnsupportedOperationException)
at
org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.newMetaException(HiveMetaStore.java:7230)
at
org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.rethrowException(HiveMetaStore.java:6256)
at
org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_partitions_by_expr(HiveMetaStore.java:6240)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:147)
at
org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:108)
at com.sun.proxy.$Proxy33.get_partitions_by_expr(Unknown Source)
at
org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$get_partitions_by_expr.getResult(ThriftHiveMetastore.java:16801)
at
org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$get_partitions_by_expr.getResult(ThriftHiveMetastore.java:16785)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
at
org.apache.hadoop.hive.metastore.TUGIBasedProcessor$1.run(TUGIBasedProcessor.java:111)
at
org.apache.hadoop.hive.metastore.TUGIBasedProcessor$1.run(TUGIBasedProcessor.java:107)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682)
at
org.apache.hadoop.hive.metastore.TUGIBasedProcessor.process(TUGIBasedProcessor.java:119)
at
org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.UnsupportedOperationException
at
org.apache.hadoop.hive.metastore.DefaultPartitionExpressionProxy.convertExprToFilter(DefaultPartitionExpressionProxy.java:34)
at
org.apache.hadoop.hive.metastore.PartFilterExprUtil.makeExpressionTree(PartFilterExprUtil.java:50)
at
org.apache.hadoop.hive.metastore.ObjectStore.getPartitionsByExprInternal(ObjectStore.java:3414)
at
org.apache.hadoop.hive.metastore.ObjectStore.getPartitionsByExpr(ObjectStore.java:3405)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:97)
at com.sun.proxy.$Proxy32.getPartitionsByExpr(Unknown Source)
at
org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_partitions_by_expr(HiveMetaStore.java:6235)
... 20 more
> Queries with filter on a partition column fail when using standalone metastore
> ------------------------------------------------------------------------------
>
> Key: HIVE-21702
> URL: https://issues.apache.org/jira/browse/HIVE-21702
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2, Standalone Metastore
> Affects Versions: 3.1.0
> Environment: HDP 3.1 on AWS (Hive 3.1.0)
> Standalone metastore on an EC2 instance (using
> hive-standalone-metastore-3.1.0.3.1.0.0-78.jar)
> Reporter: Igor Bezuglyi
> Priority: Major
> Attachments: hiveserver_ex.log, metastore.log, table_data_a.csv
>
>
> Queries with filter on a partition column fail when using standalone metastore
> Example (Hiveserver2 is pointing to a standalone metastore instance)
> {{create table test_a_src (id integer, value varchar(255), run_id
> varchar(14)) }}{{row format delimited fields terminated by ','}}{{stored as
> textfile;}}
> {{create table test_a (id integer, value varchar(255)) }}{{partitioned by
> (run_id varchar(14))}}{{row format delimited fields terminated by
> ','}}{{stored as textfile;}}
> {{<Upload a csv file to test_a_src data directory - test file is
> }}{{attached>}}
> {{insert into test_a select * from test_a_src;}}
> {{select id from test_a where run_id = '20190502123500';}}
> {{Error: Error while compiling statement: FAILED: SemanticException
> MetaException(message:java.lang.UnsupportedOperationException)
> (state=42000,code=40000)}}
> The same queries work fine when using the embedded metastore. Filters on any
> other column work fine as well. The problem is with partition columns.
> An excerpt from hiveserver2.log is attached.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)