[
https://issues.apache.org/jira/browse/IMPALA-12539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17783654#comment-17783654
]
Basapuram Kumar commented on IMPALA-12539:
------------------------------------------
I see couple of issues around the compute stats for impala tables on top of
Hive-4.
{code:java}
org.apache.thrift.protocol.TProtocolException: Required field 'engine' is
unset!
Struct:SetPartitionsStatsRequest(colStats:[ColumnStatistics(statsDesc:ColumnStatisticsDesc(isTblLevel:true,
dbName:tpcds_10000_parquet, tableName:t12, catName:hive),
statsObj:[ColumnStatisticsObj(colName:a1, colType:int,
statsData:<ColumnStatisticsData longStats:LongColumnStatsData(numNulls:0,
numDVs:1)>)])], needMerge:false, engine:null)
at
org.apache.hadoop.hive.metastore.api.SetPartitionsStatsRequest.validate(SetPartitionsStatsRequest.java:610)
~[hive-standalone-metastore-common.jar:3.1.4.3.2.2.0-1]
at
org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$update_table_column_statistics_req_args.validate(ThriftHiveMetastore.java)
~[hive-standalone-metastore-common.jar:3.1.4.3.2.2.0-1]
at
org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$update_table_column_statistics_req_args$update_table_column_statistics_req_argsStandardScheme.write(ThriftHiveMetastore.java)
~[hive-standalone-metastore-common.jar:3.1.4.3.2.2.0-1]
at
org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$update_table_column_statistics_req_args$update_table_column_statistics_req_argsStandardScheme.write(ThriftHiveMetastore.java)
~[hive-standalone-metastore-common.jar:3.1.4.3.2.2.0-1]
at
org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$update_table_column_statistics_req_args.write(ThriftHiveMetastore.java)
~[hive-standalone-metastore-common.jar:3.1.4.3.2.2.0-1]
at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:71)
~[libthrift-0.14.1.jar:0.14.1]
at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:62)
~[libthrift-0.14.1.jar:0.14.1] {code}
Here hive is apache-hive-4.0.0-alpha-1
> hive-4 compatibility with Impala
> --------------------------------
>
> Key: IMPALA-12539
> URL: https://issues.apache.org/jira/browse/IMPALA-12539
> Project: IMPALA
> Issue Type: Task
> Components: fe
> Affects Versions: Impala 4.1.2
> Environment: Hive-4.0.0-alpha-1
> Impala-4.1.2
> Reporter: Basapuram Kumar
> Priority: Major
>
> As of now , on "fe" it has compatibility with
> [hive-3|https://github.com/apache/impala/tree/master/fe/src] only.
> It will be nice to add the Hive-4.0.0-alpha-1 compatibility with Impala-4.1.2.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]