Re:Re: Re: Hive's performance for querying the Iceberg table is very poor.

2023-11-08 Thread lisoda
STEP1: CREATE TABLE USING SPARK: CREATE TABLE IF NOT EXISTS test.dwd.test_trade_table( `uni_order_id` string, `data_from` bigint,

Re: Re: Hive's performance for querying the Iceberg table is very poor.

2023-11-08 Thread Butao Zhang
Could you please provide detailed steps to reproduce this issue? e.g. how do you create the table? Thanks, Butao Zhang Replied Message | From | lisoda | | Date | 11/9/2023 14:25 | | To | | | Subject | Re:Re: Re: Hive's performance for querying the Iceberg table is very poor. |

Re:Re: Re: Hive's performance for querying the Iceberg table is very poor.

2023-11-08 Thread lisoda
Incidentally, I'm using a COW table, so there is no DELETE_FILE. 在 2023-11-09 10:57:35,"Butao Zhang" 写道: Hi lisoda. You can check this ticket https://issues.apache.org/jira/browse/HIVE-27347 which can use iceberg basic stats to optimize count(*) query. Note: it didn't take effect if

Re: Re: Hive's performance for querying the Iceberg table is very poor.

2023-11-08 Thread Butao Zhang
Hi lisoda. You can check this ticket https://issues.apache.org/jira/browse/HIVE-27347 which can use iceberg basic stats to optimize count(*) query. Note: it didn't take effect if having delete files. Thanks, Butao Zhang Replied Message | From | lisoda | | Date | 11/9/2023 10:43 |

Re:Re: Re: Hive's performance for querying the Iceberg table is very poor.

2023-11-08 Thread lisoda
HI. I am testing with HIVE-4.0.0-BETA-1 version and I am using location_based_table. So far I found that HIVE still can't push some queries down to METADATA, e.g. COUNT(*). Is HIVE 4.0.0-BETA-1 still not able to support query push down? 在 2023-10-24 17:41:20,"Ayush Saxena" 写道: