[jira] [Commented] (IMPALA-11279) Optimize count(*) queries for Iceberg tables

[ASF subversion and git services (Jira)]

Title: Message Title

ASF subversion and git services commented on IMPALA-11279   Re: Optimize count(*) queries for Iceberg tables Commit f38c53235f1797f91ff9a65bb734d3f38f1aadc9 in impala's branch refs/heads/master from LPL [ https://gitbox.apache.org/repos/asf?p=impala.git;h=f38c53235 ] IMPALA-11279: Optimize plain count queries for Iceberg tables This commit optimizes the plain count queries for the Iceberg tables. When the `org.apache.iceberg.SnapshotSummary#TOTAL_RECORDS_PROP` can be retrieved from the current `org.apache.iceberg.BaseSnapshot#summary` of the Iceberg table, this kind of query can be very fast. If this property is not retrieved, the query will aggregate the `num_rows` of parquet `file_metadata_` as usual. Queries that can be optimized need to meet the following requirements: SelectStmt does not have WHERE clause SelectStmt does not have GROUP BY clause SelectStmt does not have HAVING clause The TableRefs of FROM clause contains only one BaseTableRef Only for the Iceberg table SelectList must contain 'count' or 'count(constant)' SelectList can contain other agg functions, e.g. min, sum, etc SelectList can contain constant Testing: Added end-to-end test Existing tests Test it in a real cluster Change-Id: I8e9c48bbba7ab2320fa80915e7001ce54f1ef6d9 Reviewed-on: http://gerrit.cloudera.org:8080/18574 Reviewed-by: Impala Public Jenkins <impala-public-jenk...@cloudera.com> Tested-by: Impala Public Jenkins <impala-public-jenk...@cloudera.com> Add Comment   This message was sent by Atlassian Jira (v8.20.10#820010-sha1:ace47f9)