[
https://issues.apache.org/jira/browse/IMPALA-15033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18118065#comment-18118065
]
ASF subversion and git services commented on IMPALA-15033:
----------------------------------------------------------
Commit 3740ee388821188b4ff3f9f2cfe6d2f2c5981f75 in impala's branch
refs/heads/master from Nandor Kollar
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=3740ee388 ]
IMPALA-15033: Optimize simple LIMIT queries on Iceberg V2 tables
When OPTIMIZE_SIMPLE_LIMIT is enabled and an Iceberg V2 table has
enough delete-free data files to satisfy the LIMIT, bypass the
expensive delete-join pipeline and scan only the minimum subset of
those files.
The optimization fires early in IcebergScanPlanner.createScanPlan()
and produces a simple IcebergScanNode with just the selected files.
It is skipped for OPTIMIZE TABLE statements, queries with WHERE
clauses, and when there aren't enough delete-free rows to cover the
limit.
Also cleans up Boolean.valueOf(true/false) to Boolean.TRUE/FALSE in
SelectStmt.checkSimpleLimitStmt().
Testing: added iceberg-optimize-simple-limit.test covering mixed
delete/no-delete files, optimization disabled, no-delete tables,
all-deletes tables, and WHERE clause disqualification.
Change-Id: I416d947e3c6e3fb0e4c2da056d75f70c08ac9676
Assisted-by: Claude Opus 4.6 (Claude Code)
Reviewed-on: http://gerrit.cloudera.org:8080/24818
Reviewed-by: Impala Public Jenkins <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>
> Limit Iceberg files to scan for SELECT LIMIT queries
> ----------------------------------------------------
>
> Key: IMPALA-15033
> URL: https://issues.apache.org/jira/browse/IMPALA-15033
> Project: IMPALA
> Issue Type: Sub-task
> Reporter: Noémi Pap-Takács
> Assignee: Surya Hebbar
> Priority: Major
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
