[
https://issues.apache.org/jira/browse/IMPALA-11826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zoltán Borók-Nagy resolved IMPALA-11826.
----------------------------------------
Fix Version/s: Impala 4.3.0
Resolution: Fixed
> Avoid calling planFiles() on Iceberg V2 tables when there are no predicates
> ---------------------------------------------------------------------------
>
> Key: IMPALA-11826
> URL: https://issues.apache.org/jira/browse/IMPALA-11826
> Project: IMPALA
> Issue Type: Bug
> Components: Catalog, Frontend
> Reporter: Zoltán Borók-Nagy
> Assignee: Zoltán Borók-Nagy
> Priority: Major
> Labels: impala-iceberg
> Fix For: Impala 4.3.0
>
>
> Similar to IMPALA-11591 but this Jira extends it to V2 tables.
> We can extend IcebergContentFileStore to group data files:
> * data files without corresponding delete files
> * data files with delete files
> Once we have this we don't have to invoke planFiles() on V2 table SCANs
> without predicates. We can just simply create the usual UNION - ANTI JOIN
> plan based on IcebergContentFileStore:
> {noformat}
> UNION ALL
> / \
> / \
> SCAN ANTI JOIN
> data files / \
> without / \
> deletes SCAN SCAN
> data files delete files
> with deletes{noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
