[
https://issues.apache.org/jira/browse/IMPALA-11971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Noemi Pap-Takacs reassigned IMPALA-11971:
-----------------------------------------
Assignee: Noemi Pap-Takacs
> Simple syntax to Compact, RePartition, Clean Orphans etc for Iceberg Tables
> ---------------------------------------------------------------------------
>
> Key: IMPALA-11971
> URL: https://issues.apache.org/jira/browse/IMPALA-11971
> Project: IMPALA
> Issue Type: Epic
> Components: Frontend
> Reporter: Manish Maheshwari
> Assignee: Noemi Pap-Takacs
> Priority: Major
> Labels: impala-iceberg
>
> Impala supports overwriting iceberg tables. Overwriting iceberg tables /
> partitions can be used as an cheap way to implement the below without the
> user having to run spark jobs
> * compact small files
> * rewrite partitions according to latest spec
> * merge deltas due to deletes and updates (if any) due to Merge-on-read
> strategy
> * delete orphan files in table/partition
> Doing all of this as part of an overwrite partition is not intuitive. We
> should support a syntax verb like `compact` or `consolidate` or `tune` to do
> these operations
> {code:java}
> alter table compact table;
> alter table compact table partition <>;
> alter table compact table partition <>;{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
