[
https://issues.apache.org/jira/browse/IMPALA-12412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Noemi Pap-Takacs reassigned IMPALA-12412:
-----------------------------------------
Assignee: Noemi Pap-Takacs
> Support partition evolution in OPTIMIZE statement
> -------------------------------------------------
>
> Key: IMPALA-12412
> URL: https://issues.apache.org/jira/browse/IMPALA-12412
> Project: IMPALA
> Issue Type: Sub-task
> Components: Frontend
> Reporter: Noemi Pap-Takacs
> Assignee: Noemi Pap-Takacs
> Priority: Major
> Labels: impala-iceberg
>
> OPTIMIZE TABLE statement currently uses INSERT OVERWRITE to rewrite Iceberg
> tables. Therefore it inherits its limitations as well, such as the inability
> to rewrite tables with partition evolution.
> This change aims to increase the support OPTIMIZE TABLE provides, by making
> it independent from INSERT statment. After the refactoring, OPTIMIZE TABLE
> statement will be able to:
> * rewrite all files in Iceberg tables according to the latest partition spec
> * compact tables with partition evolution
> This change also serves as a base for further improvements.
> {code:java}
> Syntax: OPTIMIZE TABLE <table_name>;{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
