[
https://issues.apache.org/jira/browse/IMPALA-12293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Noemi Pap-Takacs updated IMPALA-12293:
--------------------------------------
Description:
A simple syntax to compact Iceberg tables. It executes the following tasks:
* compact small files
* rewrite partitions according to latest spec
* merge delete deltas
{code:java}
Syntax:
OPTIMIZE TABLE <table_name>
[ REWRITE DATA ]
[ ( { FILE_SIZE_THRESHOLD | MIN_INPUT_FILES } = <value> [, ... ] ) ]
[ WHERE <condition> ];{code}
Limitations - OPTIMIZE TABLE can not be executed on the following tables:
* Non-Iceberg tables.
* Tables with complex types columns. Currently, Impala does not support
writing complex types.
* If the 'write.format.default' is not Parquet. Impala can only write Parquet
files.
was:
A simple syntax to compact Iceberg tables. It executes the following tasks:
* compact small files
* rewrite partitions according to latest spec
* merge delete deltas
{code:java}
Syntax:
OPTIMIZE TABLE <table_name>
[ REWRITE DATA ]
[ ( { FILE_SIZE_THRESHOLD | MIN_INPUT_FILES } = <value> [, ... ] ) ]
[ WHERE <condition> ];{code}
> Optimize statement for compacting Iceberg tables
> ------------------------------------------------
>
> Key: IMPALA-12293
> URL: https://issues.apache.org/jira/browse/IMPALA-12293
> Project: IMPALA
> Issue Type: New Feature
> Components: Frontend
> Reporter: Noemi Pap-Takacs
> Assignee: Noemi Pap-Takacs
> Priority: Major
> Labels: impala-iceberg
>
> A simple syntax to compact Iceberg tables. It executes the following tasks:
> * compact small files
> * rewrite partitions according to latest spec
> * merge delete deltas
> {code:java}
> Syntax:
> OPTIMIZE TABLE <table_name>
> [ REWRITE DATA ]
> [ ( { FILE_SIZE_THRESHOLD | MIN_INPUT_FILES } = <value> [, ... ] ) ]
> [ WHERE <condition> ];{code}
> Limitations - OPTIMIZE TABLE can not be executed on the following tables:
> * Non-Iceberg tables.
> * Tables with complex types columns. Currently, Impala does not support
> writing complex types.
> * If the 'write.format.default' is not Parquet. Impala can only write
> Parquet files.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
