[
https://issues.apache.org/jira/browse/HIVE-28341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dmitriy Fingerman updated HIVE-28341:
-------------------------------------
Description: Currently, Major compaction compacts a whole table in one
step. If a table is partition and has a lot of data this operation can take a
lot of time and it risks getting write conflicts at the commit stage. This can
be improved to work partition by partition. Also, for each partition it will
create one snapshot instead of 2 snapshots (truncate+IOW) created now when
compacting the whole table in one step. (was: Currently, )
> Iceberg: Change Major QB Full Table Compaction to compact partition by
> partition
> --------------------------------------------------------------------------------
>
> Key: HIVE-28341
> URL: https://issues.apache.org/jira/browse/HIVE-28341
> Project: Hive
> Issue Type: Task
> Components: Hive, Iceberg integration
> Reporter: Dmitriy Fingerman
> Assignee: Dmitriy Fingerman
> Priority: Major
> Labels: hive, iceberg
>
> Currently, Major compaction compacts a whole table in one step. If a table is
> partition and has a lot of data this operation can take a lot of time and it
> risks getting write conflicts at the commit stage. This can be improved to
> work partition by partition. Also, for each partition it will create one
> snapshot instead of 2 snapshots (truncate+IOW) created now when compacting
> the whole table in one step.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
