[
https://issues.apache.org/jira/browse/DRILL-7331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arina Ielchiieva updated DRILL-7331:
------------------------------------
Description:
Currently Iceberg produces snapshots and table metadata for each modification
operation.
Plus it does not retire outdated data files. All these information is stored
and in metadata folder and with time occupy lots of space. This Jira aims to
expire outdated snapshots, table metadata and data files based on configured
expiration period.
Iceberg has already mechanism to retire snapshots and data files. Mechanism to
expire table metadata needs to be implemented
(https://github.com/apache/incubator-iceberg/issues/181).
> Support Iceberg metadata clean up
> ---------------------------------
>
> Key: DRILL-7331
> URL: https://issues.apache.org/jira/browse/DRILL-7331
> Project: Apache Drill
> Issue Type: Sub-task
> Reporter: Arina Ielchiieva
> Assignee: Arina Ielchiieva
> Priority: Major
> Fix For: 1.17.0
>
>
> Currently Iceberg produces snapshots and table metadata for each modification
> operation.
> Plus it does not retire outdated data files. All these information is stored
> and in metadata folder and with time occupy lots of space. This Jira aims to
> expire outdated snapshots, table metadata and data files based on configured
> expiration period.
> Iceberg has already mechanism to retire snapshots and data files. Mechanism
> to expire table metadata needs to be implemented
> (https://github.com/apache/incubator-iceberg/issues/181).
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
