[
https://issues.apache.org/jira/browse/HUDI-5379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
melin updated HUDI-5379:
------------------------
Description:
# Data management by partition: During partition clearing, if the number of
partitions exceeds the configured number, delete older partitions until the
number of partitions equals the configured maximum number.
# Management by data volume: During partition clearing, the system collects
statistics on the total data volume. If the data volume exceeds the specified
value, the system deletes the earliest partition until the total data volume of
the partition is less than or equal to the specified value
# Management by expiration time: During partition clearing, the system
calculates the expiration time based on the last modified time of the partition
and deletes the expired partition.
!image-2022-12-13-17-34-26-346.png!
was:
# Data management by partition: During partition clearing, if the number of
partitions exceeds the configured number, delete older partitions until the
number of partitions equals the configured maximum number.
# Management by data volume: During partition clearing, the system collects
statistics on the total data volume. If the data volume exceeds the specified
value, the system deletes the earliest partition until the total data volume of
the partition is less than or equal to the specified value
# Management by expiration time: During partition clearing, the system
calculates the expiration time based on the last modified time of the partition
and deletes the expired partition.
!image-2022-12-13-17-34-28-883.png!
> Add Call add_ttl_policy for spark sql
> --------------------------------------
>
> Key: HUDI-5379
> URL: https://issues.apache.org/jira/browse/HUDI-5379
> Project: Apache Hudi
> Issue Type: New Feature
> Reporter: melin
> Priority: Major
> Attachments: image-2022-12-13-17-34-26-346.png
>
>
> # Data management by partition: During partition clearing, if the number of
> partitions exceeds the configured number, delete older partitions until the
> number of partitions equals the configured maximum number.
> # Management by data volume: During partition clearing, the system collects
> statistics on the total data volume. If the data volume exceeds the specified
> value, the system deletes the earliest partition until the total data volume
> of the partition is less than or equal to the specified value
> # Management by expiration time: During partition clearing, the system
> calculates the expiration time based on the last modified time of the
> partition and deletes the expired partition.
> !image-2022-12-13-17-34-26-346.png!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
