[
https://issues.apache.org/jira/browse/HUDI-3618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
hd zhou updated HUDI-3618:
--------------------------
Component/s: flink
> flink schedule more compactions at once
> ----------------------------------------
>
> Key: HUDI-3618
> URL: https://issues.apache.org/jira/browse/HUDI-3618
> Project: Apache Hudi
> Issue Type: Improvement
> Components: flink
> Reporter: hd zhou
> Priority: Major
>
> flink CompactionPlanOperator schedule compaction at notifyCheckpointComplete
> that can only schedule one compaction every checkpoint.
> when compaction rollback, compaction will later then compaction plan ,and
> cannot catch up with compaction plan create rate。eg: if compaction rollback 3
> times, there will be 3 compaction plan pending schedule.
> hudi table (RO) look like delay , and more compactions rollback , much
> longer hudi table dely, never catch up.
> maybe we can make CompactionPlanOperator schedule more compactions at once
>
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
