hd zhou created HUDI-3618:
-----------------------------
Summary: flink schedule more compactions at once
Key: HUDI-3618
URL: https://issues.apache.org/jira/browse/HUDI-3618
Project: Apache Hudi
Issue Type: Improvement
Reporter: hd zhou
flink CompactionPlanOperator schedule compaction at notifyCheckpointComplete
that can only schedule one compaction every checkpoint.
when compaction rollback, compaction will later then compaction plan ,and
cannot catch up with compaction plan create rate。eg: if compaction rollback 3
times, there will be 3 compaction plan pending schedule.
hudi table (RO) look like delay , and more compactions rollback , much longer
hudi table dely, never catch up.
maybe we can make CompactionPlanOperator schedule more compactions at once
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
