JerryYue-M commented on code in PR #6100:
URL: https://github.com/apache/hudi/pull/6100#discussion_r920723914
##########
hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/configuration/FlinkOptions.java:
##########
@@ -502,6 +503,14 @@ private FlinkOptions() {
.defaultValue(true) // default true for MOR write
.withDescription("Schedule the compaction plan, enabled by default for
MOR");
+ public static final ConfigOption<String> COMPACTION_SCHEDULE_SEQ =
ConfigOptions
+ .key("compaction.schedule.seq")
+ .stringType()
+ .defaultValue(FlinkCompactionConfig.SEQ_LIFO) // default LIFO to
improve compact stability
+ .withDescription("Compaction plan execution sequence, two options are
supported:\n"
+ + "1). FIFO: execute the oldest plan first;\n"
+ + "2). LIFO: execute the latest plan first, by default LIFO");
Review Comment:
In my case. there leave one-day compaction plans not executed for some other
reason and my offline compaction job can't be ready for some reason such as
authority authentication. So I just depend on inline compaction (increase the
parallelism or memory) but it always failed because of too much compaction plan
needed to execute. so maybe it can execute the latest one and the others just
wait offline job to be ready
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
