[
https://issues.apache.org/jira/browse/HUDI-2296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17397163#comment-17397163
]
ASF GitHub Bot commented on HUDI-2296:
--------------------------------------
gengxuhan commented on a change in pull request #3453:
URL: https://github.com/apache/hudi/pull/3453#discussion_r686602054
##########
File path:
hudi-flink/src/main/java/org/apache/hudi/configuration/FlinkOptions.java
##########
@@ -593,6 +593,30 @@ private FlinkOptions() {
.withDescription("INT64 with original type TIMESTAMP_MICROS is converted
to hive timestamp type.\n"
+ "Disabled by default for backward compatibility.");
+ public static final ConfigOption<Boolean> CONSISTENCY_CHECK_ENABLED_PROP =
ConfigOptions
+ .key("hoodie.consistency.check.enabled")
+ .booleanType()
+ .defaultValue(false)
+ .withDescription("When there is a delay in file system metadata, you
can choose to enable this configuration.");
+
+ public static final ConfigOption<Integer>
INITIAL_CONSISTENCY_CHECK_INTERVAL_MS_PROP = ConfigOptions
+ .key("hoodie.consistency.check.initial_interval_ms")
+ .intType()
+ .defaultValue(400)
+ .withDescription("Amount of time (in ms) to wait, before checking
for consistency after an operation on storage.");
+
+ public static final ConfigOption<Integer>
MAX_CONSISTENCY_CHECK_INTERVAL_MS_PROP = ConfigOptions
+ .key("hoodie.consistency.check.max_interval_ms")
+ .intType()
+ .defaultValue(20000)
+ .withDescription("Maximum amount of time (in ms), to wait for
consistency checking.");
+
+ public static final ConfigOption<Integer> MAX_CONSISTENCY_CHECKS_PROP =
ConfigOptions
+ .key("hoodie.consistency.check.max_checks")
Review comment:
OK, I'll modify it
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
> flink support ConsistencyGuard plugin
> ---------------------------------------
>
> Key: HUDI-2296
> URL: https://issues.apache.org/jira/browse/HUDI-2296
> Project: Apache Hudi
> Issue Type: Improvement
> Components: Flink Integration
> Reporter: Gengxuhan
> Priority: Critical
> Labels: pull-request-available
> Fix For: 0.9.0
>
>
> flink support ConsistencyGuard plugin,When there is metadata latency in the
> file system,Submit CKP once, and then start a new instant. Because the commit
> cannot be seen, the data will be rolled back
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
