yihua commented on code in PR #12762:
URL: https://github.com/apache/hudi/pull/12762#discussion_r1960678192
##########
hudi-utilities/src/main/java/org/apache/hudi/utilities/config/KafkaSourceConfig.java:
##########
@@ -167,6 +167,13 @@ public class KafkaSourceConfig extends HoodieConfig {
.withDocumentation("The class name of the Exception that needs to be
retried, separated by commas. "
+ "Default is empty which means retry all the IOException and
RuntimeException from KafkaConsumer");
+ public static final ConfigProperty<Long> OFFSET_SKIP_BUFFER_MINUTES =
ConfigProperty
+ .key(PREFIX + "offset.skip.buffer.minutes")
+ .defaultValue(-1L)
+ .markAdvanced()
+ .withDocumentation("Time in minutes to move forward from retention time
for reading offsets")
Review Comment:
```suggestion
.withDocumentation("Time in minutes to move forward from retention
time for reading offsets "
+ "when the checkpoints are not available or out-of-bound to avoid
potential "
+ "OffsetOutOfRange exception, as it is possible that the earliest
Kafka offsets may "
+ "expire soon while the job is progressing.")
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
