slinkydeveloper commented on a change in pull request #18176:
URL: https://github.com/apache/flink/pull/18176#discussion_r783969278
##########
File path:
flink-connectors/flink-connector-files/src/main/java/org/apache/flink/connector/file/table/FileSystemConnectorOptions.java
##########
@@ -46,6 +46,16 @@
"The default partition name in case the dynamic
partition"
+ " column value is null/empty string.");
+ public static final ConfigOption<Duration> SOURCE_WATCH_INTERVAL =
+ key("source.monitor-interval")
+ .durationType()
+ .defaultValue(Duration.ofMinutes(1))
+ .withDescription(
+ "The interval in which the source checks for new
files. "
Review comment:
Looking at the code, it seems the discovery is by file name. But I think
we need the input from the FileSource mantainers to really understand and
document the details, as the documentation of
`fileSourceBuilder.monitorContinuously` is not complete and doesn't really
explain how it works.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
