danny0405 commented on code in PR #17490:
URL: https://github.com/apache/hudi/pull/17490#discussion_r2605516201
##########
hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/configuration/FlinkOptions.java:
##########
@@ -417,6 +417,19 @@ private FlinkOptions() {
.withDescription("Enables data-skipping allowing queries to leverage
indexes to reduce the search space by "
+ "skipping over files");
+ @AdvancedConfig
+ public static final ConfigOption<Integer> RECORD_INDEX_KEYS_MAX_COUNT =
ConfigOptions
+ .key("read.record.index.keys.max.count")
+ .intType()
+ .defaultValue(8)
+ .withDescription("Record Level index statistics will be read from
metadata table (MDT) for data skipping optimization,\n"
+ + "and currently the index statistics are collected by a single
process, i.e., flink client for batch query or\n"
+ + "split monitor operator for streaming query. This config is used
to constrain the maximum number of hoodie\n"
Review Comment:
> i.e., flink client for batch query or\n"
> + "split monitor operator for streaming query.
Let's remove these impl details.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
