manojpec commented on a change in pull request #4352:
URL: https://github.com/apache/hudi/pull/4352#discussion_r786380229
##########
File path:
hudi-common/src/main/java/org/apache/hudi/common/config/HoodieMetadataConfig.java
##########
@@ -124,6 +124,37 @@
.sinceVersion("0.10.0")
.withDocumentation("Enable full scanning of log files while reading log
records. If disabled, hudi does look up of only interested entries.");
+ public static final ConfigProperty<Boolean> ENABLE_META_INDEX_BLOOM_FILTER =
ConfigProperty
+ .key(METADATA_PREFIX + ".index.bloom.filter.enable")
+ .defaultValue(false)
+ .sinceVersion("0.11.0")
+ .withDocumentation("Enable indexing user data files bloom filters under
metadata table. When enabled, "
+ + "metadata table will have a partition to store the bloom filter
index and will be "
+ + "used during the index lookups.");
+
+ public static final ConfigProperty<Boolean> ENABLE_META_INDEX_COLUMN_STATS =
ConfigProperty
+ .key(METADATA_PREFIX + ".index.column.stats.enable")
+ .defaultValue(false)
+ .sinceVersion("0.11.0")
+ .withDocumentation("Enable indexing user data files column ranges under
metadata table key lookups. When "
+ + "enabled, metadata table will have a partition to store the column
ranges and will "
+ + "used for pruning files during the index lookups.");
+
+ public static final ConfigProperty<Boolean>
META_INDEX_COLUMN_STATS_FOR_ALL_COLUMNS = ConfigProperty
+ .key(METADATA_PREFIX + ".index.column.stats.all_columns")
+ .defaultValue(false)
+ .sinceVersion("0.11.0")
+ .withDocumentation("Enable indexing user data files column ranges under
metadata table key lookups. When "
+ + "enabled, metadata table will have a partition to store the column
ranges and will "
+ + "used for pruning files during the index lookups.");
+
Review comment:
Yes, not part of this PR. HUDI-3260 tracks this.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
