manojpec commented on a change in pull request #4352:
URL: https://github.com/apache/hudi/pull/4352#discussion_r781021375
##########
File path:
hudi-common/src/main/java/org/apache/hudi/common/config/HoodieMetadataConfig.java
##########
@@ -124,6 +124,37 @@
.sinceVersion("0.10.0")
.withDocumentation("Enable full scanning of log files while reading log
records. If disabled, hudi does look up of only interested entries.");
+ public static final ConfigProperty<Boolean> ENABLE_META_INDEX_BLOOM_FILTER =
ConfigProperty
+ .key(METADATA_PREFIX + ".index.bloomfilter.enable")
+ .defaultValue(false)
+ .sinceVersion("0.11.0")
+ .withDocumentation("Enable indexing user data files bloom filters under
metadata table. When enabled, "
+ + "a new partition under metadata table will be created to store the
bloom filter index and will be "
+ + "used during the index lookups.");
+
+ public static final ConfigProperty<Boolean> ENABLE_META_INDEX_COLUMN_STATS =
ConfigProperty
+ .key(METADATA_PREFIX + ".index.column.stats.enable")
+ .defaultValue(false)
+ .sinceVersion("0.11.0")
+ .withDocumentation("Enable indexing user data files column ranges under
metadata table key lookups. When "
+ + "enabled, a new partition under metadata table will be created to
store the column ranges and will "
+ + "used for pruning files during the index lookups.");
+
+ public static final ConfigProperty<Boolean>
META_INDEX_COLUMN_STATS_FOR_ALL_COLUMNS = ConfigProperty
+ .key(METADATA_PREFIX + ".index.column.stats.all_columns")
+ .defaultValue(false)
+ .sinceVersion("0.11.0")
+ .withDocumentation("Enable indexing user data files column ranges under
metadata table key lookups. When "
+ + "enabled, a new partition under metadata table will be created to
store the column ranges and will "
+ + "used for pruning files during the index lookups.");
+
+ public static final ConfigProperty<Boolean>
ENABLE_META_INDEX_BLOOM_FILTER_BATCH_LOAD_MODE = ConfigProperty
+ .key(METADATA_PREFIX + ".index.bloomfilter.batchload.enable")
Review comment:
fixed.
##########
File path:
hudi-common/src/main/java/org/apache/hudi/common/config/HoodieMetadataConfig.java
##########
@@ -124,6 +124,37 @@
.sinceVersion("0.10.0")
.withDocumentation("Enable full scanning of log files while reading log
records. If disabled, hudi does look up of only interested entries.");
+ public static final ConfigProperty<Boolean> ENABLE_META_INDEX_BLOOM_FILTER =
ConfigProperty
+ .key(METADATA_PREFIX + ".index.bloomfilter.enable")
+ .defaultValue(false)
+ .sinceVersion("0.11.0")
+ .withDocumentation("Enable indexing user data files bloom filters under
metadata table. When enabled, "
+ + "a new partition under metadata table will be created to store the
bloom filter index and will be "
+ + "used during the index lookups.");
+
+ public static final ConfigProperty<Boolean> ENABLE_META_INDEX_COLUMN_STATS =
ConfigProperty
+ .key(METADATA_PREFIX + ".index.column.stats.enable")
+ .defaultValue(false)
+ .sinceVersion("0.11.0")
+ .withDocumentation("Enable indexing user data files column ranges under
metadata table key lookups. When "
+ + "enabled, a new partition under metadata table will be created to
store the column ranges and will "
Review comment:
fixed.
##########
File path:
hudi-common/src/main/java/org/apache/hudi/common/config/HoodieMetadataConfig.java
##########
@@ -124,6 +124,37 @@
.sinceVersion("0.10.0")
.withDocumentation("Enable full scanning of log files while reading log
records. If disabled, hudi does look up of only interested entries.");
+ public static final ConfigProperty<Boolean> ENABLE_META_INDEX_BLOOM_FILTER =
ConfigProperty
+ .key(METADATA_PREFIX + ".index.bloomfilter.enable")
+ .defaultValue(false)
+ .sinceVersion("0.11.0")
+ .withDocumentation("Enable indexing user data files bloom filters under
metadata table. When enabled, "
+ + "a new partition under metadata table will be created to store the
bloom filter index and will be "
Review comment:
fixed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
