nsivabalan commented on code in PR #8758:
URL: https://github.com/apache/hudi/pull/8758#discussion_r1228452051
##########
hudi-common/src/main/java/org/apache/hudi/common/config/HoodieMetadataConfig.java:
##########
@@ -234,6 +235,55 @@ public final class HoodieMetadataConfig extends
HoodieConfig {
.withDocumentation("When there is a pending instant in data table, this
config limits the allowed number of deltacommits in metadata table to "
+ "prevent the metadata table's timeline from growing unboundedly as
compaction won't be triggered due to the pending data table instant.");
+ public static final ConfigProperty<Boolean> RECORD_INDEX_CREATE_PROP =
ConfigProperty
+ .key(METADATA_PREFIX + ".record.index.create")
+ .defaultValue(false)
+ .sinceVersion("0.14.0")
+ .withDocumentation("Create the HUDI Record Index within the Metadata
Table");
+
+ public static final ConfigProperty<Integer>
RECORD_INDEX_MIN_FILE_GROUP_COUNT_PROP = ConfigProperty
+ .key(METADATA_PREFIX + ".record.index.min.filegroup.count")
+ .defaultValue(10)
+ .sinceVersion("0.14.0")
+ .withDocumentation("Minimum number of file groups to use for Record
Index.");
+
+ public static final ConfigProperty<Integer>
RECORD_INDEX_MAX_FILE_GROUP_COUNT_PROP = ConfigProperty
+ .key(METADATA_PREFIX + ".record.index.max.filegroup.count")
+ .defaultValue(1000)
+ .sinceVersion("0.14.0")
+ .withDocumentation("Maximum number of file groups to use for Record
Index.");
+
+ public static final ConfigProperty<Integer>
RECORD_INDEX_MAX_FILE_GROUP_SIZE_BYTES_PROP = ConfigProperty
+ .key(METADATA_PREFIX + ".record.index.max.filegroup.size")
+ .defaultValue(1024 * 1024 * 1024)
Review Comment:
its ok. lets keep it as 1GB only.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
