[
https://issues.apache.org/jira/browse/HUDI-5582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17678752#comment-17678752
]
sivabalan narayanan commented on HUDI-5582:
-------------------------------------------
Improve docs on
hoodie.file.listing.parallelism (meant only to initialize metadata table. So
depending on the scale, one can adjust this)
> Do not let users override internal metadata configs
> ---------------------------------------------------
>
> Key: HUDI-5582
> URL: https://issues.apache.org/jira/browse/HUDI-5582
> Project: Apache Hudi
> Issue Type: Improvement
> Components: metadata
> Reporter: sivabalan narayanan
> Assignee: Jonathan Vexler
> Priority: Blocker
> Fix For: 0.13.0
>
>
> metadata cleaning, compaction configs in metadata table should not be
> overriden by user. we should make it internal configs.
> --hoodie-conf hoodie.metadata.cleaner.commits.retained=60 \
> --hoodie-conf hoodie.metadata.populate.meta.fields=true \
> --hoodie-conf hoodie.metadata.clean.async=true \
> --hoodie-conf hoodie.metadata.keep.max.commits=80 \
> --hoodie-conf hoodie.metadata.insert.parallelism=20 \
> --hoodie-conf hoodie.metadata.keep.min.commits=70 \
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
