[
https://issues.apache.org/jira/browse/HUDI-5582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
sivabalan narayanan updated HUDI-5582:
--------------------------------------
Description:
metadata cleaning, compaction configs in metadata table should not be overriden
by user. we should make it internal configs.
--hoodie-conf hoodie.metadata.cleaner.commits.retained=60 \
--hoodie-conf hoodie.metadata.populate.meta.fields=true \
--hoodie-conf hoodie.metadata.clean.async=true \
--hoodie-conf hoodie.metadata.keep.max.commits=80 \
--hoodie-conf hoodie.metadata.insert.parallelism=20 \
--hoodie-conf hoodie.metadata.keep.min.commits=70 \
was:
metadata cleaning, compaction configs in metadata table should not be overriden
by user. we should make it internal configs.
--hoodie-conf hoodie.metadata.compact.max.delta.commits=10 \
--hoodie-conf hoodie.metadata.cleaner.commits.retained=60 \
--hoodie-conf hoodie.metadata.populate.meta.fields=true \
--hoodie-conf hoodie.metadata.clean.async=true \
--hoodie-conf hoodie.metadata.keep.max.commits=80 \
--hoodie-conf hoodie.metadata.insert.parallelism=20 \
--hoodie-conf hoodie.metadata.keep.min.commits=70 \
> Do not let users override internal metadata configs
> ---------------------------------------------------
>
> Key: HUDI-5582
> URL: https://issues.apache.org/jira/browse/HUDI-5582
> Project: Apache Hudi
> Issue Type: Improvement
> Components: metadata
> Reporter: sivabalan narayanan
> Assignee: Jonathan Vexler
> Priority: Blocker
> Fix For: 0.13.0
>
>
> metadata cleaning, compaction configs in metadata table should not be
> overriden by user. we should make it internal configs.
> --hoodie-conf hoodie.metadata.cleaner.commits.retained=60 \
> --hoodie-conf hoodie.metadata.populate.meta.fields=true \
> --hoodie-conf hoodie.metadata.clean.async=true \
> --hoodie-conf hoodie.metadata.keep.max.commits=80 \
> --hoodie-conf hoodie.metadata.insert.parallelism=20 \
> --hoodie-conf hoodie.metadata.keep.min.commits=70 \
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
