This is an automated email from the ASF dual-hosted git repository.
sivabalan pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/asf-site by this push:
new e8d7999054 [DOCS] Add faq - how to reduce table versions created by
hudi in metastore (#7108)
e8d7999054 is described below
commit e8d7999054374623bccd2d2608b99de673a8f17c
Author: kazdy <[email protected]>
AuthorDate: Mon Nov 7 08:01:35 2022 +0100
[DOCS] Add faq - how to reduce table versions created by hudi in metastore
(#7108)
---
website/docs/faq.md | 5 +++++
website/versioned_docs/version-0.12.1/faq.md | 5 +++++
2 files changed, 10 insertions(+)
diff --git a/website/docs/faq.md b/website/docs/faq.md
index bb1b8743d0..18b5b0f676 100644
--- a/website/docs/faq.md
+++ b/website/docs/faq.md
@@ -643,6 +643,11 @@ This will occur when capital letters are used in the table
name. Metastores such
to lowercase. While we allow capitalization on Hudi tables, if you would like
to use a metastore you may be required to
use all lowercase letters. More details on how this issue presents can be
found [here](https://github.com/apache/hudi/issues/6832).
+### How can I reduce table versions created by Hudi in AWS Glue Data Catalog/
metastore?
+With each commit, Hudi creates a new table version in the metastore. This can
be reduced by setting the option
+[hoodie.datasource.meta_sync.condition.sync](https://hudi.apache.org/docs/configurations#hoodiedatasourcemeta_syncconditionsync)
to true.
+This will ensure that hive sync is triggered on schema or partitions changes.
+
## Contributing to FAQ
A good and usable FAQ should be community-driven and crowd source
questions/thoughts across everyone.
diff --git a/website/versioned_docs/version-0.12.1/faq.md
b/website/versioned_docs/version-0.12.1/faq.md
index 66078e8e76..34a85ccf98 100644
--- a/website/versioned_docs/version-0.12.1/faq.md
+++ b/website/versioned_docs/version-0.12.1/faq.md
@@ -638,6 +638,11 @@ This will occur when capital letters are used in the table
name. Metastores such
to lowercase. While we allow capitalization on Hudi tables, if you would like
to use a metastore you may be required to
use all lowercase letters. More details on how this issue presents can be
found [here](https://github.com/apache/hudi/issues/6832).
+### How can I reduce table versions created by Hudi in AWS Glue Data Catalog/
metastore?
+With each commit, Hudi creates a new table version in the metastore. This can
be reduced by setting the option
+[hoodie.datasource.meta_sync.condition.sync](https://hudi.apache.org/docs/configurations#hoodiedatasourcemeta_syncconditionsync)
to true.
+This will ensure that hive sync is triggered on schema or partitions changes.
+
## Contributing to FAQ
A good and usable FAQ should be community-driven and crowd source
questions/thoughts across everyone.
