This is an automated email from the ASF dual-hosted git repository.
vinoyang pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 0a6e48d [HUDI-2111] Update docs about bootstrap support configure
KeyGenerator by type (#3200)
0a6e48d is described below
commit 0a6e48dd23c73a1ef34852396291cfec388bb0ca
Author: wangxianghu <[email protected]>
AuthorDate: Tue Jul 6 14:21:16 2021 +0800
[HUDI-2111] Update docs about bootstrap support configure KeyGenerator by
type (#3200)
---
content/docs/configurations.html | 9 ++++++++-
docs/_docs/2_4_configurations.md | 3 ++-
2 files changed, 10 insertions(+), 2 deletions(-)
diff --git a/content/docs/configurations.html b/content/docs/configurations.html
index e3440a8..5b0335b 100644
--- a/content/docs/configurations.html
+++ b/content/docs/configurations.html
@@ -1808,11 +1808,18 @@ HoodieWriteConfig can be built using a builder pattern
as below.</p>
<tr>
<td>withBootstrapKeyGenClass(keyGenClass))</td>
<td>hoodie.bootstrap.keygen.class</td>
- <td>YES</td>
+ <td>NO</td>
<td>N/A</td>
<td>Key generator implementation to be used for generating keys from
the bootstrapped dataset.</td>
</tr>
<tr>
+ <td>withBootstrapKeyGenType(keyGenType))</td>
+ <td>hoodie.bootstrap.keygen.type</td>
+ <td>NO</td>
+ <td>SIMPLE</td>
+ <td>Key generator type, indicating which KeyGenerator to be used for
generating keys from the bootstrapped dataset.</td>
+ </tr>
+ <tr>
<td>withBootstrapModeSelector(partitionSelectorClass))</td>
<td>hoodie.bootstrap.mode.selector</td>
<td>NO</td>
diff --git a/docs/_docs/2_4_configurations.md b/docs/_docs/2_4_configurations.md
index 3667b81..3290e72 100644
--- a/docs/_docs/2_4_configurations.md
+++ b/docs/_docs/2_4_configurations.md
@@ -380,7 +380,8 @@ Controls bootstrap related configs. If you want to
bootstrap your data for the f
| ----------- | -------- | -------- | ------- | ------- |
| withBootstrapBasePath(basePath) | hoodie.bootstrap.base.path | YES | N/A |
Base path of the dataset that needs to be bootstrapped as a Hudi table. |
| withBootstrapParallelism(parallelism) | hoodie.bootstrap.parallelism | NO |
1500 | Parallelism value to be used to bootstrap data into hudi. |
-| withBootstrapKeyGenClass(keyGenClass)) | hoodie.bootstrap.keygen.class | YES
| N/A | Key generator implementation to be used for generating keys from the
bootstrapped dataset. |
+| withBootstrapKeyGenClass(keyGenClass)) | hoodie.bootstrap.keygen.class | NO
| N/A | Key generator implementation to be used for generating keys from the
bootstrapped dataset. |
+| withBootstrapKeyGenTYpe(keyGenType)) | hoodie.bootstrap.keygen.type | NO |
SIMPLE | Key generator type, indicating which KeyGenerator to be used for
generating keys from the bootstrapped dataset. |
| withBootstrapModeSelector(partitionSelectorClass)) |
hoodie.bootstrap.mode.selector | NO |
org.apache.hudi.client.bootstrap.selector.MetadataOnlyBootstrapModeSelector |
Bootstap Mode Selector class. By default, Hudi employs METADATA_ONLY boostrap
for all partitions. |
| withBootstrapPartitionPathTranslatorClass(partitionPathTranslatorClass) |
hoodie.bootstrap.partitionpath.translator.class | NO |
org.apache.hudi.client.bootstrap.selector.MetadataOnlyBootstrapModeSelector |
For METADATA_ONLY bootstrap, this class allows customization of partition paths
used in Hudi target dataset. By default, no customization is done and the
partition paths reflects what is available in source parquet table. |
| withFullBootstrapInputProvider(partitionSelectorClass) |
hoodie.bootstrap.full.input.provider | NO |
org.apache.hudi.bootstrap.SparkParquetBootstrapDataProvider | For FULL_RECORD
bootstrap, this class use for reading the bootstrap dataset partitions/files
and provides the input RDD of Hudi records to write. |
