This is an automated email from the ASF dual-hosted git repository.
vinoth pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/asf-site by this push:
new e9a39f8 Travis CI build asf-site
e9a39f8 is described below
commit e9a39f820dc356021d2074d5518f819d901a1c15
Author: CI <[email protected]>
AuthorDate: Sat Aug 22 13:54:27 2020 +0000
Travis CI build asf-site
---
content/cn/docs/configurations.html | 31 ++++++++++++++++++++++++++++---
content/docs/configurations.html | 30 +++++++++++++++++++++++++++---
2 files changed, 55 insertions(+), 6 deletions(-)
diff --git a/content/cn/docs/configurations.html
b/content/cn/docs/configurations.html
index 5636b76..1456a71 100644
--- a/content/cn/docs/configurations.html
+++ b/content/cn/docs/configurations.html
@@ -911,7 +911,7 @@ Hudi提供了一个选项,可以通过将对该分区中的插入作为对现
<span style="color:grey">此属性控制报告给驱动程序的失败记录和异常的比例</span></p>
<h3 id="写提交回调配置">写提交回调配置</h3>
-<p>控制写提交的回调。 如果用户启用了回调并且回调过程发生了错误,则会抛出异常。 当前只支持Http回调方式,Kafka不久后会支持。
+<p>控制写提交的回调。 如果用户启用了回调并且回调过程发生了错误,则会抛出异常。 当前支持HTTP, Kafka 两种回调方式。
<a href="#withCallbackConfig">withCallbackConfig</a>
(HoodieWriteCommitCallbackConfig) <br />
<span style="color:grey">写提交回调相关配置</span></p>
@@ -921,9 +921,10 @@ Hudi提供了一个选项,可以通过将对该分区中的插入作为对现
<h5 id="withCallbackClass">withCallbackClass(callbackClass)</h5>
<p>Property: <code
class="highlighter-rouge">hoodie.write.commit.callback.class</code> <br />
-<span style="color:grey">用户自定义回调的类全路径名,回调类必须为HoodieWriteCommitCallback的子类。默认
org.apache.hudi.callback.impl.HoodieWriteCommitHttpCallback</span></p>
+<span style="color:grey">回调类的完全限定名,必须实现HoodieWriteCommitCallback接口。默认
org.apache.hudi.callback.impl.HoodieWriteCommitHttpCallback</span></p>
-<h4 id="hoodiewritecommithttpcallback">HoodieWriteCommitHttpCallback</h4>
+<h4 id="http-callback">HTTP CALLBACK</h4>
+<p>通过 HTTP 发送写提交回调信息. 这是默认的实现方式,用户不需要显式指定。</p>
<h5 id="withCallbackHttpUrl">withCallbackHttpUrl(url)</h5>
<p>Property: <code
class="highlighter-rouge">hoodie.write.commit.callback.http.url</code> <br />
@@ -937,6 +938,30 @@ Hudi提供了一个选项,可以通过将对该分区中的插入作为对现
<p>Property: <code
class="highlighter-rouge">hoodie.write.commit.callback.http.api.key</code> <br
/>
<span style="color:grey">Http 回调秘钥. 默认
hudi_write_commit_http_callback</span></p>
+<h4 id="kafka-callback">KAFKA CALLBACK</h4>
+<p>使用Kafka发送写提交回调信息, 用户需要配置 <code
class="highlighter-rouge">hoodie.write.commit.callback.class</code> = <code
class="highlighter-rouge">org.apache.hudi.utilities.callback.kafka.HoodieWriteCommitKafkaCallback</code></p>
+
+<h5 id="callback_kafka_bootstrap_servers">CALLBACK_KAFKA_BOOTSTRAP_SERVERS</h5>
+<p>Property: <code
class="highlighter-rouge">hoodie.write.commit.callback.kafka.bootstrap.servers</code>
<br />
+<span style="color:grey">Kafka 集群地址</span></p>
+
+<h5 id="callback_kafka_topic">CALLBACK_KAFKA_TOPIC</h5>
+<p>Property: <code
class="highlighter-rouge">hoodie.write.commit.callback.kafka.topic</code> <br />
+<span style="color:grey">发送回调信息的topic</span></p>
+
+<h5 id="callback_kafka_partition">CALLBACK_KAFKA_PARTITION</h5>
+<p>Property: <code
class="highlighter-rouge">hoodie.write.commit.callback.kafka.partition</code>
<br />
+<span style="color:grey">指定发送的分区, 默认 0 </span></p>
+
+<h5 id="callback_kafka_acks">CALLBACK_KAFKA_ACKS</h5>
+<p>Property: <code
class="highlighter-rouge">hoodie.write.commit.callback.kafka.acks</code> <br />
+<span style="color:grey">Acks 级别, 默认 <code
class="highlighter-rouge">all</code></span></p>
+
+<h5 id="callback_kafka_retries">CALLBACK_KAFKA_RETRIES</h5>
+<p>Property: <code
class="highlighter-rouge">hoodie.write.commit.callback.kafka.retries</code> <br
/>
+<span style="color:grey">Kafka 发送数据失败重试次数. 默认 3 次</span></p>
+
+
</section>
<a href="#masthead__inner-wrap" class="back-to-top">Back to top
↑</a>
diff --git a/content/docs/configurations.html b/content/docs/configurations.html
index 69e45cb..5f5783e 100644
--- a/content/docs/configurations.html
+++ b/content/docs/configurations.html
@@ -886,7 +886,7 @@ HoodieWriteConfig can be built using a builder pattern as
below.</p>
<span style="color:grey">This property controls what fraction of the failed
record, exceptions we report back to driver</span></p>
<h3 id="write-commit-callback-configs">Write commit callback configs</h3>
-<p>Controls callback behavior on write commit. Exception will be thrown if
user enabled the callback service and errors occurred during the process of
callback. Currently support http callback only, kafka implementation will be
supported in the near future.
+<p>Controls callback behavior on write commit. Exception will be thrown if
user enabled the callback service and errors occurred during the process of
callback. Currently support HTTP, Kafka type.
<a href="#withCallbackConfig">withCallbackConfig</a>
(HoodieWriteCommitCallbackConfig) <br />
<span style="color:grey">Callback related configs</span></p>
@@ -896,9 +896,10 @@ HoodieWriteConfig can be built using a builder pattern as
below.</p>
<h5 id="withCallbackClass">withCallbackClass(callbackClass)</h5>
<p>Property: <code
class="highlighter-rouge">hoodie.write.commit.callback.class</code> <br />
-<span style="color:grey">Full path of user-defined callback class and must be
a subclass of HoodieWriteCommitCallback class,
org.apache.hudi.callback.impl.HoodieWriteCommitHttpCallback by
default</span></p>
+<span style="color:grey">Full path of callback class and must be a subclass of
HoodieWriteCommitCallback class,
org.apache.hudi.callback.impl.HoodieWriteCommitHttpCallback by
default</span></p>
-<h4 id="hoodiewritecommithttpcallback">HoodieWriteCommitHttpCallback</h4>
+<h4 id="http-callback">HTTP CALLBACK</h4>
+<p>Callback via HTTP, User does not need to specify this way explicitly, it is
the default type.</p>
<h5 id="withCallbackHttpUrl">withCallbackHttpUrl(url)</h5>
<p>Property: <code
class="highlighter-rouge">hoodie.write.commit.callback.http.url</code> <br />
@@ -912,6 +913,29 @@ HoodieWriteConfig can be built using a builder pattern as
below.</p>
<p>Property: <code
class="highlighter-rouge">hoodie.write.commit.callback.http.api.key</code> <br
/>
<span style="color:grey">Http callback API key.
hudi_write_commit_http_callback by default</span></p>
+<h4 id="kafka-callback">KAFKA CALLBACK</h4>
+<p>To use kafka callback, User should set <code
class="highlighter-rouge">hoodie.write.commit.callback.class</code> = <code
class="highlighter-rouge">org.apache.hudi.utilities.callback.kafka.HoodieWriteCommitKafkaCallback</code></p>
+
+<h5 id="callback_kafka_bootstrap_servers">CALLBACK_KAFKA_BOOTSTRAP_SERVERS</h5>
+<p>Property: <code
class="highlighter-rouge">hoodie.write.commit.callback.kafka.bootstrap.servers</code>
<br />
+<span style="color:grey">Bootstrap servers of kafka callback cluster</span></p>
+
+<h5 id="callback_kafka_topic">CALLBACK_KAFKA_TOPIC</h5>
+<p>Property: <code
class="highlighter-rouge">hoodie.write.commit.callback.kafka.topic</code> <br />
+<span style="color:grey">Kafka topic to be sent along with callback
messages</span></p>
+
+<h5 id="callback_kafka_partition">CALLBACK_KAFKA_PARTITION</h5>
+<p>Property: <code
class="highlighter-rouge">hoodie.write.commit.callback.kafka.partition</code>
<br />
+<span style="color:grey">partition of <code
class="highlighter-rouge">CALLBACK_KAFKA_TOPIC</code>, 0 by default</span></p>
+
+<h5 id="callback_kafka_acks">CALLBACK_KAFKA_ACKS</h5>
+<p>Property: <code
class="highlighter-rouge">hoodie.write.commit.callback.kafka.acks</code> <br />
+<span style="color:grey">kafka acks level, <code
class="highlighter-rouge">all</code> by default</span></p>
+
+<h5 id="callback_kafka_retries">CALLBACK_KAFKA_RETRIES</h5>
+<p>Property: <code
class="highlighter-rouge">hoodie.write.commit.callback.kafka.retries</code> <br
/>
+<span style="color:grey">Times to retry. 3 by default</span></p>
+
</section>
<a href="#masthead__inner-wrap" class="back-to-top">Back to top
↑</a>