This is an automated email from the ASF dual-hosted git repository.
liuyu pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/pulsar-site.git
The following commit(s) were added to refs/heads/main by this push:
new 753bc8efc94 [fix][doc] Correct configuration requirements for the HDFS
sinks (#364)
753bc8efc94 is described below
commit 753bc8efc943ae3e6154e9ef44d8d275bc56dd7d
Author: Kengo Seki <[email protected]>
AuthorDate: Fri Jan 13 10:52:21 2023 +0900
[fix][doc] Correct configuration requirements for the HDFS sinks (#364)
---
docs/io-hdfs2-sink.md | 4 ++--
docs/io-hdfs3-sink.md | 4 ++--
2 files changed, 4 insertions(+), 4 deletions(-)
diff --git a/docs/io-hdfs2-sink.md b/docs/io-hdfs2-sink.md
index 06ffd003c3a..1a7f851daf3 100644
--- a/docs/io-hdfs2-sink.md
+++ b/docs/io-hdfs2-sink.md
@@ -26,8 +26,8 @@ The configuration of the HDFS2 sink connector has the
following properties.
| `compression` | Compression |false |None |The compression code used to
compress or de-compress the files on HDFS. <br /><br />Below are the available
options:<br /><li>BZIP2<br /></li><li>DEFLATE<br /></li><li>GZIP<br
/></li><li>LZ4<br /></li><li>SNAPPY<br /></li><li>ZSTANDARD</li>|
| `kerberosUserPrincipal` |String| false| None|The principal account of
Kerberos user used for authentication. |
| `keytab` | String|false|None| The full pathname of the Kerberos keytab file
used for authentication. |
-| `filenamePrefix` |String| true, if `compression` is set to `None`. | None
|The prefix of the files created inside the HDFS directory.<br /><br
/>**Example**<br /> The value of topicA result in files named topicA-. |
-| `fileExtension` | String| true | None | The extension added to the files
written to HDFS.<br /><br />**Example**<br />'.txt'<br /> '.seq' |
+| `filenamePrefix` |String| true | None |The prefix of the files created
inside the HDFS directory.<br /><br />**Example**<br /> The value of topicA
result in files named topicA-. |
+| `fileExtension` | String| true, if `compression` is set to `None`. | None |
The extension added to the files written to HDFS.<br /><br />**Example**<br
/>'.txt'<br /> '.seq' |
| `separator` | char|false |None |The character used to separate records in a
text file. <br /><br />If no value is provided, the contents from all records
are concatenated together in one continuous byte array. |
| `syncInterval` | long| false |0| The interval between calls to flush data to
HDFS disk in milliseconds. |
| `maxPendingRecords` |int| false|Integer.MAX_VALUE | The maximum number of
records that hold in memory before acking. <br /><br />Setting this property to
1 makes every record send to disk before the record is acked.<br /><br
/>Setting this property to a higher value allows buffering records before
flushing them to disk.
diff --git a/docs/io-hdfs3-sink.md b/docs/io-hdfs3-sink.md
index eff9bdfca42..6e9f3a2f3b8 100644
--- a/docs/io-hdfs3-sink.md
+++ b/docs/io-hdfs3-sink.md
@@ -26,8 +26,8 @@ The configuration of the HDFS3 sink connector has the
following properties.
| `compression` | Compression |false |None |The compression code used to
compress or de-compress the files on HDFS. <br /><br />Below are the available
options:<br /><li>BZIP2<br /></li><li>DEFLATE<br /></li><li>GZIP<br
/></li><li>LZ4<br /></li><li>SNAPPY<br /></li><li>ZSTANDARD</li>|
| `kerberosUserPrincipal` |String| false| None|The principal account of
Kerberos user used for authentication. |
| `keytab` | String|false|None| The full pathname of the Kerberos keytab file
used for authentication. |
-| `filenamePrefix` |String| false |None |The prefix of the files created
inside the HDFS directory.<br /><br />**Example**<br /> The value of topicA
result in files named topicA-. |
-| `fileExtension` | String| false | None| The extension added to the files
written to HDFS.<br /><br />**Example**<br />'.txt'<br /> '.seq' |
+| `filenamePrefix` |String| true |None |The prefix of the files created inside
the HDFS directory.<br /><br />**Example**<br /> The value of topicA result in
files named topicA-. |
+| `fileExtension` | String| true, if `compression` is set to `None`. | None|
The extension added to the files written to HDFS.<br /><br />**Example**<br
/>'.txt'<br /> '.seq' |
| `separator` | char|false |None |The character used to separate records in a
text file. <br /><br />If no value is provided, the contents from all records
are concatenated together in one continuous byte array. |
| `syncInterval` | long| false |0| The interval between calls to flush data to
HDFS disk in milliseconds. |
| `maxPendingRecords` |int| false|Integer.MAX_VALUE | The maximum number of
records that hold in memory before acking. <br /><br />Setting this property to
1 makes every record send to disk before the record is acked.<br /><br
/>Setting this property to a higher value allows buffering records before
flushing them to disk.