This is an automated email from the ASF dual-hosted git repository. diwu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/doris-website.git
The following commit(s) were added to refs/heads/master by this push:
new 1902471bae8 [doc](enosystem) update required field for kafka connector
(#2710)
1902471bae8 is described below
commit 1902471bae80531282cd57a9fb23b07155dc9840
Author: wangchuang <[email protected]>
AuthorDate: Fri Oct 31 10:02:59 2025 +0800
[doc](enosystem) update required field for kafka connector (#2710)
relate issue: https://github.com/apache/doris-kafka-connector/issues/82
relate pr: https://github.com/apache/doris-kafka-connector/pull/83
## Versions
- [x] dev
- [x] 3.0
- [x] 2.1
- [x] 2.0
## Languages
- [x] Chinese
- [x] English
## Docs Checklist
- [ ] Checked by AI
- [ ] Test Cases Built
---
docs/ecosystem/doris-kafka-connector.md | 2 +-
.../current/ecosystem/doris-kafka-connector.md | 2 +-
.../version-2.0/ecosystem/doris-kafka-connector.md | 2 +-
.../version-2.1/ecosystem/doris-kafka-connector.md | 2 +-
.../version-3.x/ecosystem/doris-kafka-connector.md | 4 ++--
versioned_docs/version-2.0/ecosystem/doris-kafka-connector.md | 2 +-
versioned_docs/version-2.1/ecosystem/doris-kafka-connector.md | 2 +-
versioned_docs/version-3.x/ecosystem/doris-kafka-connector.md | 2 +-
8 files changed, 9 insertions(+), 9 deletions(-)
diff --git a/docs/ecosystem/doris-kafka-connector.md
b/docs/ecosystem/doris-kafka-connector.md
index 2fd60443bc6..0283d08fc04 100644
--- a/docs/ecosystem/doris-kafka-connector.md
+++ b/docs/ecosystem/doris-kafka-connector.md
@@ -200,7 +200,7 @@ errors.deadletterqueue.topic.replication.factor=1
| doris.user | - | -
|
Y | Doris username
[...]
| doris.password | - | -
|
Y | Doris password
[...]
| doris.database | - | -
|
Y | The database to write to. It can be empty when there are
multiple libraries. At the same time, the specific library name needs to be
configured in topic2table.map.
[...]
-| doris.topic2table.map | - | -
|
N | The corresponding relationship between topic and table table,
for example: topic1:tb1,topic2:tb2<br />The default is empty, indicating that
topic and table names correspond one to one. <br />The format of multiple
libraries is topic1:db1.tbl1,topic2:db2.tbl2
[...]
+| doris.topic2table.map | - | -
|
Y | The corresponding relationship between topic and table table,
for example: topic1:tb1,topic2:tb2<br />If left blank, the topic will be used
as the default table name for writing. <br />The format of multiple libraries
is topic1:db1.tbl1,topic2:db2.tbl2
[...]
| buffer.count.records | - | 50000
|
N | Number of records buffered in memory before flush triggering.
Default 50000 records
[...]
| buffer.flush.time | - | 120
|
N | Buffer refresh interval, in seconds, default 120 seconds
[...]
| buffer.size.bytes | - |
104857600(100MB)
| N | Cumulative size of records buffered in memory before
flush triggering, default 100MB |
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/current/ecosystem/doris-kafka-connector.md
b/i18n/zh-CN/docusaurus-plugin-content-docs/current/ecosystem/doris-kafka-connector.md
index 3c1fc6a4742..e7345a2e9d8 100644
---
a/i18n/zh-CN/docusaurus-plugin-content-docs/current/ecosystem/doris-kafka-connector.md
+++
b/i18n/zh-CN/docusaurus-plugin-content-docs/current/ecosystem/doris-kafka-connector.md
@@ -201,7 +201,7 @@ errors.deadletterqueue.topic.replication.factor=1
| doris.user | - | -
|
Y | Doris 用户名
[...]
| doris.password | - | -
|
Y | Doris 密码
[...]
| doris.database | - | -
|
Y | 要写入的数据库。多个库时可以为空,同时在 topic2table.map 需要配置具体的库名称
[...]
-| doris.topic2table.map | - | -
|
N | topic 和 table 表的对应关系,例:topic1:tb1,topic2:tb2<br />默认为空,表示 topic
和 table 名称一一对应。 <br /> 多个库的格式为 topic1:db1.tbl1,topic2:db2.tbl2
[...]
+| doris.topic2table.map | - | -
|
Y | topic 和 table 表的对应关系,例:topic1:tb1,topic2:tb2<br />如果留空,默认将 topic
名称作为写入的 table。 <br /> 多个库的格式为 topic1:db1.tbl1,topic2:db2.tbl2
[...]
| buffer.count.records | - | 50000
|
N | 单次 Stream Load 写入的条数。
[...]
| buffer.flush.time | - | 120
|
N | buffer 刷新间隔,单位秒,默认 120 秒
[...]
| buffer.size.bytes | - |
104857600(100MB)
| N | 单次 Stream Load 写入的数据大小。
[...]
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0/ecosystem/doris-kafka-connector.md
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0/ecosystem/doris-kafka-connector.md
index 4c68aaabb44..f16e0a6c445 100644
---
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0/ecosystem/doris-kafka-connector.md
+++
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0/ecosystem/doris-kafka-connector.md
@@ -188,7 +188,7 @@ errors.deadletterqueue.topic.replication.factor=1
| doris.user | - | -
|
Y | Doris 用户名
[...]
| doris.password | - | -
|
Y | Doris 密码
[...]
| doris.database | - | -
|
Y | 要写入的数据库。多个库时可以为空,同时在 topic2table.map 需要配置具体的库名称
[...]
-| doris.topic2table.map | - | -
|
N | topic 和 table 表的对应关系,例:topic1:tb1,topic2:tb2<br />默认为空,表示 topic
和 table 名称一一对应。 <br /> 多个库的格式为 topic1:db1.tbl1,topic2:db2.tbl2
[...]
+| doris.topic2table.map | - | -
|
Y | topic 和 table 表的对应关系,例:topic1:tb1,topic2:tb2<br />如果留空,默认将 topic
名称作为写入的 table。 <br /> 多个库的格式为 topic1:db1.tbl1,topic2:db2.tbl2
[...]
| buffer.count.records | - | 50000
|
N | 在 flush 到 doris 之前,每个 Kafka 分区在内存中缓冲的记录数。默认 50000 条记录
[...]
| buffer.flush.time | - | 120
|
N | buffer 刷新间隔,单位秒,默认 120 秒
[...]
| buffer.size.bytes | - |
10485760(100MB)
| N | 每个 Kafka 分区在内存中缓冲的记录的累积大小,单位字节,默认 100MB
[...]
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1/ecosystem/doris-kafka-connector.md
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1/ecosystem/doris-kafka-connector.md
index 5fae4107374..b5ba886aa0f 100644
---
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1/ecosystem/doris-kafka-connector.md
+++
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1/ecosystem/doris-kafka-connector.md
@@ -201,7 +201,7 @@ errors.deadletterqueue.topic.replication.factor=1
| doris.user | - | -
|
Y | Doris 用户名
[...]
| doris.password | - | -
|
Y | Doris 密码
[...]
| doris.database | - | -
|
Y | 要写入的数据库。多个库时可以为空,同时在 topic2table.map 需要配置具体的库名称
[...]
-| doris.topic2table.map | - | -
|
N | topic 和 table 表的对应关系,例:topic1:tb1,topic2:tb2<br />默认为空,表示 topic
和 table 名称一一对应。 <br /> 多个库的格式为 topic1:db1.tbl1,topic2:db2.tbl2
[...]
+| doris.topic2table.map | - | -
|
Y | topic 和 table 表的对应关系,例:topic1:tb1,topic2:tb2<br />如果留空,默认将 topic
名称作为写入的 table。 <br /> 多个库的格式为 topic1:db1.tbl1,topic2:db2.tbl2
[...]
| buffer.count.records | - | 50000
|
N | 单次 Stream Load 写入的条数。
[...]
| buffer.flush.time | - | 120
|
N | buffer 刷新间隔,单位秒,默认 120 秒
[...]
| buffer.size.bytes | - |
104857600(100MB)
| N | 单次 Stream Load 写入的数据大小。
[...]
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-3.x/ecosystem/doris-kafka-connector.md
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-3.x/ecosystem/doris-kafka-connector.md
index ae8e8391e5a..efe0f47b480 100644
---
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-3.x/ecosystem/doris-kafka-connector.md
+++
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-3.x/ecosystem/doris-kafka-connector.md
@@ -201,11 +201,11 @@ errors.deadletterqueue.topic.replication.factor=1
| doris.user | - | -
|
Y | Doris 用户名
[...]
| doris.password | - | -
|
Y | Doris 密码
[...]
| doris.database | - | -
|
Y | 要写入的数据库。多个库时可以为空,同时在 topic2table.map 需要配置具体的库名称
[...]
-| doris.topic2table.map | - | -
|
N | topic 和 table 表的对应关系,例:topic1:tb1,topic2:tb2<br />默认为空,表示 topic
和 table 名称一一对应。 <br /> 多个库的格式为 topic1:db1.tbl1,topic2:db2.tbl2
[...]
+| doris.topic2table.map | - | -
|
Y | topic 和 table 表的对应关系,例:topic1:tb1,topic2:tb2<br />如果留空,默认将 topic
名称作为写入的 table。 <br /> 多个库的格式为 topic1:db1.tbl1,topic2:db2.tbl2
[...]
| buffer.count.records | - | 50000
|
N | 单次 Stream Load 写入的条数。
[...]
| buffer.flush.time | - | 120
|
N | buffer 刷新间隔,单位秒,默认 120 秒
[...]
| buffer.size.bytes | - |
104857600(100MB)
| N | 单次 Stream Load 写入的数据大小。
[...]
-| enable.combine.flush | `true`,<br/> `false`| false | N |
是否将所有分区的数据合并在一起写入。默认值为 false。开启后只能保证 at_least_once 语义。|
+| enable.combine.flush | `true`,<br/> `false`| false | N |
是否将所有分区的数据合并在一起写入。默认值为 false。开启后只能保证 at_least_once 语义。|
| jmx | - | true
|
N | 通过 JMX 获取 Connector
内部监控指标,请参考:[Doris-Connector-JMX](https://github.com/apache/doris-kafka-connector/blob/master/docs/zh-CN/Doris-Connector-JMX.md)
[...]
| label.prefix | - | ${name}
|
N | Stream load 导入数据时的 label 前缀。默认为 Connector 应用名称。
[...]
| auto.redirect | - | true
|
N | 是否重定向 StreamLoad 请求。开启后 StreamLoad 将通过 FE 重定向到需要写入数据的
BE,并且不再显示获取 BE 信息
[...]
diff --git a/versioned_docs/version-2.0/ecosystem/doris-kafka-connector.md
b/versioned_docs/version-2.0/ecosystem/doris-kafka-connector.md
index 68bbd2987a7..ed2a66a5001 100644
--- a/versioned_docs/version-2.0/ecosystem/doris-kafka-connector.md
+++ b/versioned_docs/version-2.0/ecosystem/doris-kafka-connector.md
@@ -187,7 +187,7 @@ errors.deadletterqueue.topic.replication.factor=1
| doris.user | - | -
|
Y | Doris username
[...]
| doris.password | - | -
|
Y | Doris password
[...]
| doris.database | - | -
|
Y | The database to write to. It can be empty when there are
multiple libraries. At the same time, the specific library name needs to be
configured in topic2table.map.
[...]
-| doris.topic2table.map | - | -
|
N | The corresponding relationship between topic and table table,
for example: topic1:tb1,topic2:tb2<br />The default is empty, indicating that
topic and table names correspond one to one. <br />The format of multiple
libraries is topic1:db1.tbl1,topic2:db2.tbl2
[...]
+| doris.topic2table.map | - | -
|
Y | The corresponding relationship between topic and table table,
for example: topic1:tb1,topic2:tb2<br />If left blank, the topic will be used
as the default table name for writing. <br />The format of multiple libraries
is topic1:db1.tbl1,topic2:db2.tbl2
[...]
| buffer.count.records | - | 50000
|
N | The number of records each Kafka partition buffers in memory
before flushing to doris. Default 50000 records
[...]
| buffer.flush.time | - | 120
|
N | Buffer refresh interval, in seconds, default 120 seconds
[...]
| buffer.size.bytes | - |
10485760(100MB)
| N | The cumulative size of records buffered in memory for
each Kafka partition, in bytes, default 100MB
[...]
diff --git a/versioned_docs/version-2.1/ecosystem/doris-kafka-connector.md
b/versioned_docs/version-2.1/ecosystem/doris-kafka-connector.md
index d26a2f0389f..087de8eea4d 100644
--- a/versioned_docs/version-2.1/ecosystem/doris-kafka-connector.md
+++ b/versioned_docs/version-2.1/ecosystem/doris-kafka-connector.md
@@ -200,7 +200,7 @@ errors.deadletterqueue.topic.replication.factor=1
| doris.user | - | -
|
Y | Doris username
[...]
| doris.password | - | -
|
Y | Doris password
[...]
| doris.database | - | -
|
Y | The database to write to. It can be empty when there are
multiple libraries. At the same time, the specific library name needs to be
configured in topic2table.map.
[...]
-| doris.topic2table.map | - | -
|
N | The corresponding relationship between topic and table table,
for example: topic1:tb1,topic2:tb2<br />The default is empty, indicating that
topic and table names correspond one to one. <br />The format of multiple
libraries is topic1:db1.tbl1,topic2:db2.tbl2
[...]
+| doris.topic2table.map | - | -
|
Y | The corresponding relationship between topic and table table,
for example: topic1:tb1,topic2:tb2<br />If left blank, the topic will be used
as the default table name for writing. <br />The format of multiple libraries
is topic1:db1.tbl1,topic2:db2.tbl2
[...]
| buffer.count.records | - | 50000
|
N | Number of records buffered in memory before flush triggering.
Default 50000 records
[...]
| buffer.flush.time | - | 120
|
N | Buffer refresh interval, in seconds, default 120 seconds
[...]
| buffer.size.bytes | - |
104857600(100MB)
| N | Cumulative size of records buffered in memory before
flush triggering, default 100MB |
diff --git a/versioned_docs/version-3.x/ecosystem/doris-kafka-connector.md
b/versioned_docs/version-3.x/ecosystem/doris-kafka-connector.md
index d26a2f0389f..087de8eea4d 100644
--- a/versioned_docs/version-3.x/ecosystem/doris-kafka-connector.md
+++ b/versioned_docs/version-3.x/ecosystem/doris-kafka-connector.md
@@ -200,7 +200,7 @@ errors.deadletterqueue.topic.replication.factor=1
| doris.user | - | -
|
Y | Doris username
[...]
| doris.password | - | -
|
Y | Doris password
[...]
| doris.database | - | -
|
Y | The database to write to. It can be empty when there are
multiple libraries. At the same time, the specific library name needs to be
configured in topic2table.map.
[...]
-| doris.topic2table.map | - | -
|
N | The corresponding relationship between topic and table table,
for example: topic1:tb1,topic2:tb2<br />The default is empty, indicating that
topic and table names correspond one to one. <br />The format of multiple
libraries is topic1:db1.tbl1,topic2:db2.tbl2
[...]
+| doris.topic2table.map | - | -
|
Y | The corresponding relationship between topic and table table,
for example: topic1:tb1,topic2:tb2<br />If left blank, the topic will be used
as the default table name for writing. <br />The format of multiple libraries
is topic1:db1.tbl1,topic2:db2.tbl2
[...]
| buffer.count.records | - | 50000
|
N | Number of records buffered in memory before flush triggering.
Default 50000 records
[...]
| buffer.flush.time | - | 120
|
N | Buffer refresh interval, in seconds, default 120 seconds
[...]
| buffer.size.bytes | - |
104857600(100MB)
| N | Cumulative size of records buffered in memory before
flush triggering, default 100MB |
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
