This is an automated email from the ASF dual-hosted git repository.
morningman pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris-website.git
The following commit(s) were added to refs/heads/master by this push:
new f8996faa054 [ecosystem]Kafka-connector properties adds timeout
adjustment suggestions (#1170)
f8996faa054 is described below
commit f8996faa0547d0a3ea23e9231f729b0a412606bc
Author: wudongliang <[email protected]>
AuthorDate: Mon Oct 21 12:01:51 2024 +0800
[ecosystem]Kafka-connector properties adds timeout adjustment suggestions
(#1170)
# Versions
- [ ] dev
- [ ] 3.0
- [ ] 2.1
- [ ] 2.0
# Languages
- [ ] Chinese
- [ ] English
---
common_docs_zh/ecosystem/doris-kafka-connector.md | 10 ++++++++++
ecosystem/doris-kafka-connector.md | 10 ++++++++++
2 files changed, 20 insertions(+)
diff --git a/common_docs_zh/ecosystem/doris-kafka-connector.md
b/common_docs_zh/ecosystem/doris-kafka-connector.md
index 6a32ae5864f..2db7d53a423 100644
--- a/common_docs_zh/ecosystem/doris-kafka-connector.md
+++ b/common_docs_zh/ecosystem/doris-kafka-connector.md
@@ -54,6 +54,11 @@ bootstrap.servers=127.0.0.1:9092
# 修改为创建的 plugins 目录
# 注意：此处请填写 Kafka 的直接路径。例如：plugin.path=/opt/kafka/plugins
plugin.path=$KAFKA_HOME/plugins
+
+# 建议将 Kafka 的 max.poll.interval.ms 时间调大到 30 分钟以上，默认 5 分钟
+# 避免 Stream Load 导入数据消费超时，消费者被踢出消费群组
+max.poll.interval.ms=1800000
+consumer.max.poll.interval.ms=1800000
```
配置 doris-connector-sink.properties
@@ -103,6 +108,11 @@ group.id=connect-cluster
# 修改为创建的 plugins 目录
# 注意：此处请填写 Kafka 的直接路径。例如：plugin.path=/opt/kafka/plugins
plugin.path=$KAFKA_HOME/plugins
+
+# 建议将 Kafka 的 max.poll.interval.ms 时间调大到 30 分钟以上，默认 5 分钟
+# 避免 Stream Load 导入数据消费超时，消费者被踢出消费群组
+max.poll.interval.ms=1800000
+consumer.max.poll.interval.ms=1800000
```
diff --git a/ecosystem/doris-kafka-connector.md
b/ecosystem/doris-kafka-connector.md
index 1617857b926..cff23c2c759 100644
--- a/ecosystem/doris-kafka-connector.md
+++ b/ecosystem/doris-kafka-connector.md
@@ -54,6 +54,11 @@ bootstrap.servers=127.0.0.1:9092
# Modify to the created plugins directory
# Note: Please fill in the direct path to Kafka here. For example:
plugin.path=/opt/kafka/plugins
plugin.path=$KAFKA_HOME/plugins
+
+# It is recommended to increase the max.poll.interval.ms time of Kafka to more
than 30 minutes, the default is 5 minutes
+# Avoid Stream Load import data consumption timeout and consumers being kicked
out of the consumer group
+max.poll.interval.ms=1800000
+consumer.max.poll.interval.ms=1800000
```
Configure doris-connector-sink.properties
@@ -102,6 +107,11 @@ group.id=connect-cluster
# Modify to the created plugins directory
# Note: Please fill in the direct path to Kafka here. For example:
plugin.path=/opt/kafka/plugins
plugin.path=$KAFKA_HOME/plugins
+
+# It is recommended to increase the max.poll.interval.ms time of Kafka to more
than 30 minutes, the default is 5 minutes
+# Avoid Stream Load import data consumption timeout and consumers being kicked
out of the consumer group
+max.poll.interval.ms=1800000
+consumer.max.poll.interval.ms=1800000
```
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
