This is an automated email from the ASF dual-hosted git repository.
luzhijing pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris-website.git
The following commit(s) were added to refs/heads/master by this push:
new b04bce9213 [doc](routine load) add tips when using Single-task Loading
to Multiple Tables (#710)
b04bce9213 is described below
commit b04bce9213a2df3916ce61544e52b8af5a88fdd0
Author: yagagagaga <[email protected]>
AuthorDate: Fri Jun 21 16:50:07 2024 +0800
[doc](routine load) add tips when using Single-task Loading to Multiple
Tables (#710)
---
docs/data-operate/import/routine-load-manual.md | 2 ++
.../current/data-operate/import/routine-load-manual.md | 2 ++
.../version-2.0/data-operate/import/routine-load-manual.md | 2 ++
.../version-2.1/data-operate/import/routine-load-manual.md | 2 ++
versioned_docs/version-2.0/data-operate/import/routine-load-manual.md | 2 ++
versioned_docs/version-2.1/data-operate/import/routine-load-manual.md | 2 ++
6 files changed, 12 insertions(+)
diff --git a/docs/data-operate/import/routine-load-manual.md
b/docs/data-operate/import/routine-load-manual.md
index db5d5614e4..c102a8cad6 100644
--- a/docs/data-operate/import/routine-load-manual.md
+++ b/docs/data-operate/import/routine-load-manual.md
@@ -1915,6 +1915,8 @@ FROM KAFKA
);
```
+Currently, only extracting the table name from the Value field of Kafka is
supported. The format should be as follows, using JSON as an example:
`table_name|{"col1": "val1", "col2": "val2"}`, where `tbl_name` is the table
name and `|` is used as the separator between the table name and the table
data. The same format applies to CSV data, such as `table_name|val1,val2,val3`.
Note that the `table_name` here must be consistent with the table name in
Doris, otherwise the load will fail. Note [...]
+
### Strict Mode Load
Create a Kafka routine load task named "test1" for the "example_db" and
"example_tbl". The load task is set to strict mode.
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/current/data-operate/import/routine-load-manual.md
b/i18n/zh-CN/docusaurus-plugin-content-docs/current/data-operate/import/routine-load-manual.md
index be16f4f270..a135af21af 100644
---
a/i18n/zh-CN/docusaurus-plugin-content-docs/current/data-operate/import/routine-load-manual.md
+++
b/i18n/zh-CN/docusaurus-plugin-content-docs/current/data-operate/import/routine-load-manual.md
@@ -1910,6 +1910,8 @@ FROM KAFKA
);
```
+这个时候需要 Kafka 中的数据包含表名的信息。目前仅支持从 Kafka 的 Value 中获取动态表名，且需要符合这种格式：以 json
为例：`table_name|{"col1": "val1", "col2": "val2"}`, 其中 `tbl_name` 为表名，以 `|`
作为表名和表数据的分隔符。csv 格式的数据也是类似的，如：`table_name|val1,val2,val3`。注意，这里的 `table_name`
必须和 Doris 中的表名一致，否则会导致导入失败。注意，动态表不支持后面介绍的 column_mapping 配置。
+
### 严格模式导入
为 example_db 的 example_tbl 创建一个名为 test1 的 Kafka 例行导入任务。导入任务为严格模式。
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0/data-operate/import/routine-load-manual.md
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0/data-operate/import/routine-load-manual.md
index 905dc61e1e..b78ecd7c44 100644
---
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0/data-operate/import/routine-load-manual.md
+++
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0/data-operate/import/routine-load-manual.md
@@ -1910,6 +1910,8 @@ FROM KAFKA
);
```
+这个时候需要 Kafka 中的数据包含表名的信息。目前仅支持从 Kafka 的 Value 中获取动态表名，且需要符合这种格式：以 json
为例：`table_name|{"col1": "val1", "col2": "val2"}`, 其中 `tbl_name` 为表名，以 `|`
作为表名和表数据的分隔符。csv 格式的数据也是类似的，如：`table_name|val1,val2,val3`。注意，这里的 `table_name`
必须和 Doris 中的表名一致，否则会导致导入失败。注意，动态表不支持后面介绍的 column_mapping 配置。
+
### 严格模式导入
为 example_db 的 example_tbl 创建一个名为 test1 的 Kafka 例行导入任务。导入任务为严格模式。
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1/data-operate/import/routine-load-manual.md
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1/data-operate/import/routine-load-manual.md
index 0fbba78d87..1bc1bbacbc 100644
---
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1/data-operate/import/routine-load-manual.md
+++
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1/data-operate/import/routine-load-manual.md
@@ -1910,6 +1910,8 @@ FROM KAFKA
);
```
+这个时候需要 Kafka 中的数据包含表名的信息。目前仅支持从 Kafka 的 Value 中获取动态表名，且需要符合这种格式：以 json
为例：`table_name|{"col1": "val1", "col2": "val2"}`, 其中 `tbl_name` 为表名，以 `|`
作为表名和表数据的分隔符。csv 格式的数据也是类似的，如：`table_name|val1,val2,val3`。注意，这里的 `table_name`
必须和 Doris 中的表名一致，否则会导致导入失败。注意，动态表不支持后面介绍的 column_mapping 配置。
+
### 严格模式导入
为 example_db 的 example_tbl 创建一个名为 test1 的 Kafka 例行导入任务。导入任务为严格模式。
diff --git
a/versioned_docs/version-2.0/data-operate/import/routine-load-manual.md
b/versioned_docs/version-2.0/data-operate/import/routine-load-manual.md
index 23b8a0a20e..d59ff7f139 100644
--- a/versioned_docs/version-2.0/data-operate/import/routine-load-manual.md
+++ b/versioned_docs/version-2.0/data-operate/import/routine-load-manual.md
@@ -1915,6 +1915,8 @@ FROM KAFKA
);
```
+Currently, only extracting the table name from the Value field of Kafka is
supported. The format should be as follows, using JSON as an example:
`table_name|{"col1": "val1", "col2": "val2"}`, where `tbl_name` is the table
name and `|` is used as the separator between the table name and the table
data. The same format applies to CSV data, such as `table_name|val1,val2,val3`.
Note that the `table_name` here must be consistent with the table name in
Doris, otherwise the load will fail. Note [...]
+
### Strict Mode Load
Create a Kafka routine load task named "test1" for the "example_db" and
"example_tbl". The load task is set to strict mode.
diff --git
a/versioned_docs/version-2.1/data-operate/import/routine-load-manual.md
b/versioned_docs/version-2.1/data-operate/import/routine-load-manual.md
index db5d5614e4..c102a8cad6 100644
--- a/versioned_docs/version-2.1/data-operate/import/routine-load-manual.md
+++ b/versioned_docs/version-2.1/data-operate/import/routine-load-manual.md
@@ -1915,6 +1915,8 @@ FROM KAFKA
);
```
+Currently, only extracting the table name from the Value field of Kafka is
supported. The format should be as follows, using JSON as an example:
`table_name|{"col1": "val1", "col2": "val2"}`, where `tbl_name` is the table
name and `|` is used as the separator between the table name and the table
data. The same format applies to CSV data, such as `table_name|val1,val2,val3`.
Note that the `table_name` here must be consistent with the table name in
Doris, otherwise the load will fail. Note [...]
+
### Strict Mode Load
Create a Kafka routine load task named "test1" for the "example_db" and
"example_tbl". The load task is set to strict mode.
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
