This is an automated email from the ASF dual-hosted git repository.
dockerzhang pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/inlong-website.git
The following commit(s) were added to refs/heads/master by this push:
new b6d4c249a0 [INLONG-858][Doc] Update the latest image for MySQL-CK
example (#859)
b6d4c249a0 is described below
commit b6d4c249a026d8a461187a651a93519f9e2a1d06
Author: Charles Zhang <[email protected]>
AuthorDate: Tue Sep 19 20:56:46 2023 +0800
[INLONG-858][Doc] Update the latest image for MySQL-CK example (#859)
---
.../img/mysql_clickhouse/create_data_source.png | Bin 147936 -> 0 bytes
.../img/mysql_clickhouse/create_sink.png | Bin 229676 -> 61079 bytes
.../img/mysql_clickhouse/create_source.png | Bin 0 -> 35326 bytes
.../quick_start/img/mysql_clickhouse/data_page.png | Bin 142836 -> 0 bytes
.../img/mysql_clickhouse/data_stream_config.png | Bin 169165 -> 34336 bytes
.../img/mysql_clickhouse/data_table.png | Bin 11751 -> 0 bytes
docs/quick_start/img/mysql_clickhouse/datanode.png | Bin 101757 -> 18029 bytes
.../img/mysql_clickhouse/kafka_cluster.png | Bin 89194 -> 16351 bytes
.../img/mysql_clickhouse/receive_data.png | Bin 0 -> 75037 bytes
docs/quick_start/img/mysql_clickhouse/result.png | Bin 123659 -> 37594 bytes
.../quick_start/img/mysql_clickhouse/send_data.png | Bin 4877 -> 37466 bytes
.../img/mysql_clickhouse/stream_audit.png | Bin 0 -> 74687 bytes
docs/quick_start/mysql_kafka_clickhouse_example.md | 44 ++++++++++++++++++---
.../img/mysql_clickhouse/create_data_source.png | Bin 43896 -> 0 bytes
.../img/mysql_clickhouse/create_sink.png | Bin 108070 -> 65016 bytes
.../img/mysql_clickhouse/create_source.png | Bin 0 -> 37159 bytes
.../quick_start/img/mysql_clickhouse/data_page.png | Bin 72009 -> 0 bytes
.../img/mysql_clickhouse/data_stream_config.png | Bin 49984 -> 37147 bytes
.../img/mysql_clickhouse/data_table.png | Bin 11751 -> 0 bytes
.../img/mysql_clickhouse/kafka_cluster.png | Bin 10461 -> 17745 bytes
.../img/mysql_clickhouse/receive_data.png | Bin 0 -> 75037 bytes
.../quick_start/img/mysql_clickhouse/result.png | Bin 28199 -> 37856 bytes
.../quick_start/img/mysql_clickhouse/send_data.png | Bin 4877 -> 37466 bytes
.../img/mysql_clickhouse/stream_audit.png | Bin 0 -> 77095 bytes
.../quick_start/mysql_kafka_clickhouse_example.md | 44 ++++++++++++++++++---
25 files changed, 77 insertions(+), 11 deletions(-)
diff --git a/docs/quick_start/img/mysql_clickhouse/create_data_source.png
b/docs/quick_start/img/mysql_clickhouse/create_data_source.png
deleted file mode 100644
index a4a143c9a9..0000000000
Binary files a/docs/quick_start/img/mysql_clickhouse/create_data_source.png and
/dev/null differ
diff --git a/docs/quick_start/img/mysql_clickhouse/create_sink.png
b/docs/quick_start/img/mysql_clickhouse/create_sink.png
index 2b0b70ebbc..3415211b9c 100644
Binary files a/docs/quick_start/img/mysql_clickhouse/create_sink.png and
b/docs/quick_start/img/mysql_clickhouse/create_sink.png differ
diff --git a/docs/quick_start/img/mysql_clickhouse/create_source.png
b/docs/quick_start/img/mysql_clickhouse/create_source.png
new file mode 100644
index 0000000000..479fc7dd88
Binary files /dev/null and
b/docs/quick_start/img/mysql_clickhouse/create_source.png differ
diff --git a/docs/quick_start/img/mysql_clickhouse/data_page.png
b/docs/quick_start/img/mysql_clickhouse/data_page.png
deleted file mode 100644
index b67ba707cc..0000000000
Binary files a/docs/quick_start/img/mysql_clickhouse/data_page.png and
/dev/null differ
diff --git a/docs/quick_start/img/mysql_clickhouse/data_stream_config.png
b/docs/quick_start/img/mysql_clickhouse/data_stream_config.png
index 69d02de9e4..ba7f8d99d6 100644
Binary files a/docs/quick_start/img/mysql_clickhouse/data_stream_config.png and
b/docs/quick_start/img/mysql_clickhouse/data_stream_config.png differ
diff --git a/docs/quick_start/img/mysql_clickhouse/data_table.png
b/docs/quick_start/img/mysql_clickhouse/data_table.png
deleted file mode 100644
index 321406a4a2..0000000000
Binary files a/docs/quick_start/img/mysql_clickhouse/data_table.png and
/dev/null differ
diff --git a/docs/quick_start/img/mysql_clickhouse/datanode.png
b/docs/quick_start/img/mysql_clickhouse/datanode.png
index 47df5ca8ce..fdb8a72eb7 100644
Binary files a/docs/quick_start/img/mysql_clickhouse/datanode.png and
b/docs/quick_start/img/mysql_clickhouse/datanode.png differ
diff --git a/docs/quick_start/img/mysql_clickhouse/kafka_cluster.png
b/docs/quick_start/img/mysql_clickhouse/kafka_cluster.png
index 681677d13c..cab11aa43d 100644
Binary files a/docs/quick_start/img/mysql_clickhouse/kafka_cluster.png and
b/docs/quick_start/img/mysql_clickhouse/kafka_cluster.png differ
diff --git a/docs/quick_start/img/mysql_clickhouse/receive_data.png
b/docs/quick_start/img/mysql_clickhouse/receive_data.png
new file mode 100644
index 0000000000..52100b2a15
Binary files /dev/null and
b/docs/quick_start/img/mysql_clickhouse/receive_data.png differ
diff --git a/docs/quick_start/img/mysql_clickhouse/result.png
b/docs/quick_start/img/mysql_clickhouse/result.png
index a9c3d91078..6ac674f7dc 100644
Binary files a/docs/quick_start/img/mysql_clickhouse/result.png and
b/docs/quick_start/img/mysql_clickhouse/result.png differ
diff --git a/docs/quick_start/img/mysql_clickhouse/send_data.png
b/docs/quick_start/img/mysql_clickhouse/send_data.png
index 2879b84b5d..27bf8caa2f 100644
Binary files a/docs/quick_start/img/mysql_clickhouse/send_data.png and
b/docs/quick_start/img/mysql_clickhouse/send_data.png differ
diff --git a/docs/quick_start/img/mysql_clickhouse/stream_audit.png
b/docs/quick_start/img/mysql_clickhouse/stream_audit.png
new file mode 100644
index 0000000000..35c04f7cae
Binary files /dev/null and
b/docs/quick_start/img/mysql_clickhouse/stream_audit.png differ
diff --git a/docs/quick_start/mysql_kafka_clickhouse_example.md
b/docs/quick_start/mysql_kafka_clickhouse_example.md
index 0952f59df5..b57d47548c 100644
--- a/docs/quick_start/mysql_kafka_clickhouse_example.md
+++ b/docs/quick_start/mysql_kafka_clickhouse_example.md
@@ -58,8 +58,16 @@ Click [Next] -> [Create], config data stream.

### Create Data Source
-Click [Sources create] -> [MySQL], config data source informations.
-
+Click [Sources create] -> [MySQL], config data source information.
+
+
+:::note
+Please create `test_mysql_db.test_mysql_table` database and table, it's schema
is:
+CREATE TABLE test_mysql_db.test_mysql_table (
+id INT PRIMARY KEY,
+name VARCHAR(50)
+);
+:::
### Create Data Sink
Click [Sinks create] -> [ClickHouse], input Name, DbName, TableName and select
created ck DataNode and so on, then click [save].
@@ -75,15 +83,39 @@ Back to [Ingestion] page, wait for [configuration success].
## Test Data
### Send Data

-Add 1001 datas to MySQL.
+Add 1000 data items to MySQL.
### Verify Data
Check data in [Audit] page.
-
+
then enter ClickHouse container, check data in table.
-
+
## Questions
### Task Configuration Failed
-Generally, the MQ or Flink group configuration is incorrect. You can view the
error information on the page, or enter the Manager container to view detailed
logs.
\ No newline at end of file
+Generally, the MQ or Flink group configuration is incorrect. You can view the
error information on the page, or enter the Manager container to view detailed
logs.
+
+### The script for sending data
+```bash
+#!/bin/bash
+
+# MySQL information
+DB_HOST="mysql"
+DB_USER="root"
+DB_PASS="inlong"
+DB_NAME="test_mysql_db"
+DB_TABLE="test_mysql_table"
+
+# insert data by a loop
+for ((i=1; i<=1000; i++))
+do
+ # generate data
+ id=$i
+ name="name_$i"
+ # insert data
+ query="INSERT INTO $DB_TABLE (id, name) VALUES ($id, '$name');"
+ # execute insert
+ mysql -h $DB_HOST -u $DB_USER -p$DB_PASS $DB_NAME -e "$query"
+done
+```
\ No newline at end of file
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/current/quick_start/img/mysql_clickhouse/create_data_source.png
b/i18n/zh-CN/docusaurus-plugin-content-docs/current/quick_start/img/mysql_clickhouse/create_data_source.png
deleted file mode 100644
index 7932e1d67a..0000000000
Binary files
a/i18n/zh-CN/docusaurus-plugin-content-docs/current/quick_start/img/mysql_clickhouse/create_data_source.png
and /dev/null differ
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/current/quick_start/img/mysql_clickhouse/create_sink.png
b/i18n/zh-CN/docusaurus-plugin-content-docs/current/quick_start/img/mysql_clickhouse/create_sink.png
index 006f1870ba..02116dd628 100644
Binary files
a/i18n/zh-CN/docusaurus-plugin-content-docs/current/quick_start/img/mysql_clickhouse/create_sink.png
and
b/i18n/zh-CN/docusaurus-plugin-content-docs/current/quick_start/img/mysql_clickhouse/create_sink.png
differ
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/current/quick_start/img/mysql_clickhouse/create_source.png
b/i18n/zh-CN/docusaurus-plugin-content-docs/current/quick_start/img/mysql_clickhouse/create_source.png
new file mode 100644
index 0000000000..ed89031ea0
Binary files /dev/null and
b/i18n/zh-CN/docusaurus-plugin-content-docs/current/quick_start/img/mysql_clickhouse/create_source.png
differ
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/current/quick_start/img/mysql_clickhouse/data_page.png
b/i18n/zh-CN/docusaurus-plugin-content-docs/current/quick_start/img/mysql_clickhouse/data_page.png
deleted file mode 100644
index c81121f715..0000000000
Binary files
a/i18n/zh-CN/docusaurus-plugin-content-docs/current/quick_start/img/mysql_clickhouse/data_page.png
and /dev/null differ
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/current/quick_start/img/mysql_clickhouse/data_stream_config.png
b/i18n/zh-CN/docusaurus-plugin-content-docs/current/quick_start/img/mysql_clickhouse/data_stream_config.png
index be2db9024c..92e45c068d 100644
Binary files
a/i18n/zh-CN/docusaurus-plugin-content-docs/current/quick_start/img/mysql_clickhouse/data_stream_config.png
and
b/i18n/zh-CN/docusaurus-plugin-content-docs/current/quick_start/img/mysql_clickhouse/data_stream_config.png
differ
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/current/quick_start/img/mysql_clickhouse/data_table.png
b/i18n/zh-CN/docusaurus-plugin-content-docs/current/quick_start/img/mysql_clickhouse/data_table.png
deleted file mode 100644
index 321406a4a2..0000000000
Binary files
a/i18n/zh-CN/docusaurus-plugin-content-docs/current/quick_start/img/mysql_clickhouse/data_table.png
and /dev/null differ
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/current/quick_start/img/mysql_clickhouse/kafka_cluster.png
b/i18n/zh-CN/docusaurus-plugin-content-docs/current/quick_start/img/mysql_clickhouse/kafka_cluster.png
index 9d750f7f95..7872fb0c91 100644
Binary files
a/i18n/zh-CN/docusaurus-plugin-content-docs/current/quick_start/img/mysql_clickhouse/kafka_cluster.png
and
b/i18n/zh-CN/docusaurus-plugin-content-docs/current/quick_start/img/mysql_clickhouse/kafka_cluster.png
differ
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/current/quick_start/img/mysql_clickhouse/receive_data.png
b/i18n/zh-CN/docusaurus-plugin-content-docs/current/quick_start/img/mysql_clickhouse/receive_data.png
new file mode 100644
index 0000000000..52100b2a15
Binary files /dev/null and
b/i18n/zh-CN/docusaurus-plugin-content-docs/current/quick_start/img/mysql_clickhouse/receive_data.png
differ
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/current/quick_start/img/mysql_clickhouse/result.png
b/i18n/zh-CN/docusaurus-plugin-content-docs/current/quick_start/img/mysql_clickhouse/result.png
index ddd99d487d..2476b7bb3e 100644
Binary files
a/i18n/zh-CN/docusaurus-plugin-content-docs/current/quick_start/img/mysql_clickhouse/result.png
and
b/i18n/zh-CN/docusaurus-plugin-content-docs/current/quick_start/img/mysql_clickhouse/result.png
differ
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/current/quick_start/img/mysql_clickhouse/send_data.png
b/i18n/zh-CN/docusaurus-plugin-content-docs/current/quick_start/img/mysql_clickhouse/send_data.png
index 2879b84b5d..27bf8caa2f 100644
Binary files
a/i18n/zh-CN/docusaurus-plugin-content-docs/current/quick_start/img/mysql_clickhouse/send_data.png
and
b/i18n/zh-CN/docusaurus-plugin-content-docs/current/quick_start/img/mysql_clickhouse/send_data.png
differ
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/current/quick_start/img/mysql_clickhouse/stream_audit.png
b/i18n/zh-CN/docusaurus-plugin-content-docs/current/quick_start/img/mysql_clickhouse/stream_audit.png
new file mode 100644
index 0000000000..ba38c8736a
Binary files /dev/null and
b/i18n/zh-CN/docusaurus-plugin-content-docs/current/quick_start/img/mysql_clickhouse/stream_audit.png
differ
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/current/quick_start/mysql_kafka_clickhouse_example.md
b/i18n/zh-CN/docusaurus-plugin-content-docs/current/quick_start/mysql_kafka_clickhouse_example.md
index 91f649d5ec..5ecefab8e4 100644
---
a/i18n/zh-CN/docusaurus-plugin-content-docs/current/quick_start/mysql_kafka_clickhouse_example.md
+++
b/i18n/zh-CN/docusaurus-plugin-content-docs/current/quick_start/mysql_kafka_clickhouse_example.md
@@ -56,7 +56,15 @@ Password: inlong
### 新建数据源
点击【新建数据源】->【MySQL】,配置数据源名称、地址、用户密码以及库表信息等:
-
+
+
+:::note
+请预先创建 `test_mysql_db.test_mysql_table` 库表,schema 为:
+CREATE TABLE test_mysql_db.test_mysql_table (
+id INT PRIMARY KEY,
+name VARCHAR(50)
+);
+:::
### 新建数据目标
点击【新建数据目标】->【ClickHouse】,配置名称、库表、已创建的 ck 数据节点以及 Schema 映射信息等,完成后点击 【提交审批】:
@@ -72,15 +80,41 @@ Password: inlong
## 测试数据
### 发送数据

-累计对 MySQL 添加 1001 条数据。
+累计对 MySQL 添加 1000 条数据。
### 数据验证
查看审计页面发送数据:
-
+
然后进入 ClickHouse 容器,查看库表数据:
-
+
## 常见问题
### 任务配置失败
-一般是 MQ 或者 Flink 集群配置错误导致,可以在页面查看错误信息,或者进入 Manager 容器查看详细日志。
\ No newline at end of file
+一般是 MQ 或者 Flink 集群配置错误导致,可以在页面查看错误信息,或者进入 Manager 容器查看详细日志。
+
+### 发送数据生成脚本
+```bash
+#!/bin/bash
+
+# MySQL数据库连接信息
+DB_HOST="mysql"
+DB_USER="root"
+DB_PASS="inlong"
+DB_NAME="test_mysql_db"
+DB_TABLE="test_mysql_table"
+
+# 循环插入数据
+for ((i=1; i<=1000; i++))
+do
+ # 生成要插入的数据
+ id=$i
+ name="name_$i"
+
+ # 构建插入语句
+ query="INSERT INTO $DB_TABLE (id, name) VALUES ($id, '$name');"
+
+ # 执行插入语句
+ mysql -h $DB_HOST -u $DB_USER -p$DB_PASS $DB_NAME -e "$query"
+done
+```
\ No newline at end of file