This is an automated email from the ASF dual-hosted git repository.
aloyszhang pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/inlong-website.git
The following commit(s) were added to refs/heads/master by this push:
new fb20d83ae37 [INLONG-1086][Doc] Add documents for DolphinScheduler
offline scheduler (#1088)
fb20d83ae37 is described below
commit fb20d83ae37cd1935fd758a8eb431f587a766667
Author: emptyOVO <[email protected]>
AuthorDate: Thu Dec 5 10:41:43 2024 +0800
[INLONG-1086][Doc] Add documents for DolphinScheduler offline scheduler
(#1088)
---
.../offline_data_sync/dolphinscheduler_example.md | 97 +++++++++++++++++++++
.../dolphinscheduler/ds_process_instance.png | Bin 0 -> 441115 bytes
.../dolphinscheduler/ds_process_success.png | Bin 0 -> 381787 bytes
.../dolphinscheduler/ds_schedule_process.png | Bin 0 -> 251194 bytes
.../dolphinscheduler/ds_schedule_success.png | Bin 0 -> 258351 bytes
.../pulsar_mysql/dolphinscheduler/ds_security.png | Bin 0 -> 369559 bytes
.../pulsar_mysql/dolphinscheduler/ds_task_conf.png | Bin 0 -> 69579 bytes
.../dolphinscheduler/ds_token_copy.png | Bin 0 -> 130195 bytes
.../dolphinscheduler/ds_token_generate.png | Bin 0 -> 114247 bytes
.../dolphinscheduler/ds_token_manager.png | Bin 0 -> 260361 bytes
.../dolphinscheduler/inlong_manager_conf.png | Bin 0 -> 83005 bytes
.../pulsar_mysql/dolphinscheduler/mysql_result.png | Bin 0 -> 33012 bytes
.../img/pulsar_mysql/{ => quartz}/approve.png | Bin
.../img/pulsar_mysql/{ => quartz}/cluster_tag.png | Bin
.../{ => quartz}/conventional_schedule.png | Bin
.../{ => quartz}/create_offline_group.png | Bin
.../{ => quartz}/create_pulsar_cluster.png | Bin
.../pulsar_mysql/{ => quartz}/cron_schedule.png | Bin
.../pulsar_mysql/{ => quartz}/flink_batch_job.png | Bin
.../img/pulsar_mysql/{ => quartz}/mysql_sink.png | Bin
.../pulsar_mysql/quartz/schedule_engine_type.png | Bin 0 -> 39098 bytes
.../img/pulsar_mysql/{ => quartz}/sink.png | Bin
.../img/pulsar_mysql/{ => quartz}/sink_fields.png | Bin
.../img/pulsar_mysql/{ => quartz}/source.png | Bin
.../pulsar_mysql/{ => quartz}/source_fields.png | Bin
.../{pulsar_mysql_example.md => quartz_example.md} | 42 +++++----
.../offline_data_sync/dolphinscheduler_example.md | 96 ++++++++++++++++++++
.../dolphinscheduler/ds_process_instance.png | Bin 0 -> 441663 bytes
.../dolphinscheduler/ds_process_success.png | Bin 0 -> 329715 bytes
.../dolphinscheduler/ds_schedule_process.png | Bin 0 -> 201143 bytes
.../dolphinscheduler/ds_schedule_success.png | Bin 0 -> 411088 bytes
.../pulsar_mysql/dolphinscheduler/ds_security.png | Bin 0 -> 299803 bytes
.../pulsar_mysql/dolphinscheduler/ds_task_conf.png | Bin 0 -> 66695 bytes
.../dolphinscheduler/ds_token_copy.png | Bin 0 -> 133945 bytes
.../dolphinscheduler/ds_token_generate.png | Bin 0 -> 99869 bytes
.../dolphinscheduler/ds_token_manager.png | Bin 0 -> 262622 bytes
.../dolphinscheduler/inlong_manager_conf.png | Bin 0 -> 83005 bytes
.../pulsar_mysql/dolphinscheduler/mysql_result.png | Bin 0 -> 33012 bytes
.../img/pulsar_mysql/{ => quartz}/approve.png | Bin
.../img/pulsar_mysql/{ => quartz}/cluster_tag.png | Bin
.../{ => quartz}/create_offline_group.png | Bin
.../pulsar_mysql/{ => quartz}/cron_schedule.png | Bin
.../pulsar_mysql/{ => quartz}/flink_batch_job.png | Bin
.../img/pulsar_mysql/{ => quartz}/group.png | Bin
.../img/pulsar_mysql/{ => quartz}/mysql_sink.png | Bin
.../pulsar_mysql/{ => quartz}/normal_schedule.png | Bin
.../img/pulsar_mysql/{ => quartz}/pulsar.png | Bin
.../pulsar_mysql/quartz/schedule_engine_type.png | Bin 0 -> 29861 bytes
.../img/pulsar_mysql/{ => quartz}/sink.png | Bin
.../img/pulsar_mysql/{ => quartz}/sink_field.png | Bin
.../img/pulsar_mysql/{ => quartz}/source.png | Bin
.../img/pulsar_mysql/{ => quartz}/source_field.png | Bin
.../{pulsar_mysql_example.md => quartz_example.md} | 62 +++++++------
53 files changed, 253 insertions(+), 44 deletions(-)
diff --git a/docs/quick_start/offline_data_sync/dolphinscheduler_example.md
b/docs/quick_start/offline_data_sync/dolphinscheduler_example.md
new file mode 100644
index 00000000000..fc50ab1c90a
--- /dev/null
+++ b/docs/quick_start/offline_data_sync/dolphinscheduler_example.md
@@ -0,0 +1,97 @@
+---
+title: Use DolphinScheduler third-party scheduling engine
+sidebar_position: 2
+---
+
+In the following content, we will introduce how to use DolphinScheduler, a
third-party schedule engine in Apache InLong to create offline data
synchronization.
+
+## Deployment
+
+### Install InLong
+
+Before we begin, we need to install InLong and a usable DolphinScheduler. Here
we provide two ways:
+
+- [Docker Deployment](deployment/docker.md) (Recommended)
+- [Bare Metal Deployment](deployment/bare_metal.md)
+
+### Add Connectors
+
+Download the [connectors](https://inlong.apache.org/downloads/) corresponding
to Flink version, and after decompression, place
`sort-connector-jdbc-[version]-SNAPSHOT.jar` in `/inlong-sort/connectors/`
directory.
+
+> Currently, Apache InLong's offline data synchronization capability only
supports Flink-1.18, so please download the 1.18 version of connectors.
+
+### Operations on DolphinScheduler
+
+Before using DolphinScheduler as your scheduling engine, please make sure you
have a working DolphinScheduler on hand. If you need to deploy a
DolphinScheduler for yourself, please refer to the [DolphinScheduler Official
Document](https://dolphinscheduler.apache.org/zh-cn).
+
+
+
+
+
+Go into Token Manager page to create a token for InLong to access.
+
+
+
+Set parameters for the token according to the steps in the figure, include
[Expiration Time], [User], then generate a token.
+
+
+
+### Modify configuration in InLong Manager
+
+For third-party scheduling engine, we need to modify configurations in manager.
+
+For DolphinScheduler engine there are following configurations need to be
modified:
+
+* `schedule.engine.inlong.manager.url` : Third-party scheduling engine needs
to access the inlong manager through this url.
+* `schedule.engine.dolphinscheduler.url` : DolphinScheduler deployment url,
general format is http://{ip}:{port}/dolphinscheduler
+* `schedule.engine.dolphinscheduler.token` : Token you just generated in Token
Manager of DolphinScheduler.
+
+
+
+After doing this, restart the InLong Manager to ensure the configuration is
enabled.
+
+### Use DolphinScheduler in offline synchronization
+
+During configure the offline synchronization task, choose DolphinScheduler
when selecting the scheduling engine, then configure other parameters.
+
+
+
+For details about how to manage clusters and configure data nodes, see [Use
Quartz built-in scheduling engine](quartz_example.md).
+
+After approval data flow, return to the [Synchronization] page and wait for
the task configuration to succeed. Once configured successfully, the
DolphinScheduler will periodically calls back InLong to synchronize offline
data and the Manager will periodically submit Flink Batch Jobs to the Flink
cluster.
+
+
+
+
+
+
+
+View the DolphinScheduler task instance logs. The following logs indicate that
the configuration is successful.
+
+
+
+## Test Data
+
+### Sending Data
+
+Use the Pulsar SDK to produce data into the Pulsar topic. An example is as
follows:
+
+```java
+ // Create Pulsar client and producer
+ PulsarClient pulsarClient =
PulsarClient.builder().serviceUrl("pulsar://localhost:6650").build();
+ Producer<byte[]> producer =
pulsarClient.newProducer().topic("public/default/test").create();
+
+ // Send messages
+ for (int i = 0; i < 10000; i++) {
+ // Field separator is |
+ String msgStr = i + "|msg-" + i;
+ MessageId msgId =
producer.send(msgStr.getBytes(StandardCharsets.UTF_8));
+ System.out.println("Send msg : " + msgStr + " with msgId: " +
msgId);
+ }
+```
+
+### Data Validation
+
+Then enter MySQL to check the data in the table:
+
+
diff --git
a/docs/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/ds_process_instance.png
b/docs/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/ds_process_instance.png
new file mode 100644
index 00000000000..6ee975a10cc
Binary files /dev/null and
b/docs/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/ds_process_instance.png
differ
diff --git
a/docs/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/ds_process_success.png
b/docs/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/ds_process_success.png
new file mode 100644
index 00000000000..96f94260931
Binary files /dev/null and
b/docs/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/ds_process_success.png
differ
diff --git
a/docs/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/ds_schedule_process.png
b/docs/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/ds_schedule_process.png
new file mode 100644
index 00000000000..e3e9373de41
Binary files /dev/null and
b/docs/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/ds_schedule_process.png
differ
diff --git
a/docs/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/ds_schedule_success.png
b/docs/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/ds_schedule_success.png
new file mode 100644
index 00000000000..45e988de576
Binary files /dev/null and
b/docs/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/ds_schedule_success.png
differ
diff --git
a/docs/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/ds_security.png
b/docs/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/ds_security.png
new file mode 100644
index 00000000000..1e4f1ffaa1b
Binary files /dev/null and
b/docs/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/ds_security.png
differ
diff --git
a/docs/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/ds_task_conf.png
b/docs/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/ds_task_conf.png
new file mode 100644
index 00000000000..c3d1c8c986d
Binary files /dev/null and
b/docs/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/ds_task_conf.png
differ
diff --git
a/docs/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/ds_token_copy.png
b/docs/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/ds_token_copy.png
new file mode 100644
index 00000000000..23df7cf825e
Binary files /dev/null and
b/docs/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/ds_token_copy.png
differ
diff --git
a/docs/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/ds_token_generate.png
b/docs/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/ds_token_generate.png
new file mode 100644
index 00000000000..9f8f5ee70cd
Binary files /dev/null and
b/docs/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/ds_token_generate.png
differ
diff --git
a/docs/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/ds_token_manager.png
b/docs/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/ds_token_manager.png
new file mode 100644
index 00000000000..2fb39dfeba2
Binary files /dev/null and
b/docs/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/ds_token_manager.png
differ
diff --git
a/docs/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/inlong_manager_conf.png
b/docs/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/inlong_manager_conf.png
new file mode 100644
index 00000000000..d093f3a2159
Binary files /dev/null and
b/docs/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/inlong_manager_conf.png
differ
diff --git
a/docs/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/mysql_result.png
b/docs/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/mysql_result.png
new file mode 100644
index 00000000000..8b7d2df5ae0
Binary files /dev/null and
b/docs/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/mysql_result.png
differ
diff --git a/docs/quick_start/offline_data_sync/img/pulsar_mysql/approve.png
b/docs/quick_start/offline_data_sync/img/pulsar_mysql/quartz/approve.png
similarity index 100%
rename from docs/quick_start/offline_data_sync/img/pulsar_mysql/approve.png
rename to docs/quick_start/offline_data_sync/img/pulsar_mysql/quartz/approve.png
diff --git
a/docs/quick_start/offline_data_sync/img/pulsar_mysql/cluster_tag.png
b/docs/quick_start/offline_data_sync/img/pulsar_mysql/quartz/cluster_tag.png
similarity index 100%
rename from docs/quick_start/offline_data_sync/img/pulsar_mysql/cluster_tag.png
rename to
docs/quick_start/offline_data_sync/img/pulsar_mysql/quartz/cluster_tag.png
diff --git
a/docs/quick_start/offline_data_sync/img/pulsar_mysql/conventional_schedule.png
b/docs/quick_start/offline_data_sync/img/pulsar_mysql/quartz/conventional_schedule.png
similarity index 100%
rename from
docs/quick_start/offline_data_sync/img/pulsar_mysql/conventional_schedule.png
rename to
docs/quick_start/offline_data_sync/img/pulsar_mysql/quartz/conventional_schedule.png
diff --git
a/docs/quick_start/offline_data_sync/img/pulsar_mysql/create_offline_group.png
b/docs/quick_start/offline_data_sync/img/pulsar_mysql/quartz/create_offline_group.png
similarity index 100%
rename from
docs/quick_start/offline_data_sync/img/pulsar_mysql/create_offline_group.png
rename to
docs/quick_start/offline_data_sync/img/pulsar_mysql/quartz/create_offline_group.png
diff --git
a/docs/quick_start/offline_data_sync/img/pulsar_mysql/create_pulsar_cluster.png
b/docs/quick_start/offline_data_sync/img/pulsar_mysql/quartz/create_pulsar_cluster.png
similarity index 100%
rename from
docs/quick_start/offline_data_sync/img/pulsar_mysql/create_pulsar_cluster.png
rename to
docs/quick_start/offline_data_sync/img/pulsar_mysql/quartz/create_pulsar_cluster.png
diff --git
a/docs/quick_start/offline_data_sync/img/pulsar_mysql/cron_schedule.png
b/docs/quick_start/offline_data_sync/img/pulsar_mysql/quartz/cron_schedule.png
similarity index 100%
rename from
docs/quick_start/offline_data_sync/img/pulsar_mysql/cron_schedule.png
rename to
docs/quick_start/offline_data_sync/img/pulsar_mysql/quartz/cron_schedule.png
diff --git
a/docs/quick_start/offline_data_sync/img/pulsar_mysql/flink_batch_job.png
b/docs/quick_start/offline_data_sync/img/pulsar_mysql/quartz/flink_batch_job.png
similarity index 100%
rename from
docs/quick_start/offline_data_sync/img/pulsar_mysql/flink_batch_job.png
rename to
docs/quick_start/offline_data_sync/img/pulsar_mysql/quartz/flink_batch_job.png
diff --git a/docs/quick_start/offline_data_sync/img/pulsar_mysql/mysql_sink.png
b/docs/quick_start/offline_data_sync/img/pulsar_mysql/quartz/mysql_sink.png
similarity index 100%
rename from docs/quick_start/offline_data_sync/img/pulsar_mysql/mysql_sink.png
rename to
docs/quick_start/offline_data_sync/img/pulsar_mysql/quartz/mysql_sink.png
diff --git
a/docs/quick_start/offline_data_sync/img/pulsar_mysql/quartz/schedule_engine_type.png
b/docs/quick_start/offline_data_sync/img/pulsar_mysql/quartz/schedule_engine_type.png
new file mode 100644
index 00000000000..166f695aa04
Binary files /dev/null and
b/docs/quick_start/offline_data_sync/img/pulsar_mysql/quartz/schedule_engine_type.png
differ
diff --git a/docs/quick_start/offline_data_sync/img/pulsar_mysql/sink.png
b/docs/quick_start/offline_data_sync/img/pulsar_mysql/quartz/sink.png
similarity index 100%
rename from docs/quick_start/offline_data_sync/img/pulsar_mysql/sink.png
rename to docs/quick_start/offline_data_sync/img/pulsar_mysql/quartz/sink.png
diff --git
a/docs/quick_start/offline_data_sync/img/pulsar_mysql/sink_fields.png
b/docs/quick_start/offline_data_sync/img/pulsar_mysql/quartz/sink_fields.png
similarity index 100%
rename from docs/quick_start/offline_data_sync/img/pulsar_mysql/sink_fields.png
rename to
docs/quick_start/offline_data_sync/img/pulsar_mysql/quartz/sink_fields.png
diff --git a/docs/quick_start/offline_data_sync/img/pulsar_mysql/source.png
b/docs/quick_start/offline_data_sync/img/pulsar_mysql/quartz/source.png
similarity index 100%
rename from docs/quick_start/offline_data_sync/img/pulsar_mysql/source.png
rename to docs/quick_start/offline_data_sync/img/pulsar_mysql/quartz/source.png
diff --git
a/docs/quick_start/offline_data_sync/img/pulsar_mysql/source_fields.png
b/docs/quick_start/offline_data_sync/img/pulsar_mysql/quartz/source_fields.png
similarity index 100%
rename from
docs/quick_start/offline_data_sync/img/pulsar_mysql/source_fields.png
rename to
docs/quick_start/offline_data_sync/img/pulsar_mysql/quartz/source_fields.png
diff --git a/docs/quick_start/offline_data_sync/pulsar_mysql_example.md
b/docs/quick_start/offline_data_sync/quartz_example.md
similarity index 71%
rename from docs/quick_start/offline_data_sync/pulsar_mysql_example.md
rename to docs/quick_start/offline_data_sync/quartz_example.md
index 8d45de66dc7..503d5cf2a86 100644
--- a/docs/quick_start/offline_data_sync/pulsar_mysql_example.md
+++ b/docs/quick_start/offline_data_sync/quartz_example.md
@@ -1,9 +1,9 @@
---
-title: Pulsar to MySQL Example
+title: Use Quartz built-in scheduling engine
sidebar_position: 1
---
-In the following content, we will introduce how to use Apache InLong to create
offline data synchronization from Pulsar to MySQL through a complete example.
+In the following content, we will introduce how to use built-in schedule
engine in Apache InLong to create offline data synchronization from Pulsar to
MySQL through a complete example.
## Deployment
### Install InLong
@@ -18,7 +18,7 @@ Download the
[connectors](https://inlong.apache.org/downloads/) corresponding to
> Currently, Apache InLong's offline data synchronization capability only
> supports Flink-1.18, so please download the 1.18 version of connectors.
## Cluster Initialize
-When all containers are successfully started, you can access the InLong
dashboard address http://localhost, and use the following default account to
log in.
+When all containers are successfully started, you can access the InLong
dashboard address `http://localhost`, and use the following default account to
log in.
```
User: admin
Password: inlong
@@ -27,13 +27,13 @@ Password: inlong
### Create Cluster Tag
Click [Clusters] -> [ClusterTags] -> [Create] on the page to specify the
cluster label name and person in charge.
-
+
**caution: `default_cluster` is the default ClusterTags for each component. If
you decide to use a different name, make sure to update the corresponding tag
configuration accordingly.**
### Register Pulsar Cluster
-
+
**You can refer to the screenshot information to fill in details such as
cluster name, associated tag, and Pulsar cluster address.**
@@ -42,10 +42,18 @@ Click [Clusters] -> [ClusterTags] -> [Create] on the page
to specify the cluster
Click on [Synchronization]→[Create], fill in the Group ID, and ensure the
[Sync Type] is checked as "Offline".
-
+
### Configuration Scheduling Rules
-After selecting "offline" for [Sync Type], you can configure the [Scheduling
Rules] for offline tasks. Currently, two types are supported: Conventional and
Crontab.
+After selecting "offline" for [Sync Type], you can configure the [Scheduling
Rules] for offline tasks. Scheduling Rules include two parts: [Scheduling
Engine] and [Scheduling Type].
+
+#### Scheduling Engine
+Apache InLong provide several scheduling engines for users to choose from,
Quartz is a build-in schedule engine in Apache InLong. Here we use quartz to
handle tasks.
+
+
+
+#### Schedule Type
+Apache InLong supports two scheduling types currently: Conventional and
Crontab.
Conventional Scheduling Configuration requires the following parameters:
- Scheduling Unit: Supports minutes, hours, days, months, years, and single
execution (single execution means it will run only once).
@@ -53,18 +61,18 @@ Conventional Scheduling Configuration requires the
following parameters:
- Delay Time: Indicates the delay time for task startup.
- Valid Time: Includes start time and end time; the scheduled task will only
execute within this time range.
-
+
Crontab Scheduling requires the following parameters:
- Valid Time: Includes start time and end time; the scheduled task will only
execute within this time range.
-- Crontab Expression: Indicates the task cycle, e.g., `0 */5 * * * ?`
+- Crontab Expression: Indicates the task cycle, e.g. `0 */5 * * * ?`
-
+
### Create Data Source
In the data source section, click [Create] → [Pulsar], and configure the data
source name, Pulsar tenant, namespace, topic, admin URL, service URL, data
format, and other parameters.
-
+
Note: The Pulsar topic needs to be created in the Pulsar cluster in advance
(or enable the automatic topic creation feature in the Pulsar cluster).
@@ -82,25 +90,25 @@ CREATE TABLE sink_table (
In the data sink section, click [Create] → [MySQL], and configure the data
sink name, database name, and table name (test.sink_table), among other
information.
-
+
### Configure source and sink fields
Configure schema mapping information in the [Source fields] and [Sink fields]
sections, and click [Submit] for approval.
-
+
-
+
### Approval data flow
On the page, click [Approval] -> [My Approvals] -> [Approve] → [OK].
-
+
Return to the [Synchronization] page and wait for the task configuration to
succeed. Once configured successfully, the Manager will periodically submit
Flink Batch Jobs to the Flink cluster.
-
+
## Test Data
### Sending Data
@@ -124,4 +132,4 @@ Use the Pulsar SDK to produce data into the Pulsar topic.
An example is as follo
Then enter MySQL to check the data in the table:
-
+
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/dolphinscheduler_example.md
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/dolphinscheduler_example.md
new file mode 100644
index 00000000000..37a6afac039
--- /dev/null
+++
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/dolphinscheduler_example.md
@@ -0,0 +1,96 @@
+---
+title: 使用第三方 DolphinScheduler 调度引擎
+sidebar_position: 2
+---
+
+在接下来的内容中，我们将介绍如何在 Apache InLong 中集成第三方调度引擎 DolphinScheduler 来创建离线数据同步。
+
+## 环境部署
+
+### 安装 InLong
+
+在开始之前，我们需要安装 InLong 的全部组件，这里提供两种方式：
+
+- [Docker 部署](deployment/docker.md)（推荐）
+- [Bare Metal 部署](deployment/bare_metal.md)
+
+### 添加 Connectors
+
+下载与 Flink 版本对应的 [connectors](https://inlong.apache.org/zh-CN/downloads)，解压后将
`sort-connector-jdbc-[version]-SNAPSHOT.jar` 放在 `/inlong-sort/connectors/` 目录下。
+> 当前 Apache InLong 的离线数据同步能力只支持 Flink-1.18 版本，所以请下载 1.18 版本的 connectors。
+
+### 在 DolphinScheduler 上的操作
+
+在使用 DolphinScheduler 作为调度引擎之前，请确保有可以提供服务的 DolphinScheduler 。如果您需要为自己部署一个
DolphinScheduler，请参考 [DolphinScheduler
官方文档](https://dolphinscheduler.apache.org/zh-cn)。
+
+
+
+
+
+进入令牌管理器页面创建一个令牌供 InLong 进行访问。
+
+
+
+按照图中步骤设置 token 参数，包括 [过期时间]、[用户]，并生成令牌。
+
+
+
+### 修改 InLong Manager 中的配置
+
+对于第三方调度引擎，我们需要在 InLong Manager 中修改配置。
+
+对于 DolphinScheduler 引擎，需要修改以下配置：
+
+* `schedule.engine.inlong.manager.url` : 第三方调度引擎需要通过该 url 访问 InLong Manager。
+* `schedule.engine.dolphinscheduler.url` : DolphinScheduler 部署的 url，一般格式为
http://{ip}:{port}/dolphinScheduler
+* `schedule.engine.dolphinscheduler.token` : 上文中在 DolphinScheduler 令牌管理器页面中生成的
Token。
+
+
+
+完成这些操作后，重新启动 InLong Manager 以确保配置成功启用。
+
+### 在离线同步任务中使用 DolphinScheduler
+
+在配置离线同步任务时，在选择调度引擎时选择 DolphinScheduler，然后配置其他参数。
+
+
+
+集群管理和相关数据节点的配置请参见[使用内置的 Quartz 调度引擎](quartz_example.md)。
+
+审批数据流后，返回【数据同步】页面，等待任务配置成功，配置成功后，DolphinScheduler 将定期回调 InLong Manager，并由
InLong Manager 周期提交 Flink Batch Job 到 Flink 集群。
+
+
+
+
+
+
+
+查看 DolphinScheduler 任务实例日志，输出如下日志表示配置成功。
+
+
+
+## 测试数据
+
+### 发送数据
+
+通过 Pulsar SDK 生产数据写入的 Pulsar topic 中，示例如下：
+
+```java
+ // Create Pulsar client and producer
+ PulsarClient pulsarClient =
PulsarClient.builder().serviceUrl("pulsar://localhost:6650").build();
+ Producer<byte[]> producer =
pulsarClient.newProducer().topic("public/default/test").create();
+
+ // Send messages
+ for (int i = 0; i < 10000; i++) {
+ // Field separator is |
+ String msgStr = i + "|msg-" + i;
+ MessageId msgId =
producer.send(msgStr.getBytes(StandardCharsets.UTF_8));
+ System.out.println("Send msg : " + msgStr + " with msgId: " +
msgId);
+ }
+```
+
+### 数据验证
+
+然后进入 Mysql，查看库表数据，可以看到数据已经同步到 MySQL 中。
+
+
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/ds_process_instance.png
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/ds_process_instance.png
new file mode 100644
index 00000000000..edb8ae40b86
Binary files /dev/null and
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/ds_process_instance.png
differ
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/ds_process_success.png
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/ds_process_success.png
new file mode 100644
index 00000000000..28669626692
Binary files /dev/null and
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/ds_process_success.png
differ
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/ds_schedule_process.png
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/ds_schedule_process.png
new file mode 100644
index 00000000000..d7dca8a3d65
Binary files /dev/null and
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/ds_schedule_process.png
differ
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/ds_schedule_success.png
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/ds_schedule_success.png
new file mode 100644
index 00000000000..7d76dcec12a
Binary files /dev/null and
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/ds_schedule_success.png
differ
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/ds_security.png
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/ds_security.png
new file mode 100644
index 00000000000..c2d5f74e455
Binary files /dev/null and
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/ds_security.png
differ
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/ds_task_conf.png
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/ds_task_conf.png
new file mode 100644
index 00000000000..d23b5fbf80e
Binary files /dev/null and
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/ds_task_conf.png
differ
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/ds_token_copy.png
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/ds_token_copy.png
new file mode 100644
index 00000000000..2ee6d74690c
Binary files /dev/null and
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/ds_token_copy.png
differ
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/ds_token_generate.png
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/ds_token_generate.png
new file mode 100644
index 00000000000..71daff12a92
Binary files /dev/null and
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/ds_token_generate.png
differ
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/ds_token_manager.png
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/ds_token_manager.png
new file mode 100644
index 00000000000..9f603392212
Binary files /dev/null and
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/ds_token_manager.png
differ
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/inlong_manager_conf.png
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/inlong_manager_conf.png
new file mode 100644
index 00000000000..d093f3a2159
Binary files /dev/null and
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/inlong_manager_conf.png
differ
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/mysql_result.png
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/mysql_result.png
new file mode 100644
index 00000000000..8b7d2df5ae0
Binary files /dev/null and
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/dolphinscheduler/mysql_result.png
differ
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/approve.png
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/quartz/approve.png
similarity index 100%
rename from
i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/approve.png
rename to
i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/quartz/approve.png
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/cluster_tag.png
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/quartz/cluster_tag.png
similarity index 100%
rename from
i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/cluster_tag.png
rename to
i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/quartz/cluster_tag.png
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/create_offline_group.png
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/quartz/create_offline_group.png
similarity index 100%
rename from
i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/create_offline_group.png
rename to
i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/quartz/create_offline_group.png
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/cron_schedule.png
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/quartz/cron_schedule.png
similarity index 100%
rename from
i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/cron_schedule.png
rename to
i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/quartz/cron_schedule.png
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/flink_batch_job.png
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/quartz/flink_batch_job.png
similarity index 100%
rename from
i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/flink_batch_job.png
rename to
i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/quartz/flink_batch_job.png
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/group.png
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/quartz/group.png
similarity index 100%
rename from
i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/group.png
rename to
i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/quartz/group.png
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/mysql_sink.png
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/quartz/mysql_sink.png
similarity index 100%
rename from
i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/mysql_sink.png
rename to
i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/quartz/mysql_sink.png
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/normal_schedule.png
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/quartz/normal_schedule.png
similarity index 100%
rename from
i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/normal_schedule.png
rename to
i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/quartz/normal_schedule.png
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/pulsar.png
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/quartz/pulsar.png
similarity index 100%
rename from
i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/pulsar.png
rename to
i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/quartz/pulsar.png
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/quartz/schedule_engine_type.png
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/quartz/schedule_engine_type.png
new file mode 100644
index 00000000000..ebbcbd6bc38
Binary files /dev/null and
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/quartz/schedule_engine_type.png
differ
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/sink.png
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/quartz/sink.png
similarity index 100%
rename from
i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/sink.png
rename to
i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/quartz/sink.png
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/sink_field.png
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/quartz/sink_field.png
similarity index 100%
rename from
i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/sink_field.png
rename to
i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/quartz/sink_field.png
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/source.png
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/quartz/source.png
similarity index 100%
rename from
i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/source.png
rename to
i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/quartz/source.png
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/source_field.png
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/quartz/source_field.png
similarity index 100%
rename from
i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/source_field.png
rename to
i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/img/pulsar_mysql/quartz/source_field.png
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/pulsar_mysql_example.md
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/quartz_example.md
similarity index 63%
rename from
i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/pulsar_mysql_example.md
rename to
i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/quartz_example.md
index b7932a2f723..937e2531184 100644
---
a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/pulsar_mysql_example.md
+++
b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.0/quick_start/offline_data_sync/quartz_example.md
@@ -1,9 +1,9 @@
---
-title: Pulsar 到 MySQL 示例
+title: 使用内置的 Quartz 调度引擎
sidebar_position: 1
---
-在下面的内容中，我们将通过一个完整的示例介绍如何使用 Apache InLong 创建 Pulsar -> MySQL 的离线数据同步。
+在下面的内容中，我们将通过一个完整的示例介绍如何使用 Apache InLong 内置的调度引擎创建 Pulsar -> MySQL 的离线数据同步。
## 环境部署
### 安装 InLong
@@ -18,21 +18,21 @@ sidebar_position: 1
> 当前 Apache InLong 的离线数据同步能力只支持 Flink-1.18 版本，所以请下载 1.18 版本的 connectors。
## 集群初始化
-InLong 服务启动后，可以访问 InLong Dashboard 地址 http://localhost，并使用以下默认账号登录:
+InLong 服务启动后，可以访问 InLong Dashboard 地址 `http://localhost`，并使用以下默认账号登录:
```
User: admin
Password: inlong
```
### 创建集群标签
-页面点击 【集群管理】→【标签管理】→【新建】
+页面点击 【集群管理】→【标签管理】→【新建】。
-
+
**注意：default_cluster 是各个组件默认的集群标签，如果使用其它名称，确认对应标签配置已修改。**
### 注册 Pulsar 集群
-
+
**可以参考截图信息填写，包括集群名称、所属标签、Pulsar 集群地址等。**
@@ -40,30 +40,38 @@ Password: inlong
### 新建数据流组
页面点击【数据同步】→【新建数据同步】，填写 数据流组 ID，注意同步类型勾选为“离线”。
-
+
### 配置调度规则
-在同步类型勾选为“离线”之后，就可以配置离线任务的调度规则，目前支持两种：常规和 crontab。
+在同步类型勾选为“离线”之后，就可以配置离线任务的调度规则，调度规则主要由两个部分组成，分别为【调度引擎】和【调度类型】。
-常规调度配置需要设置以下参数：
-- 调度单位：支持分钟、小时、天、月、年以及单次，单次表示只执行一次
-- 调度周期：表示两次任务调度之间的时间间隔
-- 延迟时间：表示任务启动的延迟时间
-- 有效时间：包括起始时间和结束时间，调度任务只会在这个时间范围内执行
+#### 调度引擎
+Apache InLong 提供了多种调度引擎供用户选择，Quartz 是 Apache InLong 内置的调度引擎，这里使用 Quartz 来处理任务。
-
+
-crontab调度需要设置以下参数：
-- 有效时间：包括起始时间和结束时间，调度任务只会在这个时间范围内执行
-- crontab 表达式：表示任务的周期，比如 0 */5 * * * ?
+#### 调度类型
+ Apache InLong 目前支持两种调度类型：常规和 crontab。
-
+常规调度类型配置需要设置以下参数：
+- 调度单位：支持分钟、小时、天、月、年以及单次，单次表示只执行一次。
+- 调度周期：表示两次任务调度之间的时间间隔。
+- 延迟时间：表示任务启动的延迟时间。
+- 有效时间：包括起始时间和结束时间，调度任务只会在这个时间范围内执行。
+
+
+
+crontab 调度类型需要设置以下参数：
+- 有效时间：包括起始时间和结束时间，调度任务只会在这个时间范围内执行。
+- crontab 表达式：表示任务的周期，比如 `0 */5 * * * ?`。
+
+
### 新建数据源
数据来源中 点击 【新建】→【Pulsar】，配置数据源名称、Pulsar tenant、namespace、topic、admin url、service
url、数据格式等参数。
-
+
注：Pulsar 的 topic 需要预先在 Pulsar 集群创建（或者在 Pulsar 集群开启自动创建 topic 功能）。
@@ -80,25 +88,25 @@ CREATE TABLE sink_table (
数据目标中 点击 【新建】→【MySQL】，配置数据目标名称、库名和表名（test.sink_table）等信息。
-
+
### 配置字段信息
-分别在 【源字段】 和 【目标字段】中配置 Schema 映射信息，完成后点击 【提交审批】
+分别在 【源字段】 和 【目标字段】中配置 Schema 映射信息，完成后点击 【提交审批】。
-
+
-
+
### 审批数据流
-页面点击【审批管理】->【我的审批】->【详情】->【通过】
+页面点击【审批管理】->【我的审批】->【详情】->【通过】。
-
+
返回 【数据同步】页面，等待任务配置成功，配置成功后，Manager 会周期提交 Flink Batch Job 到 Flink 集群。
-
+
## 测试数据
### 发送数据
@@ -122,4 +130,4 @@ CREATE TABLE sink_table (
然后进入 Mysql，查看库表数据，可以看到数据已经同步到 MySQL 中。
-
+
