This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/dolphinscheduler-website.git
The following commit(s) were added to refs/heads/asf-site by this push:
new e249848949 Automated deployment:
ab53994053261a99e7d6aacee296c36c07254683
e249848949 is described below
commit e2498489490757e299d8f224956244665d450212
Author: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
AuthorDate: Fri Jan 12 02:45:51 2024 +0000
Automated deployment: ab53994053261a99e7d6aacee296c36c07254683
---
data/blog/zh-cn.json | 6 ++++++
fetch/blog/zh-cn.json | 8 ++++++++
img/2024-01-11/1.png | Bin 0 -> 118358 bytes
img/2024-01-11/10.png | Bin 0 -> 155181 bytes
img/2024-01-11/2.png | Bin 0 -> 414395 bytes
img/2024-01-11/3.png | Bin 0 -> 413461 bytes
img/2024-01-11/4.png | Bin 0 -> 336138 bytes
img/2024-01-11/5.png | Bin 0 -> 350915 bytes
img/2024-01-11/6.png | Bin 0 -> 155500 bytes
img/2024-01-11/7.png | Bin 0 -> 269889 bytes
img/2024-01-11/8.png | Bin 0 -> 343359 bytes
img/2024-01-11/9.png | Bin 0 -> 118469 bytes
...t_platform_practice_based_on_DolphinScheduler.json" | 8 ++++++++
python/2.0.5/.buildinfo | 2 +-
python/2.0.6/.buildinfo | 2 +-
python/2.0.7/.buildinfo | 2 +-
python/3.0.0/.buildinfo | 2 +-
python/3.0.1/.buildinfo | 2 +-
python/3.1.0/.buildinfo | 2 +-
python/4.0.0/.buildinfo | 2 +-
python/4.0.1/.buildinfo | 2 +-
python/4.0.2/.buildinfo | 2 +-
python/4.0.3/.buildinfo | 2 +-
python/4.0.4/.buildinfo | 2 +-
python/main/.buildinfo | 2 +-
25 files changed, 34 insertions(+), 12 deletions(-)
diff --git a/data/blog/zh-cn.json b/data/blog/zh-cn.json
index 4d33622f40..1d3cefa27e 100644
--- a/data/blog/zh-cn.json
+++ b/data/blog/zh-cn.json
@@ -293,6 +293,12 @@
"title": " 珍岛集团基于 Apache DolphinScheduler 打造智能营销云平台",
"time": "2023-10-24"
},
+ {
+ "name":
"Zuoyebang’s_data_development_platform_practice_based_on_DolphinScheduler",
+ "content": "1.
背景\n首先介绍下我们的大数据平台架构：\n\n数据计算层承接了全公司的数据开发需求，负责运行各类指标计算任务。\n其中批计算任务运行在 UDA
数据开发平台，支持任务全链路的开发场景：开发、调试、环境隔离、运维、监控。这些功能的支持、任务的稳定运行，强依赖底层的调度系统。\n原有调度系统是 2015
年 (抑或更早) 自研的，随着任务类型新增、任务数量增多，暴露出诸多问题：\n\n\n稳定性：频繁出现 mysql
连接不释放、锁超时等问题；数据库压力进一步导致调度性能瓶颈，任务无法及时调度。\n可维护性：核心调度器通过 php
开发，代码古老又经历多次交接，外围模块实现时采用了 go java python
多种语言；再加上功能上也存在单点，维护成本很高。\n扩展性：业务高速发展，不同任务类型需求越来越多，但是调度作为底层服
务在支撑上一直力不从心。\n可观测性：由于是定时nohup启动任务进程的方式，经常出现任务跑飞了的情况，系统暴露出来的可观测指标几乎为
0。\n\n对调度系统的核心诉求，我觉得分为功能和系统两部分：\n\n功能 [...]
+ "title": "作业帮基于 DolphinScheduler 的数据开发平台实践",
+ "time": "2024-01-11"
+ },
{
"name": "dolphinscheduler_json",
"content": "dolphinscheduler json拆解\n1、为什么拆解json\n在dolphinscheduler
1.3.x及以前的工作流中的任务及任务关系保存时是以大json的方式保存到数据库中process_definiton表的process_definition_json字段，如果某个工作流很大比如有100或者1000个任务，这个json字段也就非常大，在使用时需要解析json，非常耗费性能，且任务没法重用；基于大json，在工作流版本及任务版本上也没有好的实现方案，否则会导致数据大量冗余。\n故社区计划启动json拆解项目，实现的需求目标：\n\n大json完全拆分\n新增工作流及任务版本\n引入全局唯一键(code)\n\n2、如何设计拆解后的表\n1、1.3.6版本工作流\n1、比如在当前1.3.6版本创建个a-->b的工作流\n\n以下是processDefiniton
save 接口在controller入口打印的入参日志\ncreate process definition, project name: hado
[...]
diff --git a/fetch/blog/zh-cn.json b/fetch/blog/zh-cn.json
index e1262f22ad..a755c8c74e 100644
--- a/fetch/blog/zh-cn.json
+++ b/fetch/blog/zh-cn.json
@@ -236,6 +236,14 @@
"type": "user",
"label": "用户案例",
"children": [
+ {
+ "name":
"Zuoyebang’s_data_development_platform_practice_based_on_DolphinScheduler",
+ "title": "作业帮基于 DolphinScheduler 的数据开发平台实践",
+ "author": "Niko Zeng",
+ "dateStr": "2024-01-11",
+ "desc": "随着任务数量、任务类型需求不断增长，对作业帮的数据开发平台提出了更高的要求。本文主要分享作业帮将调度引擎升级到
Apache DolphinScheduler 的实践经验，以及对数据开发平台的一些思考。",
+ "img": "/img/2024-01-11/1.png"
+ },
{
"name":
"Master_Quartz_Time_Management_and_Task_Scheduling_Expert_in_Java",
"title": "精通Quartz：Java中的时间管理与任务调度专家",
diff --git a/img/2024-01-11/1.png b/img/2024-01-11/1.png
new file mode 100644
index 0000000000..a59d6fc9ee
Binary files /dev/null and b/img/2024-01-11/1.png differ
diff --git a/img/2024-01-11/10.png b/img/2024-01-11/10.png
new file mode 100644
index 0000000000..debe4340db
Binary files /dev/null and b/img/2024-01-11/10.png differ
diff --git a/img/2024-01-11/2.png b/img/2024-01-11/2.png
new file mode 100644
index 0000000000..6853b450f1
Binary files /dev/null and b/img/2024-01-11/2.png differ
diff --git a/img/2024-01-11/3.png b/img/2024-01-11/3.png
new file mode 100644
index 0000000000..97ef4d8af3
Binary files /dev/null and b/img/2024-01-11/3.png differ
diff --git a/img/2024-01-11/4.png b/img/2024-01-11/4.png
new file mode 100644
index 0000000000..4b936185d6
Binary files /dev/null and b/img/2024-01-11/4.png differ
diff --git a/img/2024-01-11/5.png b/img/2024-01-11/5.png
new file mode 100644
index 0000000000..fd2a43fa37
Binary files /dev/null and b/img/2024-01-11/5.png differ
diff --git a/img/2024-01-11/6.png b/img/2024-01-11/6.png
new file mode 100644
index 0000000000..5b704982e7
Binary files /dev/null and b/img/2024-01-11/6.png differ
diff --git a/img/2024-01-11/7.png b/img/2024-01-11/7.png
new file mode 100644
index 0000000000..7690f196e2
Binary files /dev/null and b/img/2024-01-11/7.png differ
diff --git a/img/2024-01-11/8.png b/img/2024-01-11/8.png
new file mode 100644
index 0000000000..49cfaa01f9
Binary files /dev/null and b/img/2024-01-11/8.png differ
diff --git a/img/2024-01-11/9.png b/img/2024-01-11/9.png
new file mode 100644
index 0000000000..c72211bd13
Binary files /dev/null and b/img/2024-01-11/9.png differ
diff --git
"a/pages/blog/zh-cn/Zuoyebang\342\200\231s_data_development_platform_practice_based_on_DolphinScheduler.json"
"b/pages/blog/zh-cn/Zuoyebang\342\200\231s_data_development_platform_practice_based_on_DolphinScheduler.json"
new file mode 100644
index 0000000000..5bc7580551
--- /dev/null
+++
"b/pages/blog/zh-cn/Zuoyebang\342\200\231s_data_development_platform_practice_based_on_DolphinScheduler.json"
@@ -0,0 +1,8 @@
+{
+ "__html": "<h1>1. 背景</h1>\n<p>首先介绍下我们的大数据平台架构：</p>\n<p><img
src=\"/img/2024-01-11/1.png\"
alt=\"\"></p>\n<p>数据计算层承接了全公司的数据开发需求，负责运行各类指标计算任务。</p>\n<p>其中批计算任务运行在 UDA
数据开发平台，支持任务全链路的开发场景：开发、调试、环境隔离、运维、监控。这些功能的支持、任务的稳定运行，强依赖底层的调度系统。</p>\n<p>原有调度系统是
2015 年 (抑或更早) 自研的，随着任务类型新增、任务数量增多，暴露出诸多问题：</p>\n<p><img
src=\"/img/2024-01-11/2.png\" alt=\"\"></p>\n<ol>\n<li>稳定性：频繁出现 mysql
连接不释放、锁超时等问题；数据库压力进一步导致调度性能瓶颈，任务无法及时调度。</li>\n<li>可维护性：核心调度器通过 php
开发，代码古老又经历多次交接，外围模块实现时采用了 go java python 多种语言；再�
�上功能上 [...]
+ "time": "2024-01-11",
+ "author": "Niko Zeng",
+ "title": "作业帮基于 DolphinScheduler 的数据开发平台实践",
+ "type": "user",
+ "label": "用户案例"
+}
\ No newline at end of file
diff --git a/python/2.0.5/.buildinfo b/python/2.0.5/.buildinfo
index d8169fae07..ccb386c983 100644
--- a/python/2.0.5/.buildinfo
+++ b/python/2.0.5/.buildinfo
@@ -1,4 +1,4 @@
# Sphinx build info version 1
# This file hashes the configuration used when building these files. When it
is not found, a full rebuild will be done.
-config: 9630f2a26dd90d40390122ee3ae4592b
+config: e227a5dfa34a4f5922889eb76b3cf9f4
tags: 645f666f9bcd5a90fca523b33c5a78b7
diff --git a/python/2.0.6/.buildinfo b/python/2.0.6/.buildinfo
index 33aa9fd5b7..c3419c1258 100644
--- a/python/2.0.6/.buildinfo
+++ b/python/2.0.6/.buildinfo
@@ -1,4 +1,4 @@
# Sphinx build info version 1
# This file hashes the configuration used when building these files. When it
is not found, a full rebuild will be done.
-config: 4ed12006b6c4359521b95832e0d8e2ea
+config: 3d775beab27fcce6e27c60761302d415
tags: 645f666f9bcd5a90fca523b33c5a78b7
diff --git a/python/2.0.7/.buildinfo b/python/2.0.7/.buildinfo
index 2ec6598e8d..6028fabe89 100644
--- a/python/2.0.7/.buildinfo
+++ b/python/2.0.7/.buildinfo
@@ -1,4 +1,4 @@
# Sphinx build info version 1
# This file hashes the configuration used when building these files. When it
is not found, a full rebuild will be done.
-config: 426a7373d68045ea82a35a86d1bd012d
+config: 1bb311682cc1b3d16b64735b1f57301f
tags: 645f666f9bcd5a90fca523b33c5a78b7
diff --git a/python/3.0.0/.buildinfo b/python/3.0.0/.buildinfo
index 13aff59433..67cea90980 100644
--- a/python/3.0.0/.buildinfo
+++ b/python/3.0.0/.buildinfo
@@ -1,4 +1,4 @@
# Sphinx build info version 1
# This file hashes the configuration used when building these files. When it
is not found, a full rebuild will be done.
-config: 92e9221d7f758cf7d3a9567ab359219c
+config: cf207831ecd2070755c6dfe1bbeaca76
tags: 645f666f9bcd5a90fca523b33c5a78b7
diff --git a/python/3.0.1/.buildinfo b/python/3.0.1/.buildinfo
index 40902f18a7..2c5174ca94 100644
--- a/python/3.0.1/.buildinfo
+++ b/python/3.0.1/.buildinfo
@@ -1,4 +1,4 @@
# Sphinx build info version 1
# This file hashes the configuration used when building these files. When it
is not found, a full rebuild will be done.
-config: 7e16a38acfd47ee0cca3189d1c5acb4b
+config: b3a698177d014ed51ebf4413ea1d05f5
tags: 645f666f9bcd5a90fca523b33c5a78b7
diff --git a/python/3.1.0/.buildinfo b/python/3.1.0/.buildinfo
index d6e8acba29..363d2ecd7f 100644
--- a/python/3.1.0/.buildinfo
+++ b/python/3.1.0/.buildinfo
@@ -1,4 +1,4 @@
# Sphinx build info version 1
# This file hashes the configuration used when building these files. When it
is not found, a full rebuild will be done.
-config: af8b02521bd1e052dc75ca76d9d4dab5
+config: 7810630abd3adeec2ad459d593f6726e
tags: 645f666f9bcd5a90fca523b33c5a78b7
diff --git a/python/4.0.0/.buildinfo b/python/4.0.0/.buildinfo
index a1f5c7697a..d51695424f 100644
--- a/python/4.0.0/.buildinfo
+++ b/python/4.0.0/.buildinfo
@@ -1,4 +1,4 @@
# Sphinx build info version 1
# This file hashes the configuration used when building these files. When it
is not found, a full rebuild will be done.
-config: dc34aba591fd27a9e63d8081da599e8a
+config: 3f998ca4cee6a8e4a4a56e5d450cd776
tags: 645f666f9bcd5a90fca523b33c5a78b7
diff --git a/python/4.0.1/.buildinfo b/python/4.0.1/.buildinfo
index a061db6b06..9ae2691b99 100644
--- a/python/4.0.1/.buildinfo
+++ b/python/4.0.1/.buildinfo
@@ -1,4 +1,4 @@
# Sphinx build info version 1
# This file hashes the configuration used when building these files. When it
is not found, a full rebuild will be done.
-config: 48b98c902875b7bb0cac6727cd46906d
+config: 9c3e81f4054e2e72f015166c9340f946
tags: 645f666f9bcd5a90fca523b33c5a78b7
diff --git a/python/4.0.2/.buildinfo b/python/4.0.2/.buildinfo
index 48a0032974..2feba00446 100644
--- a/python/4.0.2/.buildinfo
+++ b/python/4.0.2/.buildinfo
@@ -1,4 +1,4 @@
# Sphinx build info version 1
# This file hashes the configuration used when building these files. When it
is not found, a full rebuild will be done.
-config: baaa923474e38b3f1e89c1ad1cd0e949
+config: 459551621a88c0572ae39ff69a215047
tags: 645f666f9bcd5a90fca523b33c5a78b7
diff --git a/python/4.0.3/.buildinfo b/python/4.0.3/.buildinfo
index 846d7b5523..c45b9f00a8 100644
--- a/python/4.0.3/.buildinfo
+++ b/python/4.0.3/.buildinfo
@@ -1,4 +1,4 @@
# Sphinx build info version 1
# This file hashes the configuration used when building these files. When it
is not found, a full rebuild will be done.
-config: 1120f0b1bd0e5e7feed6cf7e672525b4
+config: fbd0048ebb31adf752507fe740d68eb3
tags: 645f666f9bcd5a90fca523b33c5a78b7
diff --git a/python/4.0.4/.buildinfo b/python/4.0.4/.buildinfo
index 7e285fd3c8..e5985a6d28 100644
--- a/python/4.0.4/.buildinfo
+++ b/python/4.0.4/.buildinfo
@@ -1,4 +1,4 @@
# Sphinx build info version 1
# This file hashes the configuration used when building these files. When it
is not found, a full rebuild will be done.
-config: 075cd802410925bec8a48c127917b476
+config: 9af46e2f951cd35fee58cd2e94df7968
tags: 645f666f9bcd5a90fca523b33c5a78b7
diff --git a/python/main/.buildinfo b/python/main/.buildinfo
index b0be18049d..8f15e21d61 100644
--- a/python/main/.buildinfo
+++ b/python/main/.buildinfo
@@ -1,4 +1,4 @@
# Sphinx build info version 1
# This file hashes the configuration used when building these files. When it
is not found, a full rebuild will be done.
-config: 459103c72fb5b99309daf753a6d2bd77
+config: b2f8b3f2f393c772a3d95702fbf5a844
tags: 645f666f9bcd5a90fca523b33c5a78b7
