This is an automated email from the ASF dual-hosted git repository.
dockerzhang pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/inlong-website.git
The following commit(s) were added to refs/heads/master by this push:
new a1a515ba79 [INLONG-590][Release] Add blog for the 1.4.0 release (#611)
a1a515ba79 is described below
commit a1a515ba79b7a4874cb319ac93733256e0ef6a1e
Author: Charles Zhang <[email protected]>
AuthorDate: Mon Nov 21 17:32:29 2022 +0800
[INLONG-590][Release] Add blog for the 1.4.0 release (#611)
---
blog/2021-11-10-release-0.11.0.md | 2 +-
blog/2022-01-04-release-0.12.0.md | 2 +-
blog/2022-04-25-release-1.1.0.md | 2 +-
blog/2022-06-22-release-1.2.0.md | 2 +-
blog/2022-09-05-release-1.3.0.md | 2 +-
blog/2022-11-16-release-1.4.0.md | 78 ++++++++++++++++++++++
.../2022-11-16-release-1.4.0.md | 76 +++++++++++++++++++++
7 files changed, 159 insertions(+), 5 deletions(-)
diff --git a/blog/2021-11-10-release-0.11.0.md
b/blog/2021-11-10-release-0.11.0.md
index 6d03f81145..cacb47b24f 100644
--- a/blog/2021-11-10-release-0.11.0.md
+++ b/blog/2021-11-10-release-0.11.0.md
@@ -1,5 +1,5 @@
---
-title: Release InLong 0.11.0
+title: Release 0.11.0
author: dockerzhang
author_url: https://github.com/dockerzhang
author_image_url: https://avatars.githubusercontent.com/u/18047329?v=4
diff --git a/blog/2022-01-04-release-0.12.0.md
b/blog/2022-01-04-release-0.12.0.md
index 44f3a5870b..3da1e38fb1 100644
--- a/blog/2022-01-04-release-0.12.0.md
+++ b/blog/2022-01-04-release-0.12.0.md
@@ -1,5 +1,5 @@
---
-title: Release InLong 0.12.0
+title: Release 0.12.0
author: gosonzhang
author_url: https://github.com/gosonzhang
author_image_url: https://avatars.githubusercontent.com/u/14038849?v=4
diff --git a/blog/2022-04-25-release-1.1.0.md b/blog/2022-04-25-release-1.1.0.md
index 9cf7d32e05..ea2669c505 100644
--- a/blog/2022-04-25-release-1.1.0.md
+++ b/blog/2022-04-25-release-1.1.0.md
@@ -1,5 +1,5 @@
---
-title: Release InLong 1.1.0
+title: Release 1.1.0
author: dockerzhang
author_url: https://github.com/dockerzhang
author_image_url: https://avatars.githubusercontent.com/u/18047329?v=4
diff --git a/blog/2022-06-22-release-1.2.0.md b/blog/2022-06-22-release-1.2.0.md
index 69c82b0727..03d98a8cd0 100644
--- a/blog/2022-06-22-release-1.2.0.md
+++ b/blog/2022-06-22-release-1.2.0.md
@@ -1,5 +1,5 @@
---
-title: Release InLong 1.2.0
+title: Release 1.2.0
author: healchow
author_url: https://github.com/healchow
author_image_url: https://avatars.githubusercontent.com/u/31994335?v=4
diff --git a/blog/2022-09-05-release-1.3.0.md b/blog/2022-09-05-release-1.3.0.md
index 43625062e0..39d71c0485 100644
--- a/blog/2022-09-05-release-1.3.0.md
+++ b/blog/2022-09-05-release-1.3.0.md
@@ -1,5 +1,5 @@
---
-title: Release InLong 1.3.0
+title: Release 1.3.0
author: EMsnap
author_url: https://github.com/EMsnap
author_image_url: https://avatars.githubusercontent.com/u/26538404?v=4
diff --git a/blog/2022-11-16-release-1.4.0.md b/blog/2022-11-16-release-1.4.0.md
new file mode 100644
index 0000000000..9bdf3c8b4b
--- /dev/null
+++ b/blog/2022-11-16-release-1.4.0.md
@@ -0,0 +1,78 @@
+---
+title: Release 1.4.0
+author: Charles Zhang
+author_url: https://github.com/dockerzhang
+author_image_url: https://avatars.githubusercontent.com/u/18047329?v=4
+tags: [Apache InLong, Version]
+---
+
+Apache InLong is a one-stop integration framework for massive data that
provides automatic, secure and reliable data transmission capabilities.
+InLong offers great power to build data analysis, modeling and other real-time
applications based on streaming data.
+
+<!--truncate-->
+
+## 1.4.0 version overview
+Apache InLong recently released version 1.4.0, which closed about 364+ issues
with 16+ features and 120+ optimizations. It mainly completes the real-time
synchronization of the entire database to Apache Doris and the real-time
synchronization of the entire database to Apache Iceberg, the standard
architecture supports HTTP reporting, and the standard architecture adds
MongoDB and other collection nodes. This release also completes a number of
other features, including:
+
+### Agent Module
+- Refactored sink-sending metrics
+- Audit report increases data size
+- Support Redis, MQTT, SQLServer, Oracle, and MongoDB data sources
+- Enhanced Kubernetes environment file collection capability
+
+### DataProxy module
+- Heartbeat reporting adds service status and supports authentication
+- Added proxy-send mode to send data
+- Optimized data link buried point indicators
+
+### TubeMQ module
+- Added client load balancing consumer group control API
+- C++ SDK fixes multiple bugs
+
+### Manager module
+- Data stream Group and Stream support extended parameters
+- Client supports updating and deleting data flow through Key
+- Refactored the way to obtain Sort cluster configuration information
+- Optimized state management
+- Client supports cluster addition, deletion, modification, and query
+- Cluster nodes report new protocol types
+- Cache layer usage supports using Kafka
+
+### Sort module
+- Support debezium-json format
+- Kafka data nodes support topic dynamic awareness
+- Connectors such as Hive/Hbase/Iceberg support indicator status recovery
+- Elasticsearch 6/7, JDBC connector added indicator status
+- Iceberg sink supports schema revolution, can automatically build tables, and
perceive the increase of fields
+
+### Dashboard module
+- Unified data source, data flow type definition
+- Added Agent type for cluster management
+- Add data node management
+- Support selection of Kafka message type
+
+### Other
+- docker-compose deploys the built-in Flink environment
+- Fix multiple aarch64 mirror bugs
+- Fix multiple dependency security bugs
+
+## 1.4.0 version feature introduction
+### Agent adds a variety of data sources
+In version 1.4.0, Agent supports data sources such as Redis, MQTT, SQLServer,
Oracle, MongoDB, etc., so that the collection capabilities of standard
architecture and lightweight architecture are basically aligned and users have
more choices in massive scenarios. The support of this part of the back-end
capabilities is mainly completed by @iamsee123 and @haibo-duan, and the
front-end part is completed by @bluewang.
+
+### Improve component metrics
+In version 1.4.0, the Agent, DataProxy, and Sort modules all have indicators
optimized and improved, including the reconstruction of the indicators sent by
the Agent, increasing the dimension of the data Group/Stream indicators, and
fixing the inaccuracy of the Prometheus Listener indicators. Thanks to
@Keylchen, @pocozh, and others for their contributions.
+
+### Optimize Docker-compose deployment
+There are many InLong service components, and there has always been a problem
with high deployment thresholds. In version 1.4.0, the compatibility of
docker-compose deployment is optimized, and an Apache Flink environment is
built-in to help developers quickly start creating tasks. Thanks to
@dockerzhang for optimizing this part.
+
+### Optimize heartbeat management
+In version 1.4.0, a lot of optimizations have been made for the heartbeat of
service components, including adding data protocol when reporting, automatic
registration of Agent/DataProxy component reporting, adding heartbeat
management API to Manager, and optimizing multiple heartbeat status bugs.
Thanks to @gosonzhang, @GanfengTan, @pocozh, @lucaspeng12138 and @haifxu for
their contributions.
+
+### Support real-time synchronization of the entire database
+In version 1.4.0, InLong began to support real-time synchronization of the
entire database to follow up on the needs of community users. Currently, it is
the first to achieve real-time synchronization of the entire database to Doris
and real-time synchronization of the entire database to Iceberg/Kafka/Doris. In
the near future, the community will also realize the synchronization of the
entire database. Share the details. Thanks to @thesumery, @EMsnap,
@yunqingmoswu for their contributions.
+
+For more details on the 1.4.0 release, please refer to the release notes,
which detail the features, enhancements, and bug fixes for this release.
+
+### Follow-up planning
+In the next version, the community will continue to add synchronization
scenarios for the entire database, improve task indicators, increase system
stability, and conduct stress tests on standard architectures and lightweight
architectures.
\ No newline at end of file
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-blog/2022-11-16-release-1.4.0.md
b/i18n/zh-CN/docusaurus-plugin-content-blog/2022-11-16-release-1.4.0.md
new file mode 100644
index 0000000000..10cdc757d8
--- /dev/null
+++ b/i18n/zh-CN/docusaurus-plugin-content-blog/2022-11-16-release-1.4.0.md
@@ -0,0 +1,76 @@
+---
+title: 1.4.0 版本发布
+author: Charles Zhang
+author_url: https://github.com/dockerzhang
+author_image_url: https://avatars.githubusercontent.com/u/18047329?v=4
+tags: [Apache InLong, Version]
+---
+
+Apache InLong(应龙)是一个一站式海量数据集成框架,提供自动、安全、可靠和高性能的数据传输能力,方便业务构建基于流式的数据分析、建模和应用。
InLong 支持大数据领域的采集、汇聚、缓存和分拣功能,用户只需要简单的配置就可以把数据从数据源导入到实时计算引擎或者落地到离线存储。
+<!--truncate-->
+
+## 1.4.0 版本纵览
+Apache InLong 最近发布了 1.4.0 版本,该版本关闭了约 364+ 个issue,包含 16+ 个特性和 120+
个优化。主要完成了整库实时同步至 Apache Doris、整库实时同步至 Apache Iceberg、标准架构支持 HTTP 上报、标准架构新增
MongoDB 等多种采集节点。该版本还完成了大量其它特性,主要包括:
+
+### Agent 模块
+- 重构了 Sink 发送指标
+- 审计上报增加数据大小
+- 支持 Redis、MQTT、SQLServer、Oracle 、MongoDB 数据源
+- 强化 Kubernetes 环境文件采集能力
+
+### DataProxy 模块
+- 心跳上报增加服务状态、支持认证
+- 增加 proxy-send 模式发送数据
+- 优化数据链路埋点指标
+
+### TubeMQ 模块
+- 增加客户端负载均衡消费组控制 API
+- C++ SDK 修复多个 Bug
+
+### Manager 模块
+- 数据流 Group 和 Stream 支持扩展参数
+- Client 支持通过 Key 更新和删除数据流向
+- 重构获取 Sort 集群配置信息方式
+- 优化状态管理
+- Client 支持集群增删改查
+- 集群节点上报新增协议类型
+- 缓存层使用支持使用 Kafka
+
+### Sort 模块
+- 支持 debezium-json 格式
+- Kafka 数据节点支持 Topic 动态感知
+- Hive/Hbase/Iceberg 等 connector 支持指标状态恢复
+- Elasticsearch 6/7、JDBC connector 增加指标状态
+- Iceberg sink 支持 schema revolution,能够自动建表并感知字段的增加
+
+### Dashboard 模块
+- 统一数据源、数据流向类型定义
+- 集群管理新增 Agent 类型
+- 增加数据节点管理
+- 支持选择 Kafka 消息类型
+
+### 其它
+- docker-compose 部署内置 Flink 环境
+- 修复多个 aarch64 镜像 Bug
+- 修复多个依赖安全漏洞
+
+## 1.4.0 版本特性介绍
+### Agent 新增多种数据源
+在 1.4.0 版本中,Agent 支持了 Redis、MQTT、SQLServer、Oracle 、MongoDB
等数据源,使得标准架构和轻量化架构的采集能力基本对齐,用户在海量场景下也有了更多选择。这部分后端能力的支持主要由@iamsee123、@haibo-duan完成,前端部分由@bluewang完成。
+
+### 完善组件指标
+在 1.4.0 版本中,Agent、DataProxy、Sort 模块都有指标的优化和完善,包括 Agent
发送指标的重构,增加数据Group/Stream指标维度,修复 Prometheus Listener
指标不准确等多个问题。感谢@Keylchen、@pocozh等贡献。
+
+### 优化 Docker-compose 部署
+InLong 服务组件比较多,一直都有部署门槛高的问题。在 1.4.0 版本中,优化了 docker-compose 部署的兼容性,同时内置一个
Apache Flink 环境,帮助开发者快速开始创建任务。感谢@dockerzhang 针对这部分内容的优化。
+
+### 优化心跳管理
+在 1.4.0 版本中,针对服务组件的心跳继续做了大量优化,包括上报时新增数据数据协议、Agent/DataProxy 组件上报自动注册、Manager
增加心跳管理 API 、优化多个心跳状态 Bug
等。感谢@gosonzhang、@GanfengTan、@pocozh、@lucaspeng12138和@haifxu的贡献。
+
+### 支持整库实时同步能力
+在 1.4.0 版本中,InLong
开始支持整库实时同步,跟进社区用户的需求,目前率先实现了整库实时同步至Doris、整库实时同步至Iceberg,近期社区也会将整库同步实现的具体细节分享出来。感谢@thesumery、@EMsnap、@yunqingmoswu的贡献。
+
+更多 1.4.0 版本的细节请参考 版本说明 ,其中详细列出了此版本的特性、提升和 Bug 修复。
+
+### 后续规划
+在下个版本中,社区会继续增加整库同步场景、完善任务指标以及增加系统稳定性,进行标准架构和轻量化架构的压测。
\ No newline at end of file