This is an automated email from the ASF dual-hosted git repository.
wusheng pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/skywalking-website.git
The following commit(s) were added to refs/heads/master by this push:
new 9e27a14a8bd Add blog:RocketMQ monitoring by skywalking (#683)
9e27a14a8bd is described below
commit 9e27a14a8bd54d148adfd8c0a1a4c8160cde75a7
Author: peachisai <[email protected]>
AuthorDate: Fri Mar 1 16:50:12 2024 +0800
Add blog:RocketMQ monitoring by skywalking (#683)
---
.../broker-dashboard.png | Bin 0 -> 133295 bytes
.../cluster-dashboard-1.png | Bin 0 -> 149269 bytes
.../cluster-dashboard-2.png | Bin 0 -> 141767 bytes
.../dataflow.png | Bin 0 -> 24916 bytes
.../index.md | 138 +++++++++++++++++++++
.../service-hierarchy-1.png | Bin 0 -> 15175 bytes
.../service-hierarchy-2.png | Bin 0 -> 52169 bytes
.../tip.png | Bin 0 -> 18264 bytes
.../topic-dashboard-1.png | Bin 0 -> 140224 bytes
.../topic-dashboard-2.png | Bin 0 -> 161497 bytes
10 files changed, 138 insertions(+)
diff --git
a/content/zh/2024-02-29-rocketmq-monitoring-by-skywalking/broker-dashboard.png
b/content/zh/2024-02-29-rocketmq-monitoring-by-skywalking/broker-dashboard.png
new file mode 100644
index 00000000000..2c8c00062be
Binary files /dev/null and
b/content/zh/2024-02-29-rocketmq-monitoring-by-skywalking/broker-dashboard.png
differ
diff --git
a/content/zh/2024-02-29-rocketmq-monitoring-by-skywalking/cluster-dashboard-1.png
b/content/zh/2024-02-29-rocketmq-monitoring-by-skywalking/cluster-dashboard-1.png
new file mode 100644
index 00000000000..3149735f532
Binary files /dev/null and
b/content/zh/2024-02-29-rocketmq-monitoring-by-skywalking/cluster-dashboard-1.png
differ
diff --git
a/content/zh/2024-02-29-rocketmq-monitoring-by-skywalking/cluster-dashboard-2.png
b/content/zh/2024-02-29-rocketmq-monitoring-by-skywalking/cluster-dashboard-2.png
new file mode 100644
index 00000000000..7e39f6ecb47
Binary files /dev/null and
b/content/zh/2024-02-29-rocketmq-monitoring-by-skywalking/cluster-dashboard-2.png
differ
diff --git
a/content/zh/2024-02-29-rocketmq-monitoring-by-skywalking/dataflow.png
b/content/zh/2024-02-29-rocketmq-monitoring-by-skywalking/dataflow.png
new file mode 100644
index 00000000000..3de8b0fb34a
Binary files /dev/null and
b/content/zh/2024-02-29-rocketmq-monitoring-by-skywalking/dataflow.png differ
diff --git a/content/zh/2024-02-29-rocketmq-monitoring-by-skywalking/index.md
b/content/zh/2024-02-29-rocketmq-monitoring-by-skywalking/index.md
new file mode 100644
index 00000000000..f41f92302e0
--- /dev/null
+++ b/content/zh/2024-02-29-rocketmq-monitoring-by-skywalking/index.md
@@ -0,0 +1,138 @@
+---
+title: "使用 SkyWalking 监控 RocketMQ Server"
+author: "邵一鸣"
+date: 2024-02-29
+description: "SkyWalking 10.0 引入了新的 RocketMQ 监控面板,本文将演示该监控面板的使用。"
+tags:
+- RocketMQ
+---
+
+# 背景介绍
+Apache RocketMQ 是一个开源的低延迟、高并发、高可用、高可靠的分布式消息中间件, 从SkyWalking OAP 10.0 版本开始, 新增了
对 RocketMQ Server的监控面板。本文将展示并介绍如何使用 Skywalking来监控RocketMQ
+
+# 部署
+
+## 流程
+通过`RocketMQ`官方提供的`RocketMQ exporter`来采集`RocketMQ
Server`数据,再通过`opentelmetry-collector`来拉取`RocketMQ exporter`并传输到`skywalking
oap`服务来处理
+
+DataFlow:
+
+
+## 准备
+
+1. [Skywalking oap服务,v10.0 +](https://github.com/apache/skywalking)
+2. [RocketMQ v4.3.2 +](https://github.com/apache/rocketmq)
+3. [RocketMQ exporter v0.0.2+](https://github.com/apache/rocketmq-exporter)
+4. [Opentelmetry-collector
v0.87+](https://github.com/open-telemetry/opentelemetry-collector-contrib)
+
+## 启动顺序
+1. 启动 `RocketMQ namesrv` 和 `broker`
+2. 启动 `skywalking oap` 和 `ui`
+3. 启动 `RocketMQ exporter`
+4. 启动 `opentelmetry-collector`
+
+具体如何启动和配置请参考以上链接中官方教程.
+
+需要注意下的是 `opentelmetry-collector` 的配置文件.
+
+`job_name: "rocketmq-monitoring"` 请不要修改,否则 skywalking 不会处理这部分数据.
+
+`rocketmq-exporter` 替换成RocketMQ exporter 的地址.
+
+`replacement: rocketmq-cluster`
中的`rocketmq-cluster`如果想要使用下文介绍的服务分层功能,请自行定义为其他服务层级相匹配的名称.
+
+`oap` 为 `skywalking oap` 地址,请自行替换.
+
+```
+receivers:
+ prometheus:
+ config:
+ scrape_configs:
+ - job_name: "rocketmq-monitoring"
+ scrape_interval: 30s
+ static_configs:
+ - targets: ['rocketmq-exporter:5557']
+ relabel_configs:
+ - source_labels: [ ]
+ target_label: cluster
+ replacement: rocketmq-cluster
+
+exporters:
+ otlp:
+ endpoint: oap:11800
+ tls:
+ insecure: true
+
+processors:
+ batch:
+service:
+ pipelines:
+ metrics:
+ receivers:
+ - prometheus
+ processors:
+ - batch
+ exporters:
+ - otlp
+
+```
+
+
+# 监控指标
+指标分为 三个维度, cluster,broker,topic
+## cluster监控
+
+
+
+cluster 主要是站在集群的角度来统计展示,比如
+
+`Messages Produced Today` 今日集群产生的消息数
+
+`Max CommitLog Disk Ratio` 展示集群中磁盘使用率最高的broker
+
+`Total Producer Tps` 集群生产者tps
+
+
+## broker 监控
+
+
+broker 主要是站在节点的角度来统计展示,比如
+
+`Produce Tps` 节点生产者tps
+
+`Producer Message Size(MB)`节点生产消息大小
+
+## topic 监控
+
+
+
+topic 主要是站在主题的角度来统计展示,比如
+
+`Consumer Group Count` 消费该主题的消费者组个数
+
+`Consumer Latency(s)` 消费者组的消费延时时间
+
+`Backlogged Messages `消费者组消费消息堆积
+
+注意:topic 维度是整个 topic 来聚合,并不是在一个 broker 上的 topic 聚合,在 dashboard 上你也可以看到 broker
跟 topic 是平级的。
+
+
+各个指标的含义可以在图标的 tip 上找到解释
+
+
+
+更多指标可以参考[文档](https://skywalking.apache.org/docs/main/next/en/setup/backend/backend-rocketmq-monitoring/#rocketmq-monitoring)
+
+
+demo 已经在 [skywalking
showcase](http://demo.skywalking.apache.org/dashboard/ROCKETMQ/Service/cm9ja2V0bXE6OnJvY2tldG1xLnNreXdhbGtpbmctc2hvd2Nhc2U=.1/RocketMQ-Cluster)
上线,可以在上面看到展示效果
+
+# 服务分层
+skywalking 10 新增了重要功能`Service Hierarchy`,接收来自不同层级的服务数据,比如 java agent 上报,k8s
监控数据或者 otel 的监控数据. 根据设置规则如果发现这些服务名称符合匹配规则,则可以将这些不同层级的服务联系起来。
+
+如下图所示：
+
+skywalking 采集部署在 k8s 的 RocketMQ 服务端的k8s 数据,并接收来自 otel 的 RocketMQ
服务端监控数据,根据匹配规则这些服务具有相同的服务名称,则可以在 ui 上观察到它们的联系
+
+
+
+
diff --git
a/content/zh/2024-02-29-rocketmq-monitoring-by-skywalking/service-hierarchy-1.png
b/content/zh/2024-02-29-rocketmq-monitoring-by-skywalking/service-hierarchy-1.png
new file mode 100644
index 00000000000..5a35acd96c3
Binary files /dev/null and
b/content/zh/2024-02-29-rocketmq-monitoring-by-skywalking/service-hierarchy-1.png
differ
diff --git
a/content/zh/2024-02-29-rocketmq-monitoring-by-skywalking/service-hierarchy-2.png
b/content/zh/2024-02-29-rocketmq-monitoring-by-skywalking/service-hierarchy-2.png
new file mode 100644
index 00000000000..ff26b572c70
Binary files /dev/null and
b/content/zh/2024-02-29-rocketmq-monitoring-by-skywalking/service-hierarchy-2.png
differ
diff --git a/content/zh/2024-02-29-rocketmq-monitoring-by-skywalking/tip.png
b/content/zh/2024-02-29-rocketmq-monitoring-by-skywalking/tip.png
new file mode 100644
index 00000000000..cab117ed073
Binary files /dev/null and
b/content/zh/2024-02-29-rocketmq-monitoring-by-skywalking/tip.png differ
diff --git
a/content/zh/2024-02-29-rocketmq-monitoring-by-skywalking/topic-dashboard-1.png
b/content/zh/2024-02-29-rocketmq-monitoring-by-skywalking/topic-dashboard-1.png
new file mode 100644
index 00000000000..cb49d51e7b2
Binary files /dev/null and
b/content/zh/2024-02-29-rocketmq-monitoring-by-skywalking/topic-dashboard-1.png
differ
diff --git
a/content/zh/2024-02-29-rocketmq-monitoring-by-skywalking/topic-dashboard-2.png
b/content/zh/2024-02-29-rocketmq-monitoring-by-skywalking/topic-dashboard-2.png
new file mode 100644
index 00000000000..34b93079add
Binary files /dev/null and
b/content/zh/2024-02-29-rocketmq-monitoring-by-skywalking/topic-dashboard-2.png
differ
