(skywalking-website) branch master updated: blog zh: SkyWalking 10 release (#710)
This is an automated email from the ASF dual-hosted git repository. wusheng pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/skywalking-website.git The following commit(s) were added to refs/heads/master by this push: new b0f2035c1bb blog zh: SkyWalking 10 release (#710) b0f2035c1bb is described below commit b0f2035c1bbf4f93a1c89577680eef2631e4c0f4 Author: Jimmy Song AuthorDate: Wed May 15 12:07:21 2024 +0800 blog zh: SkyWalking 10 release (#710) --- .../2024-05-13-skywalking-10-release/active_mq.jpg | Bin 0 -> 136769 bytes .../clickhouse.jpg | Bin 0 -> 185890 bytes .../zh/2024-05-13-skywalking-10-release/index.md | 145 + .../k8s_dashboard.jpg | Bin 0 -> 69555 bytes .../k8s_topology.jpg | Bin 0 -> 61086 bytes .../layer_jump.jpg | Bin 0 -> 108000 bytes .../layer_jump2.jpg| Bin 0 -> 74333 bytes .../2024-05-13-skywalking-10-release/postgre.jpg | Bin 0 -> 40016 bytes .../2024-05-13-skywalking-10-release/rocket_mq.jpg | Bin 0 -> 58951 bytes .../zh/2024-05-13-skywalking-10-release/song.jpg | Bin 0 -> 90011 bytes .../song_instance.jpg | Bin 0 -> 50570 bytes 11 files changed, 145 insertions(+) diff --git a/content/zh/2024-05-13-skywalking-10-release/active_mq.jpg b/content/zh/2024-05-13-skywalking-10-release/active_mq.jpg new file mode 100644 index 000..f2594837067 Binary files /dev/null and b/content/zh/2024-05-13-skywalking-10-release/active_mq.jpg differ diff --git a/content/zh/2024-05-13-skywalking-10-release/clickhouse.jpg b/content/zh/2024-05-13-skywalking-10-release/clickhouse.jpg new file mode 100644 index 000..043d63d1159 Binary files /dev/null and b/content/zh/2024-05-13-skywalking-10-release/clickhouse.jpg differ diff --git a/content/zh/2024-05-13-skywalking-10-release/index.md b/content/zh/2024-05-13-skywalking-10-release/index.md new file mode 100644 index 000..7280dfa6895 --- /dev/null +++ b/content/zh/2024-05-13-skywalking-10-release/index.md @@ -0,0 +1,145 @@ +--- +title: "SkyWalking 10 发布:服务层次结构、基于 eBPF 的 Kubernetes 网络监控、BanyanDB 等" +description: "介绍 SkyWalking 10 的新特性,包括服务层次结构、基于 eBPF 的 Kubernetes 网络监控、BanyanDB 等。" +authors: 万凯,吴晟 +date: 2024-05-13 +tags: +- Release Blog +- Service Hierarchy +- Kubernetes +- eBPF +- BanyanDB +--- + +Apache SkyWalking 团队今天宣布发布 SkyWalking 10。SkyWalking 10 提供了一系列突破性的功能和增强功能。Layer 和 Service Hierarchy 的引入通过将服务和指标组织成不同的层次,并提供跨层无缝导航,从而简化了监控。利用 eBPF 技术,Kubernetes 网络监控提供了对网络流量、拓扑和 TCP/HTTP 指标的详细洞察。BanyanDB 作为高性能的原生存储解决方案出现,同时扩展的监控支持包括 Apache RocketMQ、ClickHouse 和 Apache ActiveMQ Classic。对多标签名称的支持增强了指标分析的灵活性,而增强的导出和查询功能简化了数据分发和处理。 + +本文简要介绍了这些新功能和增强功能以及其他一些值得注意的变化。 + +## Layer 和 Service Hierarchy + +Layer 概念是在 SkyWalking 9.0.0 中引入的,它代表计算机科学中的一个抽象框架,例如操作系统(OS_LINUX layer)、Kubernetes(k8s layer)。它根据系统中服务和指标的角色和职责将其组织到不同的层次。SkyWalking 为每个层提供了一套监控和诊断工具,但层之间存在 gap,无法轻松跨层桥接数据。 + +在 SkyWalking 10 中,SkyWalking 提供了跨层跳转/连接的新功能,为用户提供无缝的监控体验。 + +### Layer Jump + +在拓扑图中,用户可以点击服务节点跳转到另一层服务的仪表板。下图显示了通过点击拓扑节点从 GENERAL 层服务拓扑跳转到 VIRTUAL_DATABASE 服务层仪表板的过程。 + +![图 1: Layer Jump](layer_jump.jpg) + +![图 2: Layer jump Dashboard](layer_jump2.jpg) + +### Service Hierarchy + +SkyWalking 10 引入了一个新概念,称为 Service Hierarchy,它定义了各层中现有逻辑相同服务的关系。OAP 将检测不同层次的服务,并尝试建立连接。用户可以点击任何层的服务拓扑节点或服务仪表板中的 Hierarchy Services 获取 Hierarchy Topology。在此拓扑图中,用户可以看到不同层次服务之间的关系和指标摘要,并且可以跳转到该层的服务仪表板。当服务发生性能问题时,用户可以轻松分析不同层次的指标并找出根本原因: + +以下是 Service Hierarchy 关系的示例: + +1. 应用程序 `song` 同时在 Kubernetes 集群中部署了 SkyWalking agent 和 Service Mesh。因此,应用程序 `song` 跨越了 GENERAL、MESH、MESH_DP 和 K8S_SERVICE 层,SkyWalking 可以监控这些层次,Service Hierarchy 拓扑如下: + +![图 3: Service Hierarchy Agent With K8s Service And Mesh With K8s Service](song.jpg) + + 还可以有 Service Instance Hierarchy 拓扑来获取跨层的单实例状态,如下所示:![图 4: Instance Hierarchy Agent With K8s Service(Pod)](song_instance.jpg) + +2. 在 Kubernetes 集群中部署并由应用程序 `song` 使用的 PostgreSQL 数据库 `psql`。因此,数据库 `psql` 跨越 `VIRTUAL_DATABASE`、`POSTGRESQL` 和 `K8S_SERVICE` 层,SkyWalking 可以监控这些层次,Service Hierarchy 拓扑如下: + +![图 5: Service Hierarchy Agent(Virtual Database) With Real Database And K8s Service](postgre.jpg) + +有关更多支持的层次以及如何检测不同层次服务之间的关系,请参阅 [Service Hierarchy](https://skywalking.apache.org/docs/main/latest/en/concepts-and-designs/service-hierarchy/#service-hierarchy)。有关如何在 SkyWalking 中配置 Service Hierarchy,请参阅 [Service Hierarchy Configuration](https://skywalking.apache.org/docs/main/latest/en/concepts-and-designs/service-hierarchy-configuration/) 部分。 + +## 使用 eBPF 监控 Kubernetes 网络流量 + +在之前的版本中,SkyWalking 提供了 [来自 kube-state-metrics 和 cAdvisor 的 Kubernetes (K8s) 监控](https://skywalking.apache.org/docs/main/latest/en/setup/backend/backend-k8s-monitoring-metrics-cadvisor/),它可以监控 Kubernetes 集群状态和 Kubernetes 资源的指标。 + +在 SkyWalking 10 中,通过利用 [Apache SkyWalking
Re: [PR] blog zh: SkyWalking 10 release [skywalking-website]
wu-sheng merged PR #710: URL: https://github.com/apache/skywalking-website/pull/710 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@skywalking.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] Add a forceIgnoring mechanism and apply it to the plugins (Spring Clo… [skywalking-java]
wu-sheng commented on code in PR #689: URL: https://github.com/apache/skywalking-java/pull/689#discussion_r1600911559 ## apm-sniffer/apm-agent-core/src/main/java/org/apache/skywalking/apm/agent/core/context/IgnoredTracerContext.java: ## @@ -34,14 +34,21 @@ public class IgnoredTracerContext implements AbstractTracerContext { private static final NoopSpan NOOP_SPAN = new NoopSpan(); private static final String IGNORE_TRACE = "Ignored_Trace"; +private LinkedList activeSpanStack; Review Comment: This is not friendly for GC. We could add `ingored` flag to the span and skip this check. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@skywalking.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] Update Apache-2.0.yaml to add BSD-2-Clause-Views [skywalking-eyes]
wu-sheng commented on PR #183: URL: https://github.com/apache/skywalking-eyes/pull/183#issuecomment-2111533294 We are following here, https://www.apache.org/legal/resolved.html > Raise the topic on legal-discuss@ or via a JIRA issue if you have doubt over whether a work falls in the public domain. This is recommended from that page. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@skywalking.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
(skywalking-website) branch master updated: fix skywalking-10-release rocktmq figure
This is an automated email from the ASF dual-hosted git repository. wankai pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/skywalking-website.git The following commit(s) were added to refs/heads/master by this push: new 0454e149ba0 fix skywalking-10-release rocktmq figure 0454e149ba0 is described below commit 0454e149ba0fda8a638cd9eb1c14be32d2b20503 Author: Wan Kai AuthorDate: Wed May 15 11:53:58 2024 +0800 fix skywalking-10-release rocktmq figure --- content/blog/2024-05-13-skywalking-10-release/index.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/content/blog/2024-05-13-skywalking-10-release/index.md b/content/blog/2024-05-13-skywalking-10-release/index.md index c05a3c59ed2..2a62377a55d 100644 --- a/content/blog/2024-05-13-skywalking-10-release/index.md +++ b/content/blog/2024-05-13-skywalking-10-release/index.md @@ -97,7 +97,7 @@ SkyWalking provides a basic monitoring dashboard for RocketMQ, which includes th - Topic Metrics: including max producer/consumer message size, consumer latency, producer/consumer TPS, producer/consumer offset, producer/consumer message size, consumer group count, and broker count. The following figure shows the RocketMQ Cluster Metrics dashboard: -![Figure 8: Apache RocketMQ Server Monitoring](active_mq.jpg) +![Figure 8: Apache RocketMQ Server Monitoring](rocket_mq.jpg) Figure 8: Apache RocketMQ Server Monitoring For more metrics and details about the RocketMQ monitoring, please refer to the [Apache RocketMQ Server Monitoring](https://skywalking.apache.org/docs/main/latest/en/setup/backend/backend-rocketmq-monitoring/),
Re: [PR] Update Apache-2.0.yaml to add BSD-2-Clause-Views [skywalking-eyes]
spacewander commented on PR #183: URL: https://github.com/apache/skywalking-eyes/pull/183#issuecomment-2111519890 Is there someone from ASF legal team we can consult? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@skywalking.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] blog zh: SkyWalking 10 release [skywalking-website]
netlify[bot] commented on PR #710: URL: https://github.com/apache/skywalking-website/pull/710#issuecomment-2111495900 ### Deploy Preview for *skywalking-website-preview* processing. | Name | Link | |:-:|| | Latest commit | e5e41058de2bcc44cea202652f1de1a281ffbedc | | Latest deploy log | https://app.netlify.com/sites/skywalking-website-preview/deploys/664426b1eda8c80008972874 | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@skywalking.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[PR] blog zh: SkyWalking 10 release [skywalking-website]
rootsongjc opened a new pull request, #710: URL: https://github.com/apache/skywalking-website/pull/710 Add the Chinese translation blog for https://skywalking.apache.org/blog/2024-05-13-skywalking-10-release/ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@skywalking.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] [Bug] redision enhance fail and no trace log produce [skywalking]
wu-sheng closed issue #12225: [Bug] redision enhance fail and no trace log produce URL: https://github.com/apache/skywalking/issues/12225 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@skywalking.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[I] [Bug] redision enhance fail and no trace log produce [skywalking]
begrow opened a new issue, #12225: URL: https://github.com/apache/skywalking/issues/12225 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/skywalking/issues?q=is%3Aissue) and found no similar issues. ### Apache SkyWalking Component Java Agent (apache/skywalking-java) ### What happened I am using skywalking9.7.0 and agent9.2.0, but I found no trace produce for my java program which start with skywalking agent. the error log was produced in skywalking-api.log. I seems the redision enhance fail. my java project is using org.redision:3.26.0, and the redisson plugin is apm-redisson-3.x-plugin-9.2.0.jar under the director skywalking agent. `ERROR 2024-05-15 09:35:29.422 main InstMethodsInter : class[class org.redisson.connection.Single ConnectionManager] after method[createClient] intercept failure java.lang.NoSuchMethodError: 'org.redisson.config.Config org.redisson.connection.ConnectionManager.getCfg()' at org.apache.skywalking.apm.plugin.redisson.v3.ConnectionManagerInterceptor.afterMethod(ConnectionManagerInterceptor.java:49) at org.apache.skywalking.apm.agent.core.plugin.interceptor.enhance.InstMethodsInter.intercept(InstMethodsInter.java:97) at org.redisson.connection.MasterSlaveConnectionManager.createClient(MasterSlaveConnectionManager.java) at org.redisson.connection.MasterSlaveConnectionManager.$sw$original$createClient$4h97ri3(MasterSlaveConnectionManager.java:323) at org.redisson.connection.MasterSlaveConnectionManager.$sw$original$createClient$4h97ri3$accessor$$sw$t83ld71(MasterSlaveConnectionManager.java) at org.redisson.connection.MasterSlaveConnectionManager$$sw$auxiliary$fqo1r32.call(Unknown Source) at org.apache.skywalking.apm.agent.core.plugin.interceptor.enhance.InstMethodsInter.intercept(InstMethodsInter.java:86) at org.redisson.connection.MasterSlaveConnectionManager.createClient(MasterSlaveConnectionManager.java) at org.redisson.connection.MasterSlaveEntry.setupMasterEntry(MasterSlaveEntry.java:117) at org.redisson.connection.MasterSlaveConnectionManager.doConnect(MasterSlaveConnectionManager.java:223) at org.redisson.connection.MasterSlaveConnectionManager.connect(MasterSlaveConnectionManager.java:196) at org.redisson.config.ConfigSupport.createConnectionManager(ConfigSupport.java:220) at org.redisson.Redisson.(Redisson.java:71) at org.redisson.Redisson.create(Redisson.java:116) at org.redisson.spring.starter.RedissonAutoConfiguration.redisson(RedissonAutoConfiguration.java:330) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) :` ### What you expected to happen . my java project is using org.redision:3.26.0, and the redisson plugin is apm-redisson-3.x-plugin-9.2.0.jar. It seems thea are the matched version for redision lib and redision agent plugins. but why the enhance error occur? ### How to reproduce just use org.redision:3.26.0, and start with skywalking java agent ### Anything else nothing ### Are you willing to submit a pull request to fix on your own? - [ ] Yes I am willing to submit a pull request on my own! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@skywalking.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] Add a forceIgnoring mechanism and apply it to the plugins (Spring Clo… [skywalking-java]
gzlicanyi commented on code in PR #689: URL: https://github.com/apache/skywalking-java/pull/689#discussion_r1600851431 ## apm-sniffer/apm-agent-core/src/main/java/org/apache/skywalking/apm/agent/core/context/IgnoredTracerContext.java: ## @@ -34,14 +34,21 @@ public class IgnoredTracerContext implements AbstractTracerContext { private static final NoopSpan NOOP_SPAN = new NoopSpan(); private static final String IGNORE_TRACE = "Ignored_Trace"; +private LinkedList activeSpanStack; Review Comment: ![image](https://github.com/apache/skywalking-java/assets/16240434/e0cc5df8-a63c-4504-a1ea-15d54b126fcd) ![image](https://github.com/apache/skywalking-java/assets/16240434/fcc0ecbb-31da-4799-8934-9b50aa4370e8) ![image](https://github.com/apache/skywalking-java/assets/16240434/7e66c4c4-0882-4485-b4b1-1b40bb6abaf3) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@skywalking.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] Add a forceIgnoring mechanism and apply it to the plugins (Spring Clo… [skywalking-java]
gzlicanyi commented on code in PR #689: URL: https://github.com/apache/skywalking-java/pull/689#discussion_r1600849761 ## apm-sniffer/apm-agent-core/src/main/java/org/apache/skywalking/apm/agent/core/context/IgnoredTracerContext.java: ## @@ -34,14 +34,21 @@ public class IgnoredTracerContext implements AbstractTracerContext { private static final NoopSpan NOOP_SPAN = new NoopSpan(); private static final String IGNORE_TRACE = "Ignored_Trace"; +private LinkedList activeSpanStack; Review Comment: Because the old span is still in use, if it's discarded, [span#prepareForAsync](https://github.com/apache/skywalking-java/blob/1a010470076ba7f206f4fd6559d04136bea73417/apm-sniffer/optional-plugins/optional-spring-plugins/optional-spring-cloud/gateway-2.0.x-plugin/src/main/java/org/apache/skywalking/apm/plugin/spring/cloud/gateway/v20x/NettyRoutingFilterInterceptor.java#L45) will throw an error. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@skywalking.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] Add a forceIgnoring mechanism and apply it to the plugins (Spring Clo… [skywalking-java]
wu-sheng commented on code in PR #689: URL: https://github.com/apache/skywalking-java/pull/689#discussion_r1600845711 ## apm-sniffer/apm-agent-core/src/main/java/org/apache/skywalking/apm/agent/core/context/IgnoredTracerContext.java: ## @@ -34,14 +34,21 @@ public class IgnoredTracerContext implements AbstractTracerContext { private static final NoopSpan NOOP_SPAN = new NoopSpan(); private static final String IGNORE_TRACE = "Ignored_Trace"; +private LinkedList activeSpanStack; + private final CorrelationContext correlationContext; private final ExtensionContext extensionContext; private final ProfileStatusContext profileStatusContext; -private int stackDepth; - public IgnoredTracerContext() { -this.stackDepth = 0; +this.activeSpanStack = new LinkedList<>(); +this.correlationContext = new CorrelationContext(); +this.extensionContext = new ExtensionContext(); +this.profileStatusContext = ProfileStatusContext.createWithNone(); +} + +public IgnoredTracerContext(LinkedList activeSpanStack) { +this.activeSpanStack = activeSpanStack; Review Comment: We only need the depth to be initialized based on stack depth, rather than holding all ## apm-sniffer/apm-agent-core/src/main/java/org/apache/skywalking/apm/agent/core/context/IgnoredTracerContext.java: ## @@ -84,34 +91,35 @@ public int getSpanId() { @Override public AbstractSpan createEntrySpan(String operationName) { -stackDepth++; +activeSpanStack.addLast(NOOP_SPAN); Review Comment: We just need depth, no further. ## apm-sniffer/apm-agent-core/src/main/java/org/apache/skywalking/apm/agent/core/context/IgnoredTracerContext.java: ## @@ -34,14 +34,21 @@ public class IgnoredTracerContext implements AbstractTracerContext { private static final NoopSpan NOOP_SPAN = new NoopSpan(); private static final String IGNORE_TRACE = "Ignored_Trace"; +private LinkedList activeSpanStack; Review Comment: Why need this? ## apm-sniffer/apm-agent-core/src/main/java/org/apache/skywalking/apm/agent/core/context/IgnoredTracerContext.java: ## @@ -34,14 +34,21 @@ public class IgnoredTracerContext implements AbstractTracerContext { private static final NoopSpan NOOP_SPAN = new NoopSpan(); private static final String IGNORE_TRACE = "Ignored_Trace"; +private LinkedList activeSpanStack; + private final CorrelationContext correlationContext; private final ExtensionContext extensionContext; private final ProfileStatusContext profileStatusContext; -private int stackDepth; - public IgnoredTracerContext() { -this.stackDepth = 0; +this.activeSpanStack = new LinkedList<>(); +this.correlationContext = new CorrelationContext(); +this.extensionContext = new ExtensionContext(); +this.profileStatusContext = ProfileStatusContext.createWithNone(); Review Comment: You just need to call new constructor. ## apm-sniffer/apm-agent-core/src/main/java/org/apache/skywalking/apm/agent/core/context/IgnoredTracerContext.java: ## @@ -84,34 +91,35 @@ public int getSpanId() { @Override public AbstractSpan createEntrySpan(String operationName) { -stackDepth++; +activeSpanStack.addLast(NOOP_SPAN); Review Comment: All logic here should not be changed. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@skywalking.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
(skywalking-website) branch master updated: Add CN online session s01e02 (#709)
This is an automated email from the ASF dual-hosted git repository. wusheng pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/skywalking-website.git The following commit(s) were added to refs/heads/master by this push: new 136a730af7b Add CN online session s01e02 (#709) 136a730af7b is described below commit 136a730af7b71f0246626aa67f0714b471e0f7af Author: weixiang1862 <652048...@qq.com> AuthorDate: Tue May 14 23:39:05 2024 +0800 Add CN online session s01e02 (#709) Co-authored-by: weixiang --- .../index.md | 132 + .../log-dashboard.jpg | Bin 0 -> 169847 bytes .../log-metrics-alerting.jpg | Bin 0 -> 41988 bytes .../log-metrics.jpg| Bin 0 -> 136861 bytes 4 files changed, 132 insertions(+) diff --git a/content/zh/2024-05-09-skywalking-in-practice-s01e02/index.md b/content/zh/2024-05-09-skywalking-in-practice-s01e02/index.md new file mode 100644 index 000..b540cd2790f --- /dev/null +++ b/content/zh/2024-05-09-skywalking-in-practice-s01e02/index.md @@ -0,0 +1,132 @@ +--- +title: "SkyWalking从入门到精通 - 2024系列线上分享活动(第二讲)" +date: 2024-05-09 +author: 魏翔 +description: SkyWalking LAL(Log Analysis Language) 语法介绍、日志分析 demo 实操,以及 log-analyzer 模块源码讲解 +--- + +本次直播是 Apache SkyWalking 社区和纵目联合举办分享活动的第二讲,由魏翔为大家介绍 SkyWalking LAL(Log Analysis Language),主要包含以下几部分内容: + +- SkyWalking LAL(Log Analysis Language) 语法介绍 +- 使用 LAL 监控服务日志异常实验 +- OAP log-analyzer 模块源码讲解 + +[B站视频地址](https://www.bilibili.com/video/BV1Ti421C7b6) + +实验中涉及到的知识点比较零散,为了方便大家复现实验结果,现将实验步骤整理如下: + +# 1. 接入服务日志至SkyWalking +首先,我们启动 demo 服务,并通过一个定时任务模拟异常,并输出异常至日志中,下面的方法会每秒钟执行一次,因为除数为零,所以会产生 `java.lang.ArithmeticException: / by zero` 的异常: +```java +@Scheduled(fixedDelay = 1000) +public void mockException() throws Exception { +int i = 1 / 0; +} +``` +```text +2024-04-22 23:03:54 SW_CTX:[gateway,3a96549cb6474607be27e3ce481c2629@198.18.0.1,N/A,N/A,-1] [scheduling-1] ERROR [org.springframework.scheduling.support.TaskUtils$LoggingErrorHandler:95] - Unexpected error occurred in scheduled task +java.lang.ArithmeticException: / by zero + at com.test.ConsumerApplication.mockException(ConsumerApplication.java:47) + at sun.reflect.GeneratedMethodAccessor195.invoke(Unknown Source) + at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) + at java.lang.reflect.Method.invoke(Method.java:498) + at org.springframework.scheduling.support.ScheduledMethodRunnable.$sw$original$run$c8tpsq2(ScheduledMethodRunnable.java:84) + at org.springframework.scheduling.support.ScheduledMethodRunnable.$sw$original$run$c8tpsq2$accessor$$sw$p2boiv3(ScheduledMethodRunnable.java) + at org.springframework.scheduling.support.ScheduledMethodRunnable$$sw$auxiliary$k466ps2.call(Unknown Source) + at org.apache.skywalking.apm.agent.core.plugin.interceptor.enhance.InstMethodsInter.intercept(InstMethodsInter.java:86) + at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java) +``` +接着,我们为该服务启动参数添加 skywalking agent 启动参数,并接入日志至 skywalking,由于我们demo使用的是logback,我们在 pom.xml 中添加以下依赖: +``` + +org.apache.skywalking +apm-toolkit-logback-1.x +${version} + +``` +同时,在logback.xml中添加 skywalking-grpc appender: +``` + + + +%d{-MM-dd HH:mm:ss.SSS} [%X{tid}] [%thread] %-5level %logger{36} -%msg%n + + + +``` +启动 SkyWalking OAP 服务,一切顺利的话,你会在 SkyWalking 日志面板中看到 demo 服务上报的日志信息: + +![log-dashboard](./log-dashboard.jpg) + +# 2. 配置 LAL 解析上报的日志并提取指标 +默认情况下,SkyWalking只会保存原始的日志数据,不做任何的处理分析,我们修改 `config/lal/default.xml`: +```yaml +rules: + - name: default +layer: GENERAL +dsl: | + filter { +text { + abortOnFailure false + regexp $/(?\d{4}-\d{2}-\d{2} \d{2}:\d{2}:\d{2}\.\d{3}) \[.+] \[.+] (?\w+) (?.*)/$ +} + +extractor { + tag level: parsed.level + timestamp parsed.time as String, "-MM-dd HH:mm:ss.SSS" + + if (parsed.level == "ERROR") { +metrics { + timestamp log.timestamp as Long + labels service: log.service, service_instance_id: log.serviceInstance + name "log_exception_count" + value 1 +} + } +} + +sink { +} + } +``` +上面的 dsl 中,首先使用 text regex 解析器解析日志内容,分别解析出了日志的时间、日志等级等信息,大家可以根据需要自行调整 regexp 表达式(如果你的日志是json格式,你也可以尝试[json 解析器](https://skywalking.apache.org/docs/main/next/en/concepts-and-designs/lal/#json) )。 + +接着 extractor 会从 regexp 解析结果中,提取出日志额外的 tag 以及 timestamp 信息,并且会检查 level,如果 level 级别为 ERROR,就会生成一个名为`log_exception_count`,值为 1 的指标,在打上 service 及 service_instance_id 标签后,会交给 skywalking meter system 接着处理。 + +# 3. 定义 log-mal 进一步分析 LAL 中提取的指标 +上一步中,我们定义了日志的解析规则,并成功提取到了 `log_exception_count` 指标,接着我们定义指标分析规则,创建
Re: [PR] Add CN online session s01e02 [skywalking-website]
wu-sheng merged PR #709: URL: https://github.com/apache/skywalking-website/pull/709 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@skywalking.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] Update Apache-2.0.yaml to add BSD-2-Clause-Views [skywalking-eyes]
wu-sheng commented on PR #183: URL: https://github.com/apache/skywalking-eyes/pull/183#issuecomment-2110439806 I can see from the description, this may be fine. But I am not from legal part. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@skywalking.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] Update Apache-2.0.yaml to add BSD-2-Clause-Views [skywalking-eyes]
wu-sheng commented on PR #183: URL: https://github.com/apache/skywalking-eyes/pull/183#issuecomment-2110437781 I think whether this is compatible with APLv2, it should be determined by ASF legal team. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@skywalking.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[PR] Update Apache-2.0.yaml to add BSD-2-Clause-Views [skywalking-eyes]
spacewander opened a new pull request, #183: URL: https://github.com/apache/skywalking-eyes/pull/183 According to the https://spdx.org/licenses/BSD-2-Clause-Views.html, the license is 'identical to BSD-2-Clause with the addition of the "views and conclusions" sentence at the end' -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@skywalking.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] Add CN online session s01e02 [skywalking-website]
netlify[bot] commented on PR #709: URL: https://github.com/apache/skywalking-website/pull/709#issuecomment-2110369036 ### Deploy Preview for *skywalking-website-preview* processing. | Name | Link | |:-:|| | Latest commit | b6d026469813400e57e3201b6b3a726072ce8843 | | Latest deploy log | https://app.netlify.com/sites/skywalking-website-preview/deploys/664372adf947a7000813b96b | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@skywalking.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[PR] Add CN online session s01e02 [skywalking-website]
weixiang1862 opened a new pull request, #709: URL: https://github.com/apache/skywalking-website/pull/709 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@skywalking.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
(skywalking-java) branch main updated: Fix method name missing in spring-plugins:scheduled-annotation-plugin with spring 6.1.x (#691)
This is an automated email from the ASF dual-hosted git repository. wusheng pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/skywalking-java.git The following commit(s) were added to refs/heads/main by this push: new 4dfc1e85b5 Fix method name missing in spring-plugins:scheduled-annotation-plugin with spring 6.1.x (#691) 4dfc1e85b5 is described below commit 4dfc1e85b56e75a1bf2bae11d34d8c0fe234bed0 Author: Chen Ziyan AuthorDate: Tue May 14 20:21:27 2024 +0800 Fix method name missing in spring-plugins:scheduled-annotation-plugin with spring 6.1.x (#691) --- .github/workflows/plugins-jdk17-test.1.yaml| 1 + .github/workflows/plugins-test.3.yaml | 2 +- CHANGES.md | 1 + .../ScheduledMethodInterceptorInstrumentation.java | 13 +++ .../service-agent/java-agent/Supported-list.md | 2 +- .../client/java/controller/MessageService.java | 43 +++--- .../config/expectedData.yaml | 10 ++--- .../configuration.yml | 4 +- .../pom.xml| 8 ++-- .../scheduled/controller/CaseController.java | 0 .../spring/scheduled/job/SchedulingJob.java| 2 +- .../src/main/resources/log4j2.xml | 0 .../src/main/webapp/WEB-INF/spring-mvc-servlet.xml | 0 .../src/main/webapp/WEB-INF/web.xml| 2 +- .../support-version.list | 3 +- .../config/expectedData.yaml | 10 ++--- .../configuration.yml | 4 +- .../pom.xml| 28 -- .../scheduled/controller/CaseController.java | 0 .../spring/scheduled/job/SchedulingJob.java| 2 +- .../src/main/resources/log4j2.xml | 0 .../src/main/webapp/WEB-INF/spring-mvc-servlet.xml | 0 .../src/main/webapp/WEB-INF/web.xml| 2 +- .../support-version.list | 11 +- 24 files changed, 81 insertions(+), 67 deletions(-) diff --git a/.github/workflows/plugins-jdk17-test.1.yaml b/.github/workflows/plugins-jdk17-test.1.yaml index 61bb8fa75a..949e69cfa1 100644 --- a/.github/workflows/plugins-jdk17-test.1.yaml +++ b/.github/workflows/plugins-jdk17-test.1.yaml @@ -62,6 +62,7 @@ jobs: - activemq-artemis-2.x-scenario - c3p0-0.9.0.x-0.9.1.x-scenario - c3p0-0.9.2.x-0.10.x-scenario + - spring-scheduled-6.x-scenario steps: - uses: actions/checkout@v2 with: diff --git a/.github/workflows/plugins-test.3.yaml b/.github/workflows/plugins-test.3.yaml index 7451dcf4b5..e687161731 100644 --- a/.github/workflows/plugins-test.3.yaml +++ b/.github/workflows/plugins-test.3.yaml @@ -81,7 +81,7 @@ jobs: - spring-kafka-1.3.x-scenario - spring-kafka-2.2.x-scenario - spring-kafka-2.3.x-scenario - - spring-scheduled-scenario + - spring-scheduled-3.x-5.x-scenario - elasticjob-2.x-scenario - quartz-scheduler-2.x-scenario - xxl-job-2.2.0-scenario diff --git a/CHANGES.md b/CHANGES.md index 6b6c759ae5..0340de503d 100644 --- a/CHANGES.md +++ b/CHANGES.md @@ -11,6 +11,7 @@ Release Notes. * Use a daemon thread to flush logs. * Fix typos in `URLParser`. * Add support for `Derby`/`Sybase`/`SQLite`/`DB2`/`OceanBase` jdbc url format in `URLParser`. +* Optimize spring-plugins:scheduled-annotation-plugin compatibility about Spring 6.1.x support. All issues and pull requests are [here](https://github.com/apache/skywalking/milestone/213?closed=1) diff --git a/apm-sniffer/apm-sdk-plugin/spring-plugins/scheduled-annotation-plugin/src/main/java/org/apache/skywalking/apm/plugin/spring/scheduled/define/ScheduledMethodInterceptorInstrumentation.java b/apm-sniffer/apm-sdk-plugin/spring-plugins/scheduled-annotation-plugin/src/main/java/org/apache/skywalking/apm/plugin/spring/scheduled/define/ScheduledMethodInterceptorInstrumentation.java index 2aacd3720b..44b36778bb 100644 --- a/apm-sniffer/apm-sdk-plugin/spring-plugins/scheduled-annotation-plugin/src/main/java/org/apache/skywalking/apm/plugin/spring/scheduled/define/ScheduledMethodInterceptorInstrumentation.java +++ b/apm-sniffer/apm-sdk-plugin/spring-plugins/scheduled-annotation-plugin/src/main/java/org/apache/skywalking/apm/plugin/spring/scheduled/define/ScheduledMethodInterceptorInstrumentation.java @@ -82,6 +82,19 @@ public class ScheduledMethodInterceptorInstrumentation extends ClassInstanceMeth public String getConstructorInterceptor() { return CONSTRUCTOR_WITH_STRING_INTERCEPTOR_CLASS; } +}, +new ConstructorInterceptPoint() { +@Override +public ElementMatcher getConstructorMatcher() { +return takesArguments(4) +
Re: [PR] Fix method name missing in spring-plugins:scheduled-annotation-plugin with spring 6.1.x [skywalking-java]
wu-sheng merged PR #691: URL: https://github.com/apache/skywalking-java/pull/691 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@skywalking.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] [Bug] skywalking 10 did not provides "/skywalking/bin/swctl", then can not check health [skywalking]
ldcsaa commented on issue #12223: URL: https://github.com/apache/skywalking/issues/12223#issuecomment-2109972062 > We just check for port available. You could determine whether to check more. OK: ``` test: ["CMD", "curl", "-s", "http://127.0.0.1:12800;] ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@skywalking.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] Fix method name missing in spring-plugins:scheduled-annotation-plugin with spring 6.1.x [skywalking-java]
wu-sheng commented on PR #691: URL: https://github.com/apache/skywalking-java/pull/691#issuecomment-2109895082 I can see RocketMQ fails again. From what I see, 50% chance fails -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@skywalking.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] Add a forceIgnoring mechanism and apply it to the plugins (Spring Clo… [skywalking-java]
wu-sheng commented on PR #689: URL: https://github.com/apache/skywalking-java/pull/689#issuecomment-2109871615 Please update here. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@skywalking.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] Add a forceIgnoring mechanism in a CROSS_THREAD scenario. [skywalking-java]
wu-sheng closed pull request #692: Add a forceIgnoring mechanism in a CROSS_THREAD scenario. URL: https://github.com/apache/skywalking-java/pull/692 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@skywalking.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] Add a forceIgnoring mechanism in a CROSS_THREAD scenario. [skywalking-java]
wu-sheng commented on PR #692: URL: https://github.com/apache/skywalking-java/pull/692#issuecomment-2109870829 Why another? Please hold on the old one. We should keep context continuously. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@skywalking.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] Add a forceIgnoring mechanism and apply it to the plugins (Spring Clo… [skywalking-java]
gzlicanyi commented on PR #689: URL: https://github.com/apache/skywalking-java/pull/689#issuecomment-2109868469 > Which problem do you mean No matter what spans they are. As they are not reported, they are fine to be GCed. I have made alterations using a new way and submitted another [PR](https://github.com/apache/skywalking-java/pull/692). Can you check if there are any problems? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@skywalking.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] Add a forceIgnoring mechanism and apply it to the plugins (Spring Clo… [skywalking-java]
wu-sheng commented on PR #689: URL: https://github.com/apache/skywalking-java/pull/689#issuecomment-2109865016 Which problem do you mean No matter what spans they are. As they are not reported, they are fine to be GCed. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@skywalking.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[PR] Add a forceIgnoring mechanism in a CROSS_THREAD scenario. [skywalking-java]
gzlicanyi opened a new pull request, #692: URL: https://github.com/apache/skywalking-java/pull/692 - [x] Tests(including UT, IT, E2E) are added to verify the new feature. - [x] Update the [`CHANGES` log](https://github.com/apache/skywalking-java/blob/main/CHANGES.md). context: https://github.com/apache/skywalking-java/pull/689 Implement the forceIgnoring mechanism in a CROSS_THREAD scenario by switching the context in the 'continued' method. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@skywalking.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] [Bug] skywalking did not work with elasitcsearch 8.13+ [skywalking]
wu-sheng commented on issue #12224: URL: https://github.com/apache/skywalking/issues/12224#issuecomment-2109821834 I think we don't test for that. @kezhenxu94 right? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@skywalking.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] [Bug] SIGSEGV: segmentation violation in banyand/query.(*topNQueryProcessor).Rev.func1() [skywalking]
Almot77 commented on issue #12219: URL: https://github.com/apache/skywalking/issues/12219#issuecomment-2109804745 Sure. Image with fix version: '3.8' services: banyandb: profiles: - "banyandb" image: ${BANYANDB_IMAGE:-ghcr.io/apache/skywalking-banyandb:c8270670d47a9c6caa2661af434157656c4b7eaf} container_name: banyandb #restart: always networks: - skywalking expose: - 17912 ports: - 17913:17913 volumes: - ./tmp:/tmp banyandb container log: [banyandb_container_log.tar.gz](https://github.com/apache/skywalking/files/15306690/banyandb_container_log.tar.gz) tmp: [https://filetransfer.io/data-package/POXU16no#link](url) Screens from grafana Elastic vs BanyanDB Elastic ![image](https://github.com/apache/skywalking/assets/88525998/a8731ed7-6f76-4995-be9b-f459948c201d) Banyan ![image](https://github.com/apache/skywalking/assets/88525998/92433cc0-6e74-41ae-a9ec-16442d3e0807) ![image](https://github.com/apache/skywalking/assets/88525998/164063a0-893a-4737-a7e5-97526ee5cafa) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@skywalking.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
(skywalking-website) branch asf-site updated: deploy: b748ff05b43e437520a33cdbd48caaff3c8d1de5
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/skywalking-website.git The following commit(s) were added to refs/heads/asf-site by this push: new fae54d21623 deploy: b748ff05b43e437520a33cdbd48caaff3c8d1de5 fae54d21623 is described below commit fae54d21623198e6fedc5ed0755bb93178e106b3 Author: wu-sheng AuthorDate: Tue May 14 10:05:29 2024 + deploy: b748ff05b43e437520a33cdbd48caaff3c8d1de5 --- contributors/index.html | 116 index.json | 2 +- team/index.html | 52 +++--- 3 files changed, 85 insertions(+), 85 deletions(-) diff --git a/contributors/index.html b/contributors/index.html index b42f7d94f5a..bd2ff3b083a 100644 --- a/contributors/index.html +++ b/contributors/index.html @@ -731,6 +731,20 @@ + + +https://github.com/dmsolr; target="_blank"> + + dmsolr + + + +12 +11 + + + + https://github.com/Fine0830; target="_blank"> @@ -740,7 +754,7 @@ 12 -11 +12 @@ -754,21 +768,21 @@ 12 -12 +13 - + -https://github.com/dmsolr; target="_blank"> +https://github.com/BFergerson; target="_blank"> - dmsolr + BFergerson -12 -13 +11 +14 @@ -782,21 +796,21 @@ 11 -14 +15 - + -https://github.com/BFergerson; target="_blank"> +https://github.com/wankai123; target="_blank"> - BFergerson + wankai123 -11 -15 +10 +16 @@ -810,21 +824,7 @@ 9 -16 - - - - - - -https://github.com/wankai123; target="_blank"> - - wankai123 - - - -9 -17 +17 @@ -871,16 +871,16 @@ - + -https://github.com/EvanLjp; target="_blank"> +https://github.com/heyanlong; target="_blank"> - EvanLjp + heyanlong -5 -21 +5 +21 @@ -899,72 +899,72 @@ - + -https://github.com/heyanlong; target="_blank"> +https://github.com/EvanLjp; target="_blank"> - heyanlong + EvanLjp -5 -23 +5 +
Re: [I] [Bug] skywalking 10 did not provides "/skywalking/bin/swctl", then can not check health [skywalking]
ldcsaa commented on issue #12223: URL: https://github.com/apache/skywalking/issues/12223#issuecomment-2109777883 > Yes, we don't provide this in the image anymore. Are you using the old compose file? I will start `skywalking-ui` after skywalking OAP server started succ. So I need to check skywalking health, these is my code: ``` skywalking: depends_on: elasticsearch: condition: service_healthy container_name: "skywalking" healthcheck: test: ["CMD", "/skywalking/bin/swctl", "health"] interval: 30s timeout: 10s retries: 5 start_period: 90s environment: - "SW_TELEMETRY=prometheus" - "SW_OTEL_RECEIVER=default" - "SW_OTEL_RECEIVER_ENABLED_OTEL_METRICS_RULES=oap" - "SW_HEALTH_CHECKER=default" - "SW_HEALTH_CHECKER_INTERVAL_SECONDS=30" - "SW_CORE_GRPC_PORT=11800" - "SW_TELEMETRY_PROMETHEUS_PORT=1234" - "SW_STORAGE=elasticsearch" - "SW_STORAGE_ES_CLUSTER_NODES=elasticsearch:9200" - "SW_CORE_REST_PORT=12800" - "JAVA_OPTS=-Xms256m -Xmx512m" image: "registry.cn-hangzhou.aliyuncs.com/jessma/apache-skywalking:10.0.0" networks: - "soa-net" ports: - "11800:11800/tcp" - "1234:1234/tcp" - "12800:12800/tcp" volumes: - "./apache-skywalking/config/alarm-settings.yml:/skywalking/config/alarm-settings.yml" - "./apache-skywalking/config/application.yml:/skywalking/config/application.yml" working_dir: "/skywalking" skywalking-ui: depends_on: skywalking: condition: service_healthy container_name: "skywalking-ui" environment: - "SW_SERVER_PORT=8080" - "SW_OAP_ADDRESS=http://skywalking:12800; - "SW_TIMEOUT=1" - "JAVA_OPTS=-Xms128m -Xmx256m" image: "registry.cn-hangzhou.aliyuncs.com/jessma/apache-skywalking-ui:10.0.0" networks: - "soa-net" ports: - "8787:8080/tcp" volumes: - "./apache-skywalking-ui/webapp/application.yml:/skywalking/webapp/application.yml" ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@skywalking.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] [Bug] skywalking 10 did not provides "/skywalking/bin/swctl", then can not check health [skywalking]
wu-sheng closed issue #12223: [Bug] skywalking 10 did not provides "/skywalking/bin/swctl", then can not check health URL: https://github.com/apache/skywalking/issues/12223 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@skywalking.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[I] [Bug] skywalking did not work with elasitcsearch 8.13+ [skywalking]
ldcsaa opened a new issue, #12224: URL: https://github.com/apache/skywalking/issues/12224 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/skywalking/issues?q=is%3Aissue) and found no similar issues. ### Apache SkyWalking Component OAP server (apache/skywalking) ### What happened skywalking would start fail, while uses `elasticsearch 8.13.x` as backend storage, and it's OK while uses `elasticsearch 8.12.x` as backend storage ### What you expected to happen Is OK while uses `elasticsearch 8.13.x` as backend storage. ### How to reproduce just start skywalking uses `elasticsearch 8.13.x` as backend storage. ### Anything else _No response_ ### Are you willing to submit a pull request to fix on your own? - [ ] Yes I am willing to submit a pull request on my own! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@skywalking.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] [Bug] skywalking 10 did not provides "/skywalking/bin/swctl", then can not check health [skywalking]
wu-sheng commented on issue #12223: URL: https://github.com/apache/skywalking/issues/12223#issuecomment-2109770754 Yes, we don't provide this in the image anymore. Are you using the old compose file? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@skywalking.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[I] [Bug] skywalking 10 did not provides "/skywalking/bin/swctl", then can not check health [skywalking]
ldcsaa opened a new issue, #12223: URL: https://github.com/apache/skywalking/issues/12223 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/skywalking/issues?q=is%3Aissue) and found no similar issues. ### Apache SkyWalking Component OAP server (apache/skywalking) ### What happened In skywalking 9.7.0 and before, uses these codes to check health in docker compose, but skywalking 10+, did not provides these tools: ``` services: skywalking: depends_on: elasticsearch: condition: service_healthy container_name: "skywalking" healthcheck: test: ["CMD", "/skywalking/bin/swctl", "health"] interval: 30s timeout: 10s retries: 5 start_period: 90s ``` ### What you expected to happen provides tool: `/skywalking/bin/swctl` ### How to reproduce just check the dir ### Anything else _No response_ ### Are you willing to submit a pull request to fix on your own? - [ ] Yes I am willing to submit a pull request on my own! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@skywalking.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] Add a forceIgnoring mechanism and apply it to the plugins (Spring Clo… [skywalking-java]
gzlicanyi commented on PR #689: URL: https://github.com/apache/skywalking-java/pull/689#issuecomment-2109749252 > > > > I think you got it wrong. It should be in ContextManager#continued method, which controls the context. > > > > > > > > > Understood. How can the [span](https://github.com/apache/skywalking-java/blob/1a010470076ba7f206f4fd6559d04136bea73417/apm-sniffer/optional-plugins/optional-spring-plugins/optional-spring-cloud/gateway-2.0.x-plugin/src/main/java/org/apache/skywalking/apm/plugin/spring/cloud/gateway/v20x/NettyRoutingFilterInterceptor.java#L44) used by the plugin be changed to a NoopSpan? > > > > > > Consider creating `AbstractTracerContext#forceIgnoring`. `TracingContext#forceIgnoring` could return a `IgnoredTracerContext` with the same stack depth, to make sure no tracing context stack leak. `IgnoredTracerContext` just simply returns **this** as no change is required. > > IgnoredTracerContext retains the activeSpanStack of TracingContext, do you think there's no problem with it? If there is no problem, indeed the 'continued' method can complete the transition of the context. However, for the leftover spans, I am not entirely sure if they might cause other issues. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@skywalking.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] Add a forceIgnoring mechanism and apply it to the plugins (Spring Clo… [skywalking-java]
gzlicanyi commented on PR #689: URL: https://github.com/apache/skywalking-java/pull/689#issuecomment-2109743159 > > > I think you got it wrong. It should be in ContextManager#continued method, which controls the context. > > > > > > Understood. How can the [span](https://github.com/apache/skywalking-java/blob/1a010470076ba7f206f4fd6559d04136bea73417/apm-sniffer/optional-plugins/optional-spring-plugins/optional-spring-cloud/gateway-2.0.x-plugin/src/main/java/org/apache/skywalking/apm/plugin/spring/cloud/gateway/v20x/NettyRoutingFilterInterceptor.java#L44) used by the plugin be changed to a NoopSpan? > > Consider creating `AbstractTracerContext#forceIgnoring`. `TracingContext#forceIgnoring` could return a `IgnoredTracerContext` with the same stack depth, to make sure no tracing context stack leak. `IgnoredTracerContext` just simply returns **this** as no change is required. IgnoredTracerContext retains the activeSpanStack of TracingContext, do you think there's no problem with it? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@skywalking.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] Fix method name missing in spring-plugins:scheduled-annotation-plugin with spring 6.1.x [skywalking-java]
CzyerChen commented on PR #691: URL: https://github.com/apache/skywalking-java/pull/691#issuecomment-2109729418 > Are we sending too frequently? The test GHA env is only 3u8g for all runtime. It could be super slow. May have an impact. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@skywalking.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] Fix method name missing in spring-plugins:scheduled-annotation-plugin with spring 6.1.x [skywalking-java]
wu-sheng commented on PR #691: URL: https://github.com/apache/skywalking-java/pull/691#issuecomment-2109656114 Are we sending too frequently? The test GHA env is only 3u8g for all runtime. It could be super slow. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@skywalking.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] Fix method name missing in spring-plugins:scheduled-annotation-plugin with spring 6.1.x [skywalking-java]
CzyerChen commented on PR #691: URL: https://github.com/apache/skywalking-java/pull/691#issuecomment-2109653475 > I can see RocketMQ case fails again. The problem is not reproduced locally, and the sending and receiving of async messages are enhanced. Please do inform me when the recurrence of the problem. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@skywalking.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
(skywalking-website) branch v10-blog deleted (was f26e64a8c26)
This is an automated email from the ASF dual-hosted git repository. wusheng pushed a change to branch v10-blog in repository https://gitbox.apache.org/repos/asf/skywalking-website.git was f26e64a8c26 head The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
Re: [PR] Add SkyWalking 10 release blog. [skywalking-website]
wu-sheng merged PR #708: URL: https://github.com/apache/skywalking-website/pull/708 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@skywalking.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
(skywalking-website) branch master updated: Add SkyWalking 10 release blog. (#708)
This is an automated email from the ASF dual-hosted git repository. wusheng pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/skywalking-website.git The following commit(s) were added to refs/heads/master by this push: new b748ff05b43 Add SkyWalking 10 release blog. (#708) b748ff05b43 is described below commit b748ff05b43e437520a33cdbd48caaff3c8d1de5 Author: Wan Kai AuthorDate: Tue May 14 16:30:06 2024 +0800 Add SkyWalking 10 release blog. (#708) --- .../2024-05-13-skywalking-10-release/active_mq.jpg | Bin 0 -> 136769 bytes .../clickhouse.jpg | Bin 0 -> 185890 bytes .../blog/2024-05-13-skywalking-10-release/index.md | 170 + .../k8s_dashboard.jpg | Bin 0 -> 69555 bytes .../k8s_topology.jpg | Bin 0 -> 61086 bytes .../layer_jump.jpg | Bin 0 -> 108000 bytes .../layer_jump2.jpg| Bin 0 -> 74333 bytes .../2024-05-13-skywalking-10-release/postgre.jpg | Bin 0 -> 40016 bytes .../2024-05-13-skywalking-10-release/rocket_mq.jpg | Bin 0 -> 58951 bytes .../blog/2024-05-13-skywalking-10-release/song.jpg | Bin 0 -> 90011 bytes .../song_instance.jpg | Bin 0 -> 50570 bytes 11 files changed, 170 insertions(+) diff --git a/content/blog/2024-05-13-skywalking-10-release/active_mq.jpg b/content/blog/2024-05-13-skywalking-10-release/active_mq.jpg new file mode 100644 index 000..f2594837067 Binary files /dev/null and b/content/blog/2024-05-13-skywalking-10-release/active_mq.jpg differ diff --git a/content/blog/2024-05-13-skywalking-10-release/clickhouse.jpg b/content/blog/2024-05-13-skywalking-10-release/clickhouse.jpg new file mode 100644 index 000..043d63d1159 Binary files /dev/null and b/content/blog/2024-05-13-skywalking-10-release/clickhouse.jpg differ diff --git a/content/blog/2024-05-13-skywalking-10-release/index.md b/content/blog/2024-05-13-skywalking-10-release/index.md new file mode 100644 index 000..c05a3c59ed2 --- /dev/null +++ b/content/blog/2024-05-13-skywalking-10-release/index.md @@ -0,0 +1,170 @@ +--- +title: "SkyWalking 10 Release: Service Hierarchy, Kubernetes Network Monitoring by eBPF, BanyanDB, and More" +date: 2024-05-13 +author: Kai Wan, Sheng Wu. tetrate.io +description: "Introduce what's new in SkyWalking 10, including Service Hierarchy, Kubernetes Network Monitoring by eBPF, BanyanDB, and more." +tags: +- Release Blog +- Service Hierarchy +- Kubernetes +- eBPF +- BanyanDB +--- + +The Apache SkyWalking team today announced the 10 release. SkyWalking 10 provides a host of groundbreaking features and enhancements. +The introduction of Layer and Service Hierarchy streamlines monitoring by organizing services and metrics into distinct layers and providing seamless navigation across them. +Leveraging eBPF technology, Kubernetes Network Monitoring delivers granular insights into network traffic, topology, and TCP/HTTP metrics. +BanyanDB emerges as a high-performance native storage solution, while expanded monitoring support encompasses Apache RocketMQ, ClickHouse, +and Apache ActiveMQ Classic. Support for Multiple Labels Names enhances flexibility in metrics analysis, +while enhanced exporting and querying capabilities streamline data dissemination and processing. + +This release blog briefly introduces these new features and Enhancements as well as some other notable changes. + +## Layer and Service Hierarchy +`Layer` concept was introduced in SkyWalking 9.0.0, it represents an abstract framework in computer science, +such as Operating System(OS_LINUX layer), Kubernetes(k8s layer). It organizes services and metrics into different layers based on their roles +and responsibilities in the system. SkyWalking provides a suite of monitoring and diagnostic tools for each layer, but there is a gap between the layers, +which can not easily bridge the data across different layers. + +In SkyWalking 10, SkyWalking provides new abilities to jump/connect across different layers and provide a seamless monitoring experience for users. + +### Layer Jump +In the topology graph, users can click on a service node to jump to the dashboard of the service in another layer. +The following figures show the jump from the `GENERAL` layer service topology to the `VIRTUAL_DATABASE` service layer dashboard by clicking the topology node. +![Figure 1: Layer Jump](layer_jump.jpg) +Figure 1: Layer Jump + +![Figure 2: Layer jump Dashboard](layer_jump2.jpg) +Figure 2: Layer jump Dashboard + +### Service Hierarchy +SkyWalking 10 introduces a new concept called `Service Hierarchy`, which defines the relationships of existing logically same services in various layers. +OAP will detect the services from different layers, and try to build the connections. +Users can click the `Hierarchy Services` in any layer's service topology node
Re: [I] [Bug] SIGSEGV: segmentation violation in banyand/query.(*topNQueryProcessor).Rev.func1() [skywalking]
hanahmily commented on issue #12219: URL: https://github.com/apache/skywalking/issues/12219#issuecomment-2109557468 ``` banyandb: profiles: - "banyandb" image: ${BANYANDB_IMAGE:-apache/skywalking-banyandb:latest} container_name: banyandb restart: always networks: - skywalking expose: - 17912 ports: - 17913:17913 volumes: - :/tmp ``` @Almot77 could you mount your host path to the banyandb's `/tmp`. then archive the whole path then upload here? The path should be like ![image](https://github.com/apache/skywalking/assets/1960537/31abcb22-19c1-44c3-b808-043888b90d56) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@skywalking.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
(skywalking-website) branch v10-blog updated (c249415b221 -> f26e64a8c26)
This is an automated email from the ASF dual-hosted git repository. wankai pushed a change to branch v10-blog in repository https://gitbox.apache.org/repos/asf/skywalking-website.git from c249415b221 add head introduce add f26e64a8c26 head No new revisions were added by this update. Summary of changes: content/blog/2024-05-13-skywalking-10-release/index.md | 2 ++ 1 file changed, 2 insertions(+)
(skywalking-website) branch v10-blog updated (a5e63300d20 -> c249415b221)
This is an automated email from the ASF dual-hosted git repository. wankai pushed a change to branch v10-blog in repository https://gitbox.apache.org/repos/asf/skywalking-website.git from a5e63300d20 fix date add c249415b221 add head introduce No new revisions were added by this update. Summary of changes: content/blog/2024-05-13-skywalking-10-release/index.md | 9 - 1 file changed, 8 insertions(+), 1 deletion(-)
(skywalking-website) branch v10-blog updated (2729e56d6f6 -> a5e63300d20)
This is an automated email from the ASF dual-hosted git repository. wankai pushed a change to branch v10-blog in repository https://gitbox.apache.org/repos/asf/skywalking-website.git from 2729e56d6f6 Add SkyWalking 10 release blog. add a5e63300d20 fix date No new revisions were added by this update. Summary of changes: content/blog/2024-05-13-skywalking-10-release/index.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
Re: [I] [Bug] SIGSEGV: segmentation violation in banyand/query.(*topNQueryProcessor).Rev.func1() [skywalking]
wu-sheng commented on issue #12219: URL: https://github.com/apache/skywalking/issues/12219#issuecomment-2109474785 SW_DCS_MAX_INBOUND_MESSAGE_SIZE is not for this case. We need to check BanyanDB Java client(storage/banyandb/... in application.yml) for relative settings(maybe missed for now). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@skywalking.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] [Bug] SIGSEGV: segmentation violation in banyand/query.(*topNQueryProcessor).Rev.func1() [skywalking]
Almot77 commented on issue #12219: URL: https://github.com/apache/skywalking/issues/12219#issuecomment-2109471689 It`s data from skywalking php exporter, i don`t now how to collect and save it, may be export docker container with collected data ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@skywalking.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] [Bug] SIGSEGV: segmentation violation in banyand/query.(*topNQueryProcessor).Rev.func1() [skywalking]
wu-sheng commented on issue #12219: URL: https://github.com/apache/skywalking/issues/12219#issuecomment-2109447305 If your data is just for testing, could you tar the whole data folder and upload here? It would be eaiser to verified your query through the same dataset. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@skywalking.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] [Bug] SIGSEGV: segmentation violation in banyand/query.(*topNQueryProcessor).Rev.func1() [skywalking]
Almot77 commented on issue #12219: URL: https://github.com/apache/skywalking/issues/12219#issuecomment-2109439962 Ok, db start success, but i have 3 troubles: 1. I lost data from my panel in grafana. Possible bug was in this place. ![image](https://github.com/apache/skywalking/assets/88525998/8608699b-d146-4331-b8a2-36d5ce7f14a6) Query to endpoint_sla{parent_service='$service', layer='$layer', top_n='15', order='ASC'} / 100 Grafana query inspect: { "request": { "url": "api/ds/query?ds_type=prometheus=Q362", "method": "POST", "data": { "queries": [ { "datasource": { "type": "prometheus", "uid": "fdjzti6mhdam8c" }, "editorMode": "code", "exemplar": false, "expr": "endpoint_sla{parent_service='php-kz-prod', layer='GENERAL', top_n='15', order='ASC'} / 100", "format": "time_series", "instant": false, "legendFormat": "{{endpoint}}", "range": true, "refId": "A", "requestId": "71A", "utcOffsetSec": 10800, "interval": "", "datasourceId": 2, "intervalMs": 6, "maxDataPoints": 1358 } ], "from": "1715666087538", "to": "1715669687539" }, "hideFromInspector": false }, "response": { "results": { "A": { "error": "expected object type", "errorSource": "", "status": 200, "frames": [ { "schema": { "refId": "A", "meta": { "typeVersion": [ 0, 0 ], "executedQueryString": "Expr: endpoint_sla{parent_service='php-kz-prod', layer='GENERAL', top_n='15', order='ASC'} / 100\nStep: 1m0s" }, "fields": [] }, "data": { "values": [] } } ], "refId": "A" } } } } 2. I have doubles in my Slow Service instance dashboard ![image](https://github.com/apache/skywalking/assets/88525998/55d14e17-0e63-4d3c-bfe8-17b6c9395ea2) ![image](https://github.com/apache/skywalking/assets/88525998/39171e7c-250d-4b4d-a662-bdb6ae1d36ee) Query: { "request": { "url": "api/ds/query?ds_type=prometheus=Q423", "method": "POST", "data": { "queries": [ { "datasource": { "type": "prometheus", "uid": "fdjzti6mhdam8c" }, "editorMode": "code", "exemplar": false, "expr": "endpoint_sla{parent_service='php-kz-prod', layer='GENERAL', top_n='15', order='ASC'} / 100", "format": "time_series", "instant": false, "legendFormat": "{{endpoint}}", "range": true, "refId": "A", "requestId": "71A", "utcOffsetSec": 10800, "interval": "", "datasourceId": 2, "intervalMs": 6, "maxDataPoints": 940 } ], "from": "1715666368835", "to": "1715669968835" }, "hideFromInspector": false }, "response": { "results": { "A": { "error": "expected object type", "errorSource": "", "status": 200, "frames": [ { "schema": { "refId": "A", "meta": { "typeVersion": [ 0, 0 ], "executedQueryString": "Expr: endpoint_sla{parent_service='php-kz-prod', layer='GENERAL', top_n='15', order='ASC'} / 100\nStep: 1m0s" }, "fields": [] }, "data": { "values": [] } } ], "refId": "A" } } } } 3. I have a lot in logs: WARNING: Exception processing message io.grpc.StatusRuntimeException: RESOURCE_EXHAUSTED: gRPC message exceeds maximum size 4194304: 5728590 at io.grpc.Status.asRuntimeException(Status.java:525) at io.grpc.internal.MessageDeframer.processHeader(MessageDeframer.java:392) at io.grpc.internal.MessageDeframer.deliver(MessageDeframer.java:272) in docker-compose i have env SW_DCS_MAX_INBOUND_MESSAGE_SIZE when i run Skywalking: oap-bdb: <<: *oap-base profiles: - "banyandb" container_name: skywalking-server-bdb # rename to oap if switching to Elasticsearch depends_on: banyandb:
Re: [PR] Add SkyWalking 10 release blog. [skywalking-website]
netlify[bot] commented on PR #708: URL: https://github.com/apache/skywalking-website/pull/708#issuecomment-2109431176 ### Deploy Preview for *skywalking-website-preview* processing. | Name | Link | |:-:|| | Latest commit | 2729e56d6f6aea784610e8c267d59f39c1a9b421 | | Latest deploy log | https://app.netlify.com/sites/skywalking-website-preview/deploys/66430c5ecce6bf000887239f | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@skywalking.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[PR] Add SkyWalking 10 release blog. [skywalking-website]
wankai123 opened a new pull request, #708: URL: https://github.com/apache/skywalking-website/pull/708 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@skywalking.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
(skywalking-website) branch v10-blog created (now 2729e56d6f6)
This is an automated email from the ASF dual-hosted git repository. wankai pushed a change to branch v10-blog in repository https://gitbox.apache.org/repos/asf/skywalking-website.git at 2729e56d6f6 Add SkyWalking 10 release blog. This branch includes the following new commits: new 2729e56d6f6 Add SkyWalking 10 release blog. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
(skywalking-website) 01/01: Add SkyWalking 10 release blog.
This is an automated email from the ASF dual-hosted git repository. wankai pushed a commit to branch v10-blog in repository https://gitbox.apache.org/repos/asf/skywalking-website.git commit 2729e56d6f6aea784610e8c267d59f39c1a9b421 Author: wankai123 AuthorDate: Tue May 14 15:01:14 2024 +0800 Add SkyWalking 10 release blog. --- .../2024-05-13-skywalking-10-release/active_mq.jpg | Bin 0 -> 136769 bytes .../clickhouse.jpg | Bin 0 -> 185890 bytes .../blog/2024-05-13-skywalking-10-release/index.md | 161 + .../k8s_dashboard.jpg | Bin 0 -> 69555 bytes .../k8s_topology.jpg | Bin 0 -> 61086 bytes .../layer_jump.jpg | Bin 0 -> 108000 bytes .../layer_jump2.jpg| Bin 0 -> 74333 bytes .../2024-05-13-skywalking-10-release/postgre.jpg | Bin 0 -> 40016 bytes .../2024-05-13-skywalking-10-release/rocket_mq.jpg | Bin 0 -> 58951 bytes .../blog/2024-05-13-skywalking-10-release/song.jpg | Bin 0 -> 90011 bytes .../song_instance.jpg | Bin 0 -> 50570 bytes 11 files changed, 161 insertions(+) diff --git a/content/blog/2024-05-13-skywalking-10-release/active_mq.jpg b/content/blog/2024-05-13-skywalking-10-release/active_mq.jpg new file mode 100644 index 000..f2594837067 Binary files /dev/null and b/content/blog/2024-05-13-skywalking-10-release/active_mq.jpg differ diff --git a/content/blog/2024-05-13-skywalking-10-release/clickhouse.jpg b/content/blog/2024-05-13-skywalking-10-release/clickhouse.jpg new file mode 100644 index 000..043d63d1159 Binary files /dev/null and b/content/blog/2024-05-13-skywalking-10-release/clickhouse.jpg differ diff --git a/content/blog/2024-05-13-skywalking-10-release/index.md b/content/blog/2024-05-13-skywalking-10-release/index.md new file mode 100644 index 000..21422a48903 --- /dev/null +++ b/content/blog/2024-05-13-skywalking-10-release/index.md @@ -0,0 +1,161 @@ +--- +title: "SkyWalking 10 Release: Service Hierarchy, Kubernetes Network Monitoring by eBPF, BanyanDB, and More" +date: 2024-5-13 +author: Kai Wan, Sheng Wu. tetrate.io +description: "Introduce what's new in SkyWalking 10, including Service Hierarchy, Kubernetes Network Monitoring by eBPF, BanyanDB, and more." +tags: +- Release Blog +- Service Hierarchy +- Kubernetes +- eBPF +- BanyanDB +--- + +## Layer and Service Hierarchy +`Layer` concept was introduced in SkyWalking 9.0.0, it represents an abstract framework in computer science, +such as Operating System(OS_LINUX layer), Kubernetes(k8s layer). It organizes services and metrics into different layers based on their roles +and responsibilities in the system. SkyWalking provides a suite of monitoring and diagnostic tools for each layer, but there is a gap between the layers, +which can not easily bridge the data across different layers. + +In SkyWalking 10, SkyWalking provides new abilities to jump/connect across different layers and provide a seamless monitoring experience for users. + +### Layer Jump +In the topology graph, users can click on a service node to jump to the dashboard of the service in another layer. +The following figures show the jump from the `GENERAL` layer service topology to the `VIRTUAL_DATABASE` service layer dashboard by clicking the topology node. +![Figure 1: Layer Jump](layer_jump.jpg) +Figure 1: Layer Jump + +![Figure 2: Layer jump Dashboard](layer_jump2.jpg) +Figure 2: Layer jump Dashboard + +### Service Hierarchy +SkyWalking 10 introduces a new concept called `Service Hierarchy`, which defines the relationships of existing logically same services in various layers. +OAP will detect the services from different layers, and try to build the connections. +Users can click the `Hierarchy Services` in any layer's service topology node or service dashboard to get the `Hierarchy Topology`. +In this topology graph, users can see the relationships between the services in different layers and the summary of the metrics and also can jump to the service dashboard in the layer. +When a service occurrs performance issue, users can easily analyze the metrics from different layers and track down the root cause: + +The examples of the `Service Hierarchy` relationships: + +1. The application `song` deployed in the Kubernetes cluster with SkyWalking agent and Service Mesh at the same time. +So the application `song` across the `GENERAL`, `MESH`, `MESH_DP` and `K8S_SERVICE` layers which could be monitoring by SkyWalking, +the `Service Hierarchy` topology as below: +![Figure 3: Service Hierarchy Agent With K8s Service And Mesh With K8s Service](song.jpg) +Figure 3: Service Hierarchy Agent With K8s Service And Mesh With K8s Service. + +And can also have the `Service Instance Hierarchy` topology to get the single instance status across the layers as below: +![Figure 4: Instance Hierarchy Agent With K8s
Re: [I] How to connect elasticsearch with https? [skywalking]
kyleli666 commented on issue #4512: URL: https://github.com/apache/skywalking/issues/4512#issuecomment-2109410067 From https://github.com/apache/skywalking/blob/v6.6.0/docs/en/setup/backend/backend-storage.md#elasticsearch-6-with-https-ssl-encrypting-communications, I found another ENV shall be set in OAP is SW_STORAGE_ES_HTTP_PROTOCOL = https, and for AWS OpenSearch with https SW_SW_STORAGE_ES_SSL_JKS_PATH and SW_SW_STORAGE_ES_SSL_JKS_PASS are optional. So, the helm values for me with AWS OpenSearch are: ``` elasticsearch: enabled: false config: host: example.xxx.es.amazonaws.com port: http: 443 user: xxx password: xxx esMajorVersion: "7" oap: storageType: elasticsearch env: SW_STORAGE_ES_HTTP_PROTOCOL: https ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@skywalking.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] [Bug] SIGSEGV: segmentation violation in banyand/query.(*topNQueryProcessor).Rev.func1() [skywalking]
wu-sheng commented on issue #12219: URL: https://github.com/apache/skywalking/issues/12219#issuecomment-2109373978 Or simply, try dev image from here, https://github.com/apache/skywalking-banyandb/pkgs/container/skywalking-banyandb/215721861?tag=c8270670d47a9c6caa2661af434157656c4b7eaf -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@skywalking.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] [Bug] SIGSEGV: segmentation violation in banyand/query.(*topNQueryProcessor).Rev.func1() [skywalking]
wu-sheng commented on issue #12219: URL: https://github.com/apache/skywalking/issues/12219#issuecomment-2109371084 This is build doc, https://skywalking.apache.org/docs/skywalking-banyandb/latest/installation/binaries/#build-binaries -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@skywalking.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] [Bug] SIGSEGV: segmentation violation in banyand/query.(*topNQueryProcessor).Rev.func1() [skywalking]
Almot77 commented on issue #12219: URL: https://github.com/apache/skywalking/issues/12219#issuecomment-2109366071 How to install go libaries ? Ubuntu 22.04 I do: sudo apt install time nodejs npm sudo npm cache clean -f sudo npm install -g n sudo n stable wget https://go.dev/dl/go1.22.3.linux-amd64.tar.gz sudo rm -rf /usr/local/go && tar -C /usr/local -xzf go1.22.3.linux-amd64.tar.gz export PATH=$PATH:/usr/local/go/bin $ make docker.build ``` make docker -C docker; \ if [ $? -ne 0 ]; then \ exit 1; \ fi; \ make[1]: Entering directory '/home/srvdocker/skywalking/build/skywalking-banyandb/docker' Build apache/skywalking-banyandb:latest [+] Building 1.3s (14/18) docker:default => [internal] load .dockerignore 0.0s => => transferring context: 2B 0.0s => [internal] load build definition from Dockerfile 0.0s => => transferring dockerfile: 2.03kB 0.0s => [internal] load metadata for docker.io/library/busybox:stable-glibc 0.5s => [internal] load metadata for docker.io/library/alpine:edge 0.5s => [internal] load metadata for docker.io/library/golang:1.22 0.5s => [base 1/4] FROM docker.io/library/golang:1.22@sha256:b1e05e2c918f52c59d39ce7d5844f73b2f4511f7734add8bb98c9ecdd4443365 0.0s => [internal] load build context 0.1s => => transferring context: 73.62kB 0.1s => CACHED [build-linux 1/4] FROM docker.io/library/busybox:stable-glibc@sha256:9bc27a72a82d22e54b4cc8bd7b99d3907a442869f77f075e0119104f2404953d 0.0s => [certs 1/2] FROM docker.io/library/alpine:edge@sha256:e31c3b1cd47718260e1b6163af0a05b3c428dc01fa410baf72ca8b8076e22e72 0.0s => CACHED [certs 2/2] RUN apk add --no-cache ca-certificates && update-ca-certificates 0.0s => CACHED [base 2/4] WORKDIR /src 0.0s => CACHED [base 3/4] COPY go.* ./ 0.0s => CACHED [base 4/4] RUN go mod download 0.0s => ERROR [builder 1/2] RUN --mount=target=. --mount=type=cache,target=/root/.cache/go-build BUILD_DIR=/out BUILD_TAGS=prometheus make -C banyan 0.8s -- > [builder 1/2] RUN --mount=target=. --mount=type=cache,target=/root/.cache/go-build BUILD_DIR=/out BUILD_TAGS=prometheus make -C banyand banyand-server-static: 0.215 make: Entering directory '/src/banyand' 0.233 Building static binary 0.233 CGO_ENABLED=0 GOOS=linux GOARCH=amd64 go build \ 0.233 -buildvcs=false \ 0.233 -a --ldflags '-X github.com/apache/skywalking-banyandb/pkg/version.build=v0.6.0-1-gc827067-main -extldflags "-static"' -tags "netgo prometheus" -installsuffix netgo \ 0.233 -o /out/banyand-server-static github.com/apache/skywalking-banyandb/banyand/cmd/server 0.434 ../api/data/data.go:24:2: no required module provides package github.com/apache/skywalking-banyandb/api/proto/banyandb/measure/v1; to add it: 0.434 go get github.com/apache/skywalking-banyandb/api/proto/banyandb/measure/v1 0.434 ../api/data/data.go:25:2: no required module provides package