wu-sheng commented on PR #13016:
URL: https://github.com/apache/skywalking/pull/13016#issuecomment-2629384008
> It seems new server has issues, wait for @hanahmily recheck.
I have confirmed, something bad happened at DB server side.
- BanyanDB logs
```
created by
github.com/apache/skywalking-banyandb/banyand/stream.(*tsTable).startLoop in
goroutine 47557
/home/runner/work/skywalking-banyandb/skywalking-banyandb/banyand/stream/tstable.go:117
+0x158
goroutine 47589 gp=0xc0054f8fc0 m=nil [select, 1 minutes]:
runtime.gopark(0xc00076ff20?, 0x3?, 0x7d?, 0x3?, 0xc00076feca?)
/opt/hostedtoolcache/go/1.23.5/x64/src/runtime/proc.go:424 +0xce
fp=0xc00f9e0d58 sp=0xc00f9e0d38 pc=0x4758ee
runtime.selectgo(0xc00f9e0f20, 0xc00076fec4, 0xc00076ffc8?, 0x0, 0x14a9c60?,
0x1)
/opt/hostedtoolcache/go/1.23.5/x64/src/runtime/select.go:335 +0x7a5
fp=0xc00f9e0e80 sp=0xc00f9e0d58 pc=0x451365
github.com/apache/skywalking-banyandb/banyand/stream.(*tsTable).flusherLoop(0xc00f308800,
0xc005276e00, 0xc005276e70, 0xc005078380, 0xc0050783f0, 0x1820584f5d5239dc)
/home/runner/work/skywalking-banyandb/skywalking-banyandb/banyand/stream/flusher.go:37
+0x293 fp=0xc00f9e0fa0 sp=0xc00f9e0e80 pc=0xfb8833
github.com/apache/skywalking-banyandb/banyand/stream.(*tsTable).startLoop.gowrap2()
/home/runner/work/skywalking-banyandb/skywalking-banyandb/banyand/stream/tstable.go:118
+0x34 fp=0xc00f9e0fe0 sp=0xc00f9e0fa0 pc=0xfd5dd4
runtime.goexit({})
/opt/hostedtoolcache/go/1.23.5/x64/src/runtime/asm_amd64.s:1700 +0x1
fp=0xc00f9e0fe8 sp=0xc00f9e0fe0 pc=0x47dc81
created by
github.com/apache/skywalking-banyandb/banyand/stream.(*tsTable).startLoop in
goroutine 47557
/home/runner/work/skywalking-banyandb/skywalking-banyandb/banyand/stream/tstable.go:118
+0x1e6
```
- OAP logs
```
2025-02-02 08:56:23,497
org.apache.skywalking.oap.query.zipkin.handler.ZipkinQueryExceptionHandler 41
[armeria-eventloop-epoll-8-8] ERROR [] - fail to query stream
java.io.IOException: fail to query stream
at
org.apache.skywalking.oap.server.storage.plugin.banyandb.BanyanDBStorageClient.query(BanyanDBStorageClient.java:188)
~[storage-banyandb-plugin-10.2.0-SNAPSHOT.jar:10.2.0-SNAPSHOT]
at
org.apache.skywalking.oap.server.storage.plugin.banyandb.stream.AbstractBanyanDBDAO.query(AbstractBanyanDBDAO.java:88)
~[storage-banyandb-plugin-10.2.0-SNAPSHOT.jar:10.2.0-SNAPSHOT]
at
org.apache.skywalking.oap.server.storage.plugin.banyandb.stream.AbstractBanyanDBDAO.queryDebuggable(AbstractBanyanDBDAO.java:111)
~[storage-banyandb-plugin-10.2.0-SNAPSHOT.jar:10.2.0-SNAPSHOT]
at
org.apache.skywalking.oap.server.storage.plugin.banyandb.BanyanDBZipkinQueryDAO.getTraces(BanyanDBZipkinQueryDAO.java:265)
~[storage-banyandb-plugin-10.2.0-SNAPSHOT.jar:10.2.0-SNAPSHOT]
at
org.apache.skywalking.oap.server.storage.plugin.banyandb.BanyanDBZipkinQueryDAO.getTraces(BanyanDBZipkinQueryDAO.java:200)
~[storage-banyandb-plugin-10.2.0-SNAPSHOT.jar:10.2.0-SNAPSHOT]
at
org.apache.skywalking.oap.server.core.storage.query.IZipkinQueryDAO.getTracesDebuggable(IZipkinQueryDAO.java:47)
~[server-core-10.2.0-SNAPSHOT.jar:10.2.0-SNAPSHOT]
at
org.apache.skywalking.oap.query.zipkin.handler.ZipkinQueryHandler.getTraces(ZipkinQueryHandler.java:244)
~[zipkin-query-plugin-10.2.0-SNAPSHOT.jar:10.2.0-SNAPSHOT]
at
com.linecorp.armeria.internal.server.annotation.DefaultAnnotatedService.invoke(DefaultAnnotatedService.java:417)
~[armeria-1.29.3.jar:?]
at
com.linecorp.armeria.internal.server.annotation.DefaultAnnotatedService.lambda$serve1$8(DefaultAnnotatedService.java:386)
~[armeria-1.29.3.jar:?]
at java.util.concurrent.CompletableFuture$UniApply.tryFire(Unknown
Source) ~[?:?]
at java.util.concurrent.CompletableFuture$Completion.run(Unknown
Source) ~[?:?]
at
com.linecorp.armeria.common.DefaultContextAwareRunnable.run(DefaultContextAwareRunnable.java:45)
~[armeria-1.29.3.jar:?]
at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
~[?:?]
at java.util.concurrent.FutureTask.run(Unknown Source) ~[?:?]
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown
Source) ~[?:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
~[?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
~[?:?]
at
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
[netty-common-4.1.115.Final.jar:4.1.115.Final]
at java.lang.Thread.run(Unknown Source) [?:?]
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscr...@skywalking.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
