myname00707 opened a new issue #1971:
URL: https://github.com/apache/servicecomb-java-chassis/issues/1971
1,客户端调用服务端接口超时时间4.5s,客户端连接超时时间默认,30s,服务端连接超时时间默认,60s,微服务调用低概率报如下错误:
2020-09-23
10:11:04.493|[vert.x-eventloop-thread-4]|[ERROR]|[RestClientInvocation:]|Failed
to send request, local:10.33.8.68:34698, remote:/10.31.15.138:8083.
io.vertx.core.VertxException: Connection was closed
metric日志:
2020-09-23 10:11:22.812|[spectator-poller-0]|[INFO ]|[DefaultLogPublisher:]|
os:
cpu:
all usage: 4.47% all idle: 95.53% process: 0.90%
net:
send(Bps) recv(Bps) send(pps) recv(pps) interface
5.254K 5.229K 22 19 eth0
vertx:
instances:
name eventLoopContext-created
registry 0
registry-watch 0
transport 0
transport:
client.endpoints:
connectCount disconnectCount queue connections send(Bps)
receive(Bps) remote
3 2 0 3 6 100
10.31.15.199:7474
3 1 0 4 208 82
10.33.8.228:8083
3 1 0 3 197 68
10.33.8.139:8083
2 1 0 3 135 50
10.33.168.151:8082
2 0 0 4 202 57
10.31.19.112:8083
0 0 0 0 0 0
10.33.168.40:8085
3 2 0 3 201 55
10.31.15.138:8083
1 0 0 3 135 40
10.33.8.216:8082
2 3 0 2 102 32
10.31.19.202:8082
3 1 0 4 6 100
10.33.8.10:7474
3 3 0 3 135 57
10.31.15.110:8082
2 1 0 3 5 75
10.33.8.222:7474
4 2 0 4 6 100
10.31.15.211:7474
31 17 0 39 1.313K 820
(summary)
server.endpoints:
connectCount disconnectCount rejectByLimit connections send(Bps)
receive(Bps) listen
12 9 0 15 182 529
10.33.8.68:8099
12 9 0 15 182 529
(summary)
threadPool:
coreSize maxThreads poolSize currentBusy rejected queueSize taskCount
taskFinished name
25 200 25 0 NaN 0 0.1 0.1
cse.executor.groupThreadPool-group1
25 200 25 0 NaN 0 0.1 0.1
cse.executor.groupThreadPool-group0
consumer:
simple:
status tps latency [0,1000) [1000,2000) [2000,3000)
[3000,4000) [4000,) operation
rest.200 0.3 13.916/36.387 15 0 0 0
0 doNlu
0.3 8.898/17.948 15 0 0 0
0 findDeviceInfoByKeys
0.3 40.143/64.296 15 0 0 0
0 handleDialog
0.8 20.986/64.296 45 0 0 0
0 (summary)
rest.490 0.0 0.788/0.788 1 0 0 0
0 handleDialog
0.0 0.788/0.788 1 0 0 0
0 (summary)
0.0 0.000/0.000 0 0 0 0
0 (summary)
details:
rest.200:
doNlu:
prepare : 0.004/0.008 handlersReq : 0.098/0.117
cFiltersReq: 0.035/0.048 sendReq : 3.642/12.410
getConnect : 3.528/12.304 writeBuf : 0.114/0.124
waitResp : 10.091/34.637 wakeConsumer: 0.016/0.019
cFiltersResp: 0.022/0.026 handlersResp: 0.006/0.013
findDeviceInfoByKeys:
prepare : 0.003/0.007 handlersReq : 0.082/0.096
cFiltersReq: 0.014/0.019 sendReq : 4.984/11.360
getConnect : 4.920/11.297 writeBuf : 0.064/0.071
waitResp : 3.771/6.465 wakeConsumer: 0.017/0.025
cFiltersResp: 0.022/0.026 handlersResp: 0.005/0.013
handleDialog:
prepare : 0.004/0.014 handlersReq : 0.080/0.096
cFiltersReq: 0.042/0.049 sendReq : 3.889/9.272
getConnect : 3.773/9.154 writeBuf : 0.116/0.146
waitResp : 36.049/61.935 wakeConsumer: 0.017/0.021
cFiltersResp: 0.055/0.066 handlersResp: 0.008/0.023
rest.490:
handleDialog:
prepare : 0.003/0.003 handlersReq : 0.099/0.099
cFiltersReq: 0.043/0.043 sendReq : 0.254/0.254
getConnect : 0.040/0.040 writeBuf : 0.214/0.214
waitResp : 0.223/0.223 wakeConsumer: 0.001/0.001
cFiltersResp: 0.001/0.001 handlersResp: 0.164/0.164
rest.408:
producer:
simple:
status tps latency [0,1000) [1000,2000) [2000,3000)
[3000,4000) [4000,) operation
rest.200 0.3 71.894/99.427 15 0 0 0
0 event
0.3 71.894/99.427 15 0 0 0
0 (summary)
0.0 0.000/0.000 0 0 0 0
0 (summary)
details:
rest.200:
event:
prepare: 0.017/0.028 queue : 0.040/0.053
filtersReq : 0.557/0.600 handlersReq: 0.041/0.044
execute: 71.201/98.716 handlersResp: 0.008/0.010
filtersResp: 0.019/0.021 sendResp : 0.010/0.013
rest.400:
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]