HTFX-Cloud commented on issue #10965:
URL: https://github.com/apache/dubbo/issues/10965#issuecomment-1321559332
> 从日志上看是 provider 到 nacos 的心跳断开了，导致 nacos 推送该 provider 下线，但是有在途请求然后报错
>
> 可以检查下为什么 nacos 注册中心会推送下线信息
我看了一下nacos集群（130、131、132）三个节点上10.19日的naming.log文件。其中在10:27:04.914和10:27:20.508两个时间三个节点都存在
2022-10-19 10:27:04.914 INFO
[com.alibaba.nacos.client.naming.updater:client.naming] removed ips(1) service:
DEFAULT_GROUP@@providers:com.bonc.dataplatform.buw.dispatcher.api.IEngineService:5.0:public
->
[{"clusterName":"DEFAULT","enabled":true,"ephemeral":true,"healthy":true,"instanceHeartBeatInterval":5000,"instanceHeartBeatTimeOut":15000,"instanceId":"10.177.56.133#20882#DEFAULT#DEFAULT_GROUP@@providers:com.bonc.dataplatform.buw.dispatcher.api.IEngineService:5.0:public","ip":"10.177.56.133","ipDeleteTimeout":30000,"metadata":{"side":"provider","methods":"reRunTask,executeTask","release":"2.7.8","deprecated":"false","dubbo":"2.0.2","threads":"500","pid":"2378","interface":"com.bonc.dataplatform.buw.dispatcher.api.IEngineService","version":"5.0","generic":"false","timeout":"30000","revision":"5.3-MASTER-20220608.095739-141","path":"engineService","protocol":"dubbo","metadata-type":"remote","application":"dig-buw-dispatcher-app","payload":"104857600","dynamic":"true","category":"p
roviders","anyhost":"true","group":"public","timestamp":"1655987866520"},"port":20882,"serviceName":"DEFAULT_GROUP@@providers:com.bonc.dataplatform.buw.dispatcher.api.IEngineService:5.0:public","weight":1.0}]
和
2022-10-19 10:27:20.508 INFO
[com.alibaba.nacos.naming.push.receiver:client.naming] removed ips(1) service:
DEFAULT_GROUP@@providers:com.bonc.dataplatform.buw.dispatcher.api.IWorkflowWebService:5.0:public
->
[{"clusterName":"DEFAULT","enabled":true,"ephemeral":true,"healthy":true,"instanceHeartBeatInterval":5000,"instanceHeartBeatTimeOut":15000,"instanceId":"10.177.56.133#20882#DEFAULT#DEFAULT_GROUP@@providers:com.bonc.dataplatform.buw.dispatcher.api.IWorkflowWebService:5.0:public","ip":"10.177.56.133","ipDeleteTimeout":30000,"metadata":{"side":"provider","methods":"startLaunchedWorkflowByCode,restartWorkflows,restartWorkflowNew,resumeWorkflows,restartWorkflow,recoverWorkflowNew,resumeWorkflow,startLaunchedWorkflow,dealWithCacheRestart,suspendWorkflow,suspendWorkflows,reRunWorkflow,returnAuditTaskResult,dealWithCacheCrash,recoverWorkflows,startWorkflow,startScheduleWorkflow,executeTaskForTemp,returnCheckResult,doNodeStopForKill,returnTaskResult,getParamDefaultValue,killWarnWorkflo
ws,recoverWorkflow,dealParentWorkflow,killWorkflows","release":"2.7.8","deprecated":"false","dubbo":"2.0.2","threads":"500","pid":"2378","interface":"com.bonc.dataplatform.buw.dispatcher.api.IWorkflowWebService","version":"5.0","generic":"false","timeout":"30000","revision":"5.3-MASTER-20220608.095739-141","path":"WorkflowWebService","protocol":"dubbo","metadata-type":"remote","application":"dig-buw-dispatcher-app","payload":"104857600","dynamic":"true","category":"providers","anyhost":"true","group":"public","timestamp":"1655987866761"},"port":20882,"serviceName":"DEFAULT_GROUP@@providers:com.bonc.dataplatform.buw.dispatcher.api.IWorkflowWebService:5.0:public","weight":1.0}]摘除133节点（**也就是上文提到负载调用不平衡的A节点**）
并且在nacos集群中的132节点存在如下的日志
2022-10-19 10:27:05.066 INFO
[com.alibaba.nacos.naming.push.receiver:client.naming] received push data:
{"type":"dom","data":"{\"hosts\":[{\"ip\":\"10.177.56.132\",\"port\":20882,\"valid\":true,\"healthy\":true,\"marked\":false,\"instanceId\":\"10.177.56.132#20882#DEFAULT#DEFAULT_GROUP@@providers:a.b.c.bd.api.IEngineService:5.0:public\",\"metadata\":{\"side\":\"provider\",\"methods\":\"reRunTask,executeTask\",\"release\":\"2.7.8\",\"deprecated\":\"false\",\"dubbo\":\"2.0.2\",\"threads\":\"500\",\"pid\":\"53008\",\"interface\":\"a.b.c.bd.api.IEngineService\",\"version\":\"5.0\",\"generic\":\"false\",\"timeout\":\"30000\",\"revision\":\"5.3-MASTER-20220608.095739-141\",\"path\":\"engineService\",\"protocol\":\"dubbo\",\"metadata-type\":\"remote\",\"application\":\"dig-buw-dispatcher-app\",\"payload\":\"104857600\",\"dynamic\":\"true\",\"category\":\"providers\",\"anyhost\":\"true\",\"group\":\"public\",\"timestamp\":\"1655987760581\"},\"enabled\":true,\"weight\":1.0,\"clusterName\":
\"DEFAULT\",\"serviceName\":\"DEFAULT_GROUP@@providers:a.b.c.bd.api.IEngineService:5.0:public\",\"ephemeral\":true},{\"ip\":\"10.177.56.134\",\"port\":20881,\"valid\":true,\"healthy\":true,\"marked\":false,\"instanceId\":\"10.177.56.134#20881#DEFAULT#DEFAULT_GROUP@@providers:a.b.c.bd.api.IEngineService:5.0:public\",\"metadata\":{\"side\":\"provider\",\"methods\":\"reRunTask,executeTask\",\"release\":\"2.7.8\",\"deprecated\":\"false\",\"dubbo\":\"2.0.2\",\"threads\":\"500\",\"pid\":\"31262\",\"interface\":\"a.b.c.bd.api.IEngineService\",\"version\":\"5.0\",\"generic\":\"false\",\"timeout\":\"30000\",\"revision\":\"5.3-MASTER-20220608.095739-141\",\"path\":\"engineService\",\"protocol\":\"dubbo\",\"metadata-type\":\"remote\",\"application\":\"dig-buw-dispatcher-app\",\"payload\":\"104857600\",\"dynamic\":\"true\",\"category\":\"providers\",\"anyhost\":\"true\",\"group\":\"public\",\"timestamp\":\"1655987989629\"},\"enabled\":true,\"weight\":1.0,\"clusterName\":\"DEFAULT\",\"serviceNam
e\":\"DEFAULT_GROUP@@providers:a.b.c.bd.api.IEngineService:5.0:public\",\"ephemeral\":true},{\"ip\":\"10.177.56.135\",\"port\":20881,\"valid\":true,\"healthy\":true,\"marked\":false,\"instanceId\":\"10.177.56.135#20881#DEFAULT#DEFAULT_GROUP@@providers:a.b.c.bd.api.IEngineService:5.0:public\",\"metadata\":{\"side\":\"provider\",\"methods\":\"reRunTask,executeTask\",\"release\":\"2.7.8\",\"deprecated\":\"false\",\"dubbo\":\"2.0.2\",\"threads\":\"500\",\"pid\":\"56132\",\"interface\":\"a.b.c.bd.api.IEngineService\",\"version\":\"5.0\",\"generic\":\"false\",\"timeout\":\"30000\",\"revision\":\"5.3-MASTER-20220608.095739-141\",\"path\":\"engineService\",\"protocol\":\"dubbo\",\"metadata-type\":\"remote\",\"application\":\"dig-buw-dispatcher-app\",\"payload\":\"104857600\",\"dynamic\":\"true\",\"category\":\"providers\",\"anyhost\":\"true\",\"group\":\"public\",\"timestamp\":\"1655988109440\"},\"enabled\":true,\"weight\":1.0,\"clusterName\":\"DEFAULT\",\"serviceName\":\"DEFAULT_GROUP@@pro
viders:a.b.c.bd.api.IEngineService:5.0:public\",\"ephemeral\":true}],\"dom\":\"DEFAULT_GROUP@@providers:a.b.c.bd.api.IEngineService:5.0:public\",\"name\":\"DEFAULT_GROUP@@providers:a.b.c.bd.api.IEngineService:5.0:public\",\"cacheMillis\":10000,\"lastRefTime\":1666146425065,\"checksum\":\"9190a7c1dcdb5fce2375f5282bd116ae\",\"useSpecifiedURL\":false,\"clusters\":\"\",\"env\":\"\",\"metadata\":{}}","lastRefTime":56135268660146131}
from /10.177.56.132
2022-10-19 10:27:05.066 INFO
[com.alibaba.nacos.naming.push.receiver:client.naming] received push data:
{"type":"dom","data":"{\"hosts\":[{\"ip\":\"10.177.56.132\",\"port\":20882,\"valid\":true,\"healthy\":true,\"marked\":false,\"instanceId\":\"10.177.56.132#20882#DEFAULT#DEFAULT_GROUP@@providers:a.b.c.bd.api.IEngineService:5.0:public\",\"metadata\":{\"side\":\"provider\",\"methods\":\"reRunTask,executeTask\",\"release\":\"2.7.8\",\"deprecated\":\"false\",\"dubbo\":\"2.0.2\",\"threads\":\"500\",\"pid\":\"53008\",\"interface\":\"a.b.c.bd.api.IEngineService\",\"version\":\"5.0\",\"generic\":\"false\",\"timeout\":\"30000\",\"revision\":\"5.3-MASTER-20220608.095739-141\",\"path\":\"engineService\",\"protocol\":\"dubbo\",\"metadata-type\":\"remote\",\"application\":\"dig-buw-dispatcher-app\",\"payload\":\"104857600\",\"dynamic\":\"true\",\"category\":\"providers\",\"anyhost\":\"true\",\"group\":\"public\",\"timestamp\":\"1655987760581\"},\"enabled\":true,\"weight\":1.0,\"clusterName\":
\"DEFAULT\",\"serviceName\":\"DEFAULT_GROUP@@providers:a.b.c.bd.api.IEngineService:5.0:public\",\"ephemeral\":true},{\"ip\":\"10.177.56.134\",\"port\":20881,\"valid\":true,\"healthy\":true,\"marked\":false,\"instanceId\":\"10.177.56.134#20881#DEFAULT#DEFAULT_GROUP@@providers:a.b.c.bd.api.IEngineService:5.0:public\",\"metadata\":{\"side\":\"provider\",\"methods\":\"reRunTask,executeTask\",\"release\":\"2.7.8\",\"deprecated\":\"false\",\"dubbo\":\"2.0.2\",\"threads\":\"500\",\"pid\":\"31262\",\"interface\":\"a.b.c.bd.api.IEngineService\",\"version\":\"5.0\",\"generic\":\"false\",\"timeout\":\"30000\",\"revision\":\"5.3-MASTER-20220608.095739-141\",\"path\":\"engineService\",\"protocol\":\"dubbo\",\"metadata-type\":\"remote\",\"application\":\"dig-buw-dispatcher-app\",\"payload\":\"104857600\",\"dynamic\":\"true\",\"category\":\"providers\",\"anyhost\":\"true\",\"group\":\"public\",\"timestamp\":\"1655987989629\"},\"enabled\":true,\"weight\":1.0,\"clusterName\":\"DEFAULT\",\"serviceNam
e\":\"DEFAULT_GROUP@@providers:a.b.c.bd.api.IEngineService:5.0:public\",\"ephemeral\":true},{\"ip\":\"10.177.56.135\",\"port\":20881,\"valid\":true,\"healthy\":true,\"marked\":false,\"instanceId\":\"10.177.56.135#20881#DEFAULT#DEFAULT_GROUP@@providers:a.b.c.bd.api.IEngineService:5.0:public\",\"metadata\":{\"side\":\"provider\",\"methods\":\"reRunTask,executeTask\",\"release\":\"2.7.8\",\"deprecated\":\"false\",\"dubbo\":\"2.0.2\",\"threads\":\"500\",\"pid\":\"56132\",\"interface\":\"a.b.c.bd.api.IEngineService\",\"version\":\"5.0\",\"generic\":\"false\",\"timeout\":\"30000\",\"revision\":\"5.3-MASTER-20220608.095739-141\",\"path\":\"engineService\",\"protocol\":\"dubbo\",\"metadata-type\":\"remote\",\"application\":\"dig-buw-dispatcher-app\",\"payload\":\"104857600\",\"dynamic\":\"true\",\"category\":\"providers\",\"anyhost\":\"true\",\"group\":\"public\",\"timestamp\":\"1655988109440\"},\"enabled\":true,\"weight\":1.0,\"clusterName\":\"DEFAULT\",\"serviceName\":\"DEFAULT_GROUP@@pro
viders:a.b.c.bd.api.IEngineService:5.0:public\",\"ephemeral\":true}],\"dom\":\"DEFAULT_GROUP@@providers:a.b.c.bd.api.IEngineService:5.0:public\",\"name\":\"DEFAULT_GROUP@@providers:a.b.c.bd.api.IEngineService:5.0:public\",\"cacheMillis\":10000,\"lastRefTime\":1666146425067,\"checksum\":\"9190a7c1dcdb5fce2375f5282bd116ae\",\"useSpecifiedURL\":false,\"clusters\":\"\",\"env\":\"\",\"metadata\":{}}","lastRefTime":56135268660146131}
from /10.177.56.132
2022-10-19 10:27:05.085 INFO
[com.alibaba.nacos.naming.push.receiver:client.naming] removed ips(1) service:
DEFAULT_GROUP@@providers:a.b.c.bd.api.IEngineService:5.0:public ->
[{"instanceId":"10.177.56.133#20882#DEFAULT#DEFAULT_GROUP@@providers:a.b.c.bd.api.IEngineService:5.0:public","ip":"10.177.56.133","port":20882,"weight":1.0,"healthy":true,"enabled":true,"ephemeral":true,"clusterName":"DEFAULT","serviceName":"DEFAULT_GROUP@@providers:a.b.c.bd.api.IEngineService:5.0:public","metadata":{"side":"provider","methods":"reRunTask,executeTask","release":"2.7.8","deprecated":"false","dubbo":"2.0.2","threads":"500","pid":"2378","interface":"a.b.c.bd.api.IEngineService","version":"5.0","generic":"false","timeout":"30000","revision":"5.3-MASTER-20220608.095739-141","path":"engineService","protocol":"dubbo","metadata-type":"remote","application":"dig-buw-dispatcher-app","payload":"104857600","dynamic":"true","category":"providers","anyhost":"true","group":"public","timestamp":"165598786652
0"},"ipDeleteTimeout":30000,"instanceHeartBeatInterval":5000,"instanceHeartBeatTimeOut":15000}]
2022-10-19 10:27:05.085 INFO
[com.alibaba.nacos.naming.push.receiver:client.naming] removed ips(1) service:
DEFAULT_GROUP@@providers:a.b.c.bd.api.IEngineService:5.0:public ->
[{"instanceId":"10.177.56.133#20882#DEFAULT#DEFAULT_GROUP@@providers:a.b.c.bd.api.IEngineService:5.0:public","ip":"10.177.56.133","port":20882,"weight":1.0,"healthy":true,"enabled":true,"ephemeral":true,"clusterName":"DEFAULT","serviceName":"DEFAULT_GROUP@@providers:a.b.c.bd.api.IEngineService:5.0:public","metadata":{"side":"provider","methods":"reRunTask,executeTask","release":"2.7.8","deprecated":"false","dubbo":"2.0.2","threads":"500","pid":"2378","interface":"a.b.c.bd.api.IEngineService","version":"5.0","generic":"false","timeout":"30000","revision":"5.3-MASTER-20220608.095739-141","path":"engineService","protocol":"dubbo","metadata-type":"remote","application":"dig-buw-dispatcher-app","payload":"104857600","dynamic":"true","category":"providers","anyhost":"true","group":"public","timestamp":"165598786652
0"},"ipDeleteTimeout":30000,"instanceHeartBeatInterval":5000,"instanceHeartBeatTimeOut":15000}]
2022-10-19 10:27:05.086 INFO
[com.alibaba.nacos.naming.push.receiver:client.naming] current ips:(3) service:
DEFAULT_GROUP@@providers:a.b.c.bd.api.IEngineService:5.0:public ->
[{"instanceId":"10.177.56.132#20882#DEFAULT#DEFAULT_GROUP@@providers:a.b.c.bd.api.IEngineService:5.0:public","ip":"10.177.56.132","port":20882,"weight":1.0,"healthy":true,"enabled":true,"ephemeral":true,"clusterName":"DEFAULT","serviceName":"DEFAULT_GROUP@@providers:a.b.c.bd.api.IEngineService:5.0:public","metadata":{"side":"provider","methods":"reRunTask,executeTask","release":"2.7.8","deprecated":"false","dubbo":"2.0.2","threads":"500","pid":"53008","interface":"a.b.c.bd.api.IEngineService","version":"5.0","generic":"false","timeout":"30000","revision":"5.3-MASTER-20220608.095739-141","path":"engineService","protocol":"dubbo","metadata-type":"remote","application":"dig-buw-dispatcher-app","payload":"104857600","dynamic":"true","category":"providers","anyhost":"true","group":"public","timestamp":"1655987760
581"},"ipDeleteTimeout":30000,"instanceHeartBeatInterval":5000,"instanceHeartBeatTimeOut":15000},{"instanceId":"10.177.56.134#20881#DEFAULT#DEFAULT_GROUP@@providers:a.b.c.bd.api.IEngineService:5.0:public","ip":"10.177.56.134","port":20881,"weight":1.0,"healthy":true,"enabled":true,"ephemeral":true,"clusterName":"DEFAULT","serviceName":"DEFAULT_GROUP@@providers:a.b.c.bd.api.IEngineService:5.0:public","metadata":{"side":"provider","methods":"reRunTask,executeTask","release":"2.7.8","deprecated":"false","dubbo":"2.0.2","threads":"500","pid":"31262","interface":"a.b.c.bd.api.IEngineService","version":"5.0","generic":"false","timeout":"30000","revision":"5.3-MASTER-20220608.095739-141","path":"engineService","protocol":"dubbo","metadata-type":"remote","application":"dig-buw-dispatcher-app","payload":"104857600","dynamic":"true","category":"providers","anyhost":"true","group":"public","timestamp":"1655987989629"},"ipDeleteTimeout":30000,"instanceHeartBeatInterval":5000,"instanceHeartBeatT
imeOut":15000},{"instanceId":"10.177.56.135#20881#DEFAULT#DEFAULT_GROUP@@providers:a.b.c.bd.api.IEngineService:5.0:public","ip":"10.177.56.135","port":20881,"weight":1.0,"healthy":true,"enabled":true,"ephemeral":true,"clusterName":"DEFAULT","serviceName":"DEFAULT_GROUP@@providers:a.b.c.bd.api.IEngineService:5.0:public","metadata":{"side":"provider","methods":"reRunTask,executeTask","release":"2.7.8","deprecated":"false","dubbo":"2.0.2","threads":"500","pid":"56132","interface":"a.b.c.bd.api.IEngineService","version":"5.0","generic":"false","timeout":"30000","revision":"5.3-MASTER-20220608.095739-141","path":"engineService","protocol":"dubbo","metadata-type":"remote","application":"dig-buw-dispatcher-app","payload":"104857600","dynamic":"true","category":"providers","anyhost":"true","group":"public","timestamp":"1655988109440"},"ipDeleteTimeout":30000,"instanceHeartBeatInterval":5000,"instanceHeartBeatTimeOut":15000}]
2022-10-19 10:27:05.529 WARN
[com.alibaba.nacos.naming.push.receiver:client.naming] write
DEFAULT_GROUP%40%40providers%3Aa.b.c.bd.api.IEngineService%3A5.0%3Apublic
conflict;retry time: 1
2022-10-19 10:27:05.529 INFO
[com.alibaba.nacos.naming.push.receiver:client.naming] current ips:(3) service:
DEFAULT_GROUP@@providers:a.b.c.bd.api.IEngineService:5.0:public ->
[{"instanceId":"10.177.56.132#20882#DEFAULT#DEFAULT_GROUP@@providers:a.b.c.bd.api.IEngineService:5.0:public","ip":"10.177.56.132","port":20882,"weight":1.0,"healthy":true,"enabled":true,"ephemeral":true,"clusterName":"DEFAULT","serviceName":"DEFAULT_GROUP@@providers:a.b.c.bd.api.IEngineService:5.0:public","metadata":{"side":"provider","methods":"reRunTask,executeTask","release":"2.7.8","deprecated":"false","dubbo":"2.0.2","threads":"500","pid":"53008","interface":"a.b.c.bd.api.IEngineService","version":"5.0","generic":"false","timeout":"30000","revision":"5.3-MASTER-20220608.095739-141","path":"engineService","protocol":"dubbo","metadata-type":"remote","application":"dig-buw-dispatcher-app","payload":"104857600","dynamic":"true","category":"providers","anyhost":"true","group":"public","timestamp":"1655987760
581"},"ipDeleteTimeout":30000,"instanceHeartBeatInterval":5000,"instanceHeartBeatTimeOut":15000},{"instanceId":"10.177.56.134#20881#DEFAULT#DEFAULT_GROUP@@providers:a.b.c.bd.api.IEngineService:5.0:public","ip":"10.177.56.134","port":20881,"weight":1.0,"healthy":true,"enabled":true,"ephemeral":true,"clusterName":"DEFAULT","serviceName":"DEFAULT_GROUP@@providers:a.b.c.bd.api.IEngineService:5.0:public","metadata":{"side":"provider","methods":"reRunTask,executeTask","release":"2.7.8","deprecated":"false","dubbo":"2.0.2","threads":"500","pid":"31262","interface":"a.b.c.bd.api.IEngineService","version":"5.0","generic":"false","timeout":"30000","revision":"5.3-MASTER-20220608.095739-141","path":"engineService","protocol":"dubbo","metadata-type":"remote","application":"dig-buw-dispatcher-app","payload":"104857600","dynamic":"true","category":"providers","anyhost":"true","group":"public","timestamp":"1655987989629"},"ipDeleteTimeout":30000,"instanceHeartBeatInterval":5000,"instanceHeartBeatT
imeOut":15000},{"instanceId":"10.177.56.135#20881#DEFAULT#DEFAULT_GROUP@@providers:a.b.c.bd.api.IEngineService:5.0:public","ip":"10.177.56.135","port":20881,"weight":1.0,"healthy":true,"enabled":true,"ephemeral":true,"clusterName":"DEFAULT","serviceName":"DEFAULT_GROUP@@providers:a.b.c.bd.api.IEngineService:5.0:public","metadata":{"side":"provider","methods":"reRunTask,executeTask","release":"2.7.8","deprecated":"false","dubbo":"2.0.2","threads":"500","pid":"56132","interface":"a.b.c.bd.api.IEngineService","version":"5.0","generic":"false","timeout":"30000","revision":"5.3-MASTER-20220608.095739-141","path":"engineService","protocol":"dubbo","metadata-type":"remote","application":"dig-buw-dispatcher-app","payload":"104857600","dynamic":"true","category":"providers","anyhost":"true","group":"public","timestamp":"1655988109440"},"ipDeleteTimeout":30000,"instanceHeartBeatInterval":5000,"instanceHeartBeatTimeOut":15000}]
2022-10-19 10:27:20.858 INFO
[com.alibaba.nacos.naming.push.receiver:client.naming] received push data:
{"type":"dom","data":"{\"hosts\":[{\"ip\":\"10.177.56.132\",\"port\":20882,\"valid\":true,\"healthy\":true,\"marked\":false,\"instanceId\":\"10.177.56.132#20882#DEFAULT#DEFAULT_GROUP@@providers:a.b.c.bd.api.IWorkflowWebService:5.0:public\",\"metadata\":{\"side\":\"provider\",\"methods\":\"startLaunchedWorkflowByCode,restartWorkflows,restartWorkflowNew,resumeWorkflows,restartWorkflow,recoverWorkflowNew,resumeWorkflow,startLaunchedWorkflow,dealWithCacheRestart,suspendWorkflow,suspendWorkflows,reRunWorkflow,returnAuditTaskResult,dealWithCacheCrash,recoverWorkflows,executeTaskForTemp,startWorkflow,startScheduleWorkflow,returnCheckResult,doNodeStopForKill,returnTaskResult,getParamDefaultValue,killWarnWorkflows,recoverWorkflow,dealParentWorkflow,killWorkflows\",\"release\":\"2.7.8\",\"deprecated\":\"false\",\"dubbo\":\"2.0.2\",\"threads\":\"500\",\"pid\":\"53008\",\"interface\":\"a.b.
c.bd.api.IWorkflowWebService\",\"version\":\"5.0\",\"generic\":\"false\",\"timeout\":\"30000\",\"revision\":\"5.3-MASTER-20220608.095739-141\",\"path\":\"WorkflowWebService\",\"protocol\":\"dubbo\",\"metadata-type\":\"remote\",\"application\":\"dig-buw-dispatcher-app\",\"payload\":\"104857600\",\"dynamic\":\"true\",\"category\":\"providers\",\"anyhost\":\"true\",\"group\":\"public\",\"timestamp\":\"1655987760900\"},\"enabled\":true,\"weight\":1.0,\"clusterName\":\"DEFAULT\",\"serviceName\":\"DEFAULT_GROUP@@providers:a.b.c.bd.api.IWorkflowWebService:5.0:public\",\"ephemeral\":true},{\"ip\":\"10.177.56.134\",\"port\":20881,\"valid\":true,\"healthy\":true,\"marked\":false,\"instanceId\":\"10.177.56.134#20881#DEFAULT#DEFAULT_GROUP@@providers:a.b.c.bd.api.IWorkflowWebService:5.0:public\",\"metadata\":{\"side\":\"provider\",\"methods\":\"startLaunchedWorkflowByCode,restartWorkflows,restartWorkflowNew,resumeWorkflows,restartWorkflow,recoverWorkflowNew,resumeWorkflow,startLaunchedWorkflow,d
ealWithCacheRestart,suspendWorkflow,suspendWorkflows,reRunWorkflow,returnAuditTaskResult,dealWithCacheCrash,recoverWorkflows,executeTaskForTemp,startWorkflow,startScheduleWorkflow,returnCheckResult,doNodeStopForKill,returnTaskResult,getParamDefaultValue,killWarnWorkflows,recoverWorkflow,dealParentWorkflow,killWorkflows\",\"release\":\"2.7.8\",\"deprecated\":\"false\",\"dubbo\":\"2.0.2\",\"threads\":\"500\",\"pid\":\"31262\",\"interface\":\"a.b.c.bd.api.IWorkflowWebService\",\"version\":\"5.0\",\"generic\":\"false\",\"timeout\":\"30000\",\"revision\":\"5.3-MASTER-20220608.095739-141\",\"path\":\"WorkflowWebService\",\"protocol\":\"dubbo\",\"metadata-type\":\"remote\",\"application\":\"dig-buw-dispatcher-app\",\"payload\":\"104857600\",\"dynamic\":\"true\",\"category\":\"providers\",\"anyhost\":\"true\",\"group\":\"public\",\"timestamp\":\"1655987989873\"},\"enabled\":true,\"weight\":1.0,\"clusterName\":\"DEFAULT\",\"serviceName\":\"DEFAULT_GROUP@@providers:a.b.c.bd.api.IWorkflowWebSe
rvice:5.0:public\",\"ephemeral\":true},{\"ip\":\"10.177.56.135\",\"port\":20881,\"valid\":true,\"healthy\":true,\"marked\":false,\"instanceId\":\"10.177.56.135#20881#DEFAULT#DEFAULT_GROUP@@providers:a.b.c.bd.api.IWorkflowWebService:5.0:public\",\"metadata\":{\"side\":\"provider\",\"methods\":\"startLaunchedWorkflowByCode,restartWorkflows,restartWorkflowNew,resumeWorkflows,restartWorkflow,recoverWorkflowNew,resumeWorkflow,startLaunchedWorkflow,dealWithCacheRestart,suspendWorkflow,suspendWorkflows,reRunWorkflow,returnAuditTaskResult,dealWithCacheCrash,recoverWorkflows,executeTaskForTemp,startWorkflow,startScheduleWorkflow,returnCheckResult,doNodeStopForKill,returnTaskResult,getParamDefaultValue,killWarnWorkflows,recoverWorkflow,dealParentWorkflow,killWorkflows\",\"release\":\"2.7.8\",\"deprecated\":\"false\",\"dubbo\":\"2.0.2\",\"threads\":\"500\",\"pid\":\"56132\",\"interface\":\"a.b.c.bd.api.IWorkflowWebService\",\"version\":\"5.0\",\"generic\":\"false\",\"timeout\":\"30000\",\"revi
sion\":\"5.3-MASTER-20220608.095739-141\",\"path\":\"WorkflowWebService\",\"protocol\":\"dubbo\",\"metadata-type\":\"remote\",\"application\":\"dig-buw-dispatcher-app\",\"payload\":\"104857600\",\"dynamic\":\"true\",\"category\":\"providers\",\"anyhost\":\"true\",\"group\":\"public\",\"timestamp\":\"1655988109818\"},\"enabled\":true,\"weight\":1.0,\"clusterName\":\"DEFAULT\",\"serviceName\":\"DEFAULT_GROUP@@providers:a.b.c.bd.api.IWorkflowWebService:5.0:public\",\"ephemeral\":true}],\"dom\":\"DEFAULT_GROUP@@providers:a.b.c.bd.api.IWorkflowWebService:5.0:public\",\"name\":\"DEFAULT_GROUP@@providers:a.b.c.bd.api.IWorkflowWebService:5.0:public\",\"cacheMillis\":10000,\"lastRefTime\":1666146440499,\"checksum\":\"aef2359632324193f6bbced5589e6846\",\"useSpecifiedURL\":false,\"clusters\":\"\",\"env\":\"\",\"metadata\":{}}","lastRefTime":56135284087143858}
from /10.177.56.132
2022-10-19 10:27:20.859 INFO
[com.alibaba.nacos.naming.push.receiver:client.naming] removed ips(1) service:
DEFAULT_GROUP@@providers:a.b.c.bd.api.IWorkflowWebService:5.0:public ->
[{"instanceId":"10.177.56.133#20882#DEFAULT#DEFAULT_GROUP@@providers:a.b.c.bd.api.IWorkflowWebService:5.0:public","ip":"10.177.56.133","port":20882,"weight":1.0,"healthy":true,"enabled":true,"ephemeral":true,"clusterName":"DEFAULT","serviceName":"DEFAULT_GROUP@@providers:a.b.c.bd.api.IWorkflowWebService:5.0:public","metadata":{"side":"provider","methods":"startLaunchedWorkflowByCode,restartWorkflows,restartWorkflowNew,resumeWorkflows,restartWorkflow,recoverWorkflowNew,resumeWorkflow,startLaunchedWorkflow,dealWithCacheRestart,suspendWorkflow,suspendWorkflows,reRunWorkflow,returnAuditTaskResult,dealWithCacheCrash,recoverWorkflows,startWorkflow,startScheduleWorkflow,executeTaskForTemp,returnCheckResult,doNodeStopForKill,returnTaskResult,getParamDefaultValue,killWarnWorkflows,recoverWorkflow,dealParentWorkfl
ow,killWorkflows","release":"2.7.8","deprecated":"false","dubbo":"2.0.2","threads":"500","pid":"2378","interface":"a.b.c.bd.api.IWorkflowWebService","version":"5.0","generic":"false","timeout":"30000","revision":"5.3-MASTER-20220608.095739-141","path":"WorkflowWebService","protocol":"dubbo","metadata-type":"remote","application":"dig-buw-dispatcher-app","payload":"104857600","dynamic":"true","category":"providers","anyhost":"true","group":"public","timestamp":"1655987866761"},"ipDeleteTimeout":30000,"instanceHeartBeatInterval":5000,"instanceHeartBeatTimeOut":15000}]
2022-10-19 10:27:20.860 INFO
[com.alibaba.nacos.naming.push.receiver:client.naming] current ips:(3) service:
DEFAULT_GROUP@@providers:a.b.c.bd.api.IWorkflowWebService:5.0:public ->
[{"instanceId":"10.177.56.132#20882#DEFAULT#DEFAULT_GROUP@@providers:a.b.c.bd.api.IWorkflowWebService:5.0:public","ip":"10.177.56.132","port":20882,"weight":1.0,"healthy":true,"enabled":true,"ephemeral":true,"clusterName":"DEFAULT","serviceName":"DEFAULT_GROUP@@providers:a.b.c.bd.api.IWorkflowWebService:5.0:public","metadata":{"side":"provider","methods":"startLaunchedWorkflowByCode,restartWorkflows,restartWorkflowNew,resumeWorkflows,restartWorkflow,recoverWorkflowNew,resumeWorkflow,startLaunchedWorkflow,dealWithCacheRestart,suspendWorkflow,suspendWorkflows,reRunWorkflow,returnAuditTaskResult,dealWithCacheCrash,recoverWorkflows,executeTaskForTemp,startWorkflow,startScheduleWorkflow,returnCheckResult,doNodeStopForKill,returnTaskResult,getParamDefaultValue,killWarnWorkflows,recoverWorkflow,dealParentWorkf
low,killWorkflows","release":"2.7.8","deprecated":"false","dubbo":"2.0.2","threads":"500","pid":"53008","interface":"a.b.c.bd.api.IWorkflowWebService","version":"5.0","generic":"false","timeout":"30000","revision":"5.3-MASTER-20220608.095739-141","path":"WorkflowWebService","protocol":"dubbo","metadata-type":"remote","application":"dig-buw-dispatcher-app","payload":"104857600","dynamic":"true","category":"providers","anyhost":"true","group":"public","timestamp":"1655987760900"},"ipDeleteTimeout":30000,"instanceHeartBeatInterval":5000,"instanceHeartBeatTimeOut":15000},{"instanceId":"10.177.56.134#20881#DEFAULT#DEFAULT_GROUP@@providers:a.b.c.bd.api.IWorkflowWebService:5.0:public","ip":"10.177.56.134","port":20881,"weight":1.0,"healthy":true,"enabled":true,"ephemeral":true,"clusterName":"DEFAULT","serviceName":"DEFAULT_GROUP@@providers:a.b.c.bd.api.IWorkflowWebService:5.0:public","metadata":{"side":"provider","methods":"startLaunchedWorkflowByCode,restartWorkflows,restartWorkflowNew,re
sumeWorkflows,restartWorkflow,recoverWorkflowNew,resumeWorkflow,startLaunchedWorkflow,dealWithCacheRestart,suspendWorkflow,suspendWorkflows,reRunWorkflow,returnAuditTaskResult,dealWithCacheCrash,recoverWorkflows,executeTaskForTemp,startWorkflow,startScheduleWorkflow,returnCheckResult,doNodeStopForKill,returnTaskResult,getParamDefaultValue,killWarnWorkflows,recoverWorkflow,dealParentWorkflow,killWorkflows","release":"2.7.8","deprecated":"false","dubbo":"2.0.2","threads":"500","pid":"31262","interface":"a.b.c.bd.api.IWorkflowWebService","version":"5.0","generic":"false","timeout":"30000","revision":"5.3-MASTER-20220608.095739-141","path":"WorkflowWebService","protocol":"dubbo","metadata-type":"remote","application":"dig-buw-dispatcher-app","payload":"104857600","dynamic":"true","category":"providers","anyhost":"true","group":"public","timestamp":"1655987989873"},"ipDeleteTimeout":30000,"instanceHeartBeatInterval":5000,"instanceHeartBeatTimeOut":15000},{"instanceId":"10.177.56.135#2088
1#DEFAULT#DEFAULT_GROUP@@providers:a.b.c.bd.api.IWorkflowWebService:5.0:public","ip":"10.177.56.135","port":20881,"weight":1.0,"healthy":true,"enabled":true,"ephemeral":true,"clusterName":"DEFAULT","serviceName":"DEFAULT_GROUP@@providers:a.b.c.bd.api.IWorkflowWebService:5.0:public","metadata":{"side":"provider","methods":"startLaunchedWorkflowByCode,restartWorkflows,restartWorkflowNew,resumeWorkflows,restartWorkflow,recoverWorkflowNew,resumeWorkflow,startLaunchedWorkflow,dealWithCacheRestart,suspendWorkflow,suspendWorkflows,reRunWorkflow,returnAuditTaskResult,dealWithCacheCrash,recoverWorkflows,executeTaskForTemp,startWorkflow,startScheduleWorkflow,returnCheckResult,doNodeStopForKill,returnTaskResult,getParamDefaultValue,killWarnWorkflows,recoverWorkflow,dealParentWorkflow,killWorkflows","release":"2.7.8","deprecated":"false","dubbo":"2.0.2","threads":"500","pid":"56132","interface":"a.b.c.bd.api.IWorkflowWebService","version":"5.0","generic":"false","timeout":"30000","revision":"5.
3-MASTER-20220608.095739-141","path":"WorkflowWebService","protocol":"dubbo","metadata-type":"remote","application":"dig-buw-dispatcher-app","payload":"104857600","dynamic":"true","category":"providers","anyhost":"true","group":"public","timestamp":"1655988109818"},"ipDeleteTimeout":30000,"instanceHeartBeatInterval":5000,"instanceHeartBeatTimeOut":15000}]
2022-10-19 11:36:36.582 WARN
[com.alibaba.nacos.client.naming.updater:client.naming] failed to request
http://10.177.56.130:9908/nacos/v1/ns/instance/list?app=unknown&healthyOnly=false&namespaceId=10_177_37_101_hh_process_cjzh_src_realtime&clientIP=10.177.56.132&serviceName=DEFAULT_GROUP%40%40providers%3Acom.bonc.dataplatform.buw.executor.api.ITaskService%3A5.0%3AshellScript&udpPort=51084&encoding=UTF-8
from 10.177.56.130
2022-10-19 11:36:36.583 WARN
[com.alibaba.nacos.client.naming.updater:client.naming] failed to request
http://10.177.56.130:9908/nacos/v1/ns/instance/list?app=unknown&healthyOnly=false&namespaceId=10_177_37_111_hh_process_cjzh_src_realtime&clientIP=10.177.56.132&serviceName=DEFAULT_GROUP%40%40providers%3Acom.bonc.dataplatform.buw.executor.api.ITaskService%3A5.0%3AshellScript&udpPort=48579&encoding=UTF-8
from 10.177.56.130
2022-10-19 11:36:36.583 ERROR
[com.alibaba.nacos.client.naming.updater:client.naming] [NA] failed to request
java.net.SocketTimeoutException: connect timed out
at java.net.PlainSocketImpl.socketConnect(Native Method) ~[?:1.8.0_181]
at
java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
~[?:1.8.0_181]
at
java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
~[?:1.8.0_181]
at
java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
~[?:1.8.0_181]
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
~[?:1.8.0_181]
at java.net.Socket.connect(Socket.java:589) ~[?:1.8.0_181]
at sun.net.NetworkClient.doConnect(NetworkClient.java:175)
~[?:1.8.0_181]
at sun.net.www.http.HttpClient.openServer(HttpClient.java:463)
~[?:1.8.0_181]
at sun.net.www.http.HttpClient.openServer(HttpClient.java:558)
~[?:1.8.0_181]
at sun.net.www.http.HttpClient.<init>(HttpClient.java:242)
~[?:1.8.0_181]
at sun.net.www.http.HttpClient.New(HttpClient.java:339) ~[?:1.8.0_181]
at sun.net.www.http.HttpClient.New(HttpClient.java:357) ~[?:1.8.0_181]
at
sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1220)
~[?:1.8.0_181]
at
sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1156)
~[?:1.8.0_181]
at
sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:1050)
~[?:1.8.0_181]
at
sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:984)
~[?:1.8.0_181]
at
com.alibaba.nacos.client.naming.net.HttpClient.request(HttpClient.java:86)
~[nacos-client-1.3.0.jar:?]
at
com.alibaba.nacos.client.naming.net.NamingProxy.callServer(NamingProxy.java:432)
~[nacos-client-1.3.0.jar:?]
at
com.alibaba.nacos.client.naming.net.NamingProxy.reqAPI(NamingProxy.java:467)
~[nacos-client-1.3.0.jar:?]
at
com.alibaba.nacos.client.naming.net.NamingProxy.reqAPI(NamingProxy.java:400)
~[nacos-client-1.3.0.jar:?]
at
com.alibaba.nacos.client.naming.net.NamingProxy.reqAPI(NamingProxy.java:396)
~[nacos-client-1.3.0.jar:?]
at
com.alibaba.nacos.client.naming.net.NamingProxy.queryList(NamingProxy.java:321)
~[nacos-client-1.3.0.jar:?]
at
com.alibaba.nacos.client.naming.core.HostReactor.updateServiceNow(HostReactor.java:282)
~[nacos-client-1.3.0.jar:?]
at
com.alibaba.nacos.client.naming.core.HostReactor$UpdateTask.run(HostReactor.java:330)
~[nacos-client-1.3.0.jar:?]
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
~[?:1.8.0_181]
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
~[?:1.8.0_181]
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
~[?:1.8.0_181]
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
~[?:1.8.0_181]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
~[?:1.8.0_181]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
~[?:1.8.0_181]
at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_181]
2022-10-19 11:36:36.584 ERROR
[com.alibaba.nacos.client.naming.updater:client.naming] [NA] failed to request
java.net.SocketTimeoutException: connect timed out
at java.net.PlainSocketImpl.socketConnect(Native Method) ~[?:1.8.0_181]
at
java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
~[?:1.8.0_181]
at
java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
~[?:1.8.0_181]
at
java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
~[?:1.8.0_181]
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
~[?:1.8.0_181]
at java.net.Socket.connect(Socket.java:589) ~[?:1.8.0_181]
at sun.net.NetworkClient.doConnect(NetworkClient.java:175)
~[?:1.8.0_181]
at sun.net.www.http.HttpClient.openServer(HttpClient.java:463)
~[?:1.8.0_181]
at sun.net.www.http.HttpClient.openServer(HttpClient.java:558)
~[?:1.8.0_181]
at sun.net.www.http.HttpClient.<init>(HttpClient.java:242)
~[?:1.8.0_181]
at sun.net.www.http.HttpClient.New(HttpClient.java:339) ~[?:1.8.0_181]
at sun.net.www.http.HttpClient.New(HttpClient.java:357) ~[?:1.8.0_181]
at
sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1220)
~[?:1.8.0_181]
at
sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1156)
~[?:1.8.0_181]
at
sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:1050)
~[?:1.8.0_181]
at
sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:984)
~[?:1.8.0_181]
at
com.alibaba.nacos.client.naming.net.HttpClient.request(HttpClient.java:86)
~[nacos-client-1.3.0.jar:?]
at
com.alibaba.nacos.client.naming.net.NamingProxy.callServer(NamingProxy.java:432)
~[nacos-client-1.3.0.jar:?]
at
com.alibaba.nacos.client.naming.net.NamingProxy.reqAPI(NamingProxy.java:467)
~[nacos-client-1.3.0.jar:?]
at
com.alibaba.nacos.client.naming.net.NamingProxy.reqAPI(NamingProxy.java:400)
~[nacos-client-1.3.0.jar:?]
at
com.alibaba.nacos.client.naming.net.NamingProxy.reqAPI(NamingProxy.java:396)
~[nacos-client-1.3.0.jar:?]
at
com.alibaba.nacos.client.naming.net.NamingProxy.queryList(NamingProxy.java:321)
~[nacos-client-1.3.0.jar:?]
at
com.alibaba.nacos.client.naming.core.HostReactor.updateServiceNow(HostReactor.java:282)
~[nacos-client-1.3.0.jar:?]
at
com.alibaba.nacos.client.naming.core.HostReactor$UpdateTask.run(HostReactor.java:330)
~[nacos-client-1.3.0.jar:?]
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
~[?:1.8.0_181]
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
~[?:1.8.0_181]
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
~[?:1.8.0_181]
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
~[?:1.8.0_181]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
~[?:1.8.0_181]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
~[?:1.8.0_181]
at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_181]
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscr...@dubbo.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscr...@dubbo.apache.org
For additional commands, e-mail: notifications-h...@dubbo.apache.org
