[ https://issues.apache.org/jira/browse/IGNITE-10943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dmitry Sherstobitov updated IGNITE-10943: ----------------------------------------- Attachment: grid.1.node.1.jstack.log > "No next node in topology" infinite messages in log after cycle cluster nodes > restart > ------------------------------------------------------------------------------------- > > Key: IGNITE-10943 > URL: https://issues.apache.org/jira/browse/IGNITE-10943 > Project: Ignite > Issue Type: Bug > Affects Versions: 2.4 > Reporter: Dmitry Sherstobitov > Priority: Critical > Attachments: grid.1.node.1.jstack.log > > > Same scenario as in https://issues.apache.org/jira/browse/IGNITE-10878 > After cluster restarted here is one node with 100% CPU load and following > messages in log: > {code:java} > 2019-01-15T15:16:41,333][DEBUG][tcp-disco-msg-worker-#2][TcpDiscoverySpi] > Message has been added to queue: TcpDiscoveryNodeFailedMessage > [failedNodeId=e006e575-bbc8-4004-8ce3-ddc165d1748c, order=12, warning=null, > super=TcpDiscoveryAbstractMessage [sndNodeId=null, > id=3cfe0715861-24a27aff-e471-4db1-ac46-cda072de17b9, verifierNodeId=null, > topVer=0, pendingIdx=0, failedNodes=null, isClient=false]] > 2019-01-15T15:16:41,333][DEBUG][tcp-disco-msg-worker-#2][TcpDiscoverySpi] > Pending messages will be resent to local node > 2019-01-15T15:16:41,333][INFO ][tcp-disco-srvr-#3][TcpDiscoverySpi] TCP > discovery spawning a new thread for connection [rmtAddr=/172.25.1.40, > rmtPort=59236] > 2019-01-15T15:16:41,333][INFO ][tcp-disco-sock-reader-#21][TcpDiscoverySpi] > Started serving remote node connection [rmtAddr=/172.25.1.40:59236, > rmtPort=59236] > 2019-01-15T15:16:41,333][DEBUG][tcp-disco-msg-worker-#2][TcpDiscoverySpi] > Message has been added to queue: TcpDiscoveryStatusCheckMessage > [creatorNode=TcpDiscoveryNode [id=24a27aff-e471-4db1-ac46-cda072de17b9, > addrs=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 172.17.0.1, 172.25.1.40], > sockAddrs=[/172.17.0.1:47500, /0:0:0:0:0:0:0:1%lo:47500, > lab40.gridgain.local/172.25.1.40:47500, /127.0.0.1:47500], discPort=47500, > order=0, intOrder=15, lastExchangeTime=1547554584282, loc=true, > ver=2.4.13#20190114-sha1:a7667ae6, isClient=false], failedNodeId=null, > status=0, super=TcpDiscoveryAbstractMessage [sndNodeId=null, > id=4cfe0715861-24a27aff-e471-4db1-ac46-cda072de17b9, verifierNodeId=null, > topVer=0, pendingIdx=0, failedNodes=null, isClient=false]] > 2019-01-15T15:16:41,334][DEBUG][tcp-disco-msg-worker-#2][TcpDiscoverySpi] > Ignore message failed nodes, sender node is in fail list > [nodeId=e006e575-bbc8-4004-8ce3-ddc165d1748c, > failedNodes=[a251994d-8df6-4b2d-a28c-18ec55a3a48c, > a5fa9095-2e4b-48e5-803d-551a5ebde558]] > 2019-01-15T15:16:41,334][DEBUG][tcp-disco-msg-worker-#2][TcpDiscoverySpi] No > next node in topology. > 2019-01-15T15:16:41,334][DEBUG][tcp-disco-msg-worker-#2][TcpDiscoverySpi] No > next node in topology. > 2019-01-15T15:16:41,334][DEBUG][tcp-disco-sock-reader-#21][TcpDiscoverySpi] > Initialized connection with remote node > [nodeId=6df245fe-6288-4d93-ab20-2b9ac1b35771, client=false] > 2019-01-15T15:16:41,334][DEBUG][tcp-disco-msg-worker-#2][TcpDiscoverySpi] No > next node in topology. > 2019-01-15T15:16:41,335][DEBUG][tcp-disco-msg-worker-#2][TcpDiscoverySpi] No > next node in topology. > 2019-01-15T15:16:41,335][DEBUG][tcp-disco-msg-worker-#2][TcpDiscoverySpi] No > next node in topology. > 2019-01-15T15:16:41,335][DEBUG][tcp-disco-msg-worker-#2][TcpDiscoverySpi] No > next node in topology. > 2019-01-15T15:16:41,335][DEBUG][tcp-disco-msg-worker-#2][TcpDiscoverySpi] No > next node in topology. > 2019-01-15T15:16:41,335][DEBUG][tcp-disco-msg-worker-#2][TcpDiscoverySpi] No > next node in topology. > 2019-01-15T15:16:41,335][DEBUG][tcp-disco-msg-worker-#2][TcpDiscoverySpi] No > next node in topology. > 2019-01-15T15:16:41,336][DEBUG][tcp-disco-msg-worker-#2][TcpDiscoverySpi] No > next node in topology. > 2019-01-15T15:16:41,336][DEBUG][tcp-disco-msg-worker-#2][TcpDiscoverySpi] No > next node in topology.{code} -- This message was sent by Atlassian JIRA (v7.6.3#76005)