[
https://issues.apache.org/jira/browse/IGNITE-10842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ilya Suntsov updated IGNITE-10842:
----------------------------------
Description:
Steps:
# Start 3 nodes: 1 yardstick driver and 2 servers
# Almost simultaneously start all nodes. ( kill -9 -f "Dyardstick.server"/
"Dyardstick.driver")
Result:
I see the following messages in log:
{noformat}
2018-12-28 12:30:06,606][ERROR][sys-stripe-8-#9][TcpCommunicationSpi] Failed to
send message to remote node [node=TcpDiscoveryNode
[id=8e884f80-f55d-4b32-9dcd-39e1af0ed2ef, addrs=ArrayList [1
class org.apache.ignite.spi.IgniteSpiException: Node is stopping.
*<------>*at
org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.reserveClient(TcpCommunicationSpi.java:2883)
*<------>*at
org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.sendMessage0(TcpCommunicationSpi.java:2743)
*<------>*at
org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.sendMessage(TcpCommunicationSpi.java:2702)
*<------>*at
org.apache.ignite.internal.managers.communication.GridIoManager.send(GridIoManager.java:1652)
*<------>*at
org.apache.ignite.internal.managers.communication.GridIoManager.sendToGridTopic(GridIoManager.java:1726)
*<------>*at
org.apache.ignite.internal.processors.cache.GridCacheIoManager.send(GridCacheIoManager.java:1240)
*<------>*at
org.apache.ignite.internal.processors.cache.GridCacheIoManager.send(GridCacheIoManager.java:1279)
*<------>*at
org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache.sendDeferredUpdateResponse(GridDhtAtomicCache.java:3548)
*<------>*at
org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache.access$3300(GridDhtAtomicCache.java:139)
*<------>*at
org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache$DeferredUpdateTimeout.run(GridDhtAtomicCache.java:3794)
*<------>*at
org.apache.ignite.internal.util.StripedExecutor$Stripe.body(StripedExecutor.java:508)
*<------>*at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:120)
*<------>*at java.lang.Thread.run(Thread.java:745)
[2018-12-28 12:30:06,658][ERROR][sys-stripe-12-#13][TcpCommunicationSpi] Failed
to send message to remote node [node=TcpDiscoveryNode
[id=8e884f80-f55d-4b32-9dcd-39e1af0ed2ef, addrs=ArrayList
class org.apache.ignite.spi.IgniteSpiException: Node is stopping.
*<------>*at
org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.reserveClient(TcpCommunicationSpi.java:2883)
*<------>*at
org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.sendMessage0(TcpCommunicationSpi.java:2743)
*<------>*at
org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.sendMessage(TcpCommunicationSpi.java:2702)
*<------>*at
org.apache.ignite.internal.managers.communication.GridIoManager.send(GridIoManager.java:1652)
*<------>*at
org.apache.ignite.internal.managers.communication.GridIoManager.sendToGridTopic(GridIoManager.java:1726)
*<------>*at
org.apache.ignite.internal.processors.cache.GridCacheIoManager.send(GridCacheIoManager.java:1240)
*<------>*at
org.apache.ignite.internal.processors.cache.GridCacheIoManager.send(GridCacheIoManager.java:1279)
*<------>*at
org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache.sendDeferredUpdateResponse(GridDhtAtomicCache.java:3548)
*<------>*at
org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache.access$3300(GridDhtAtomicCache.java:139)
*<------>*at
org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache$DeferredUpdateTimeout.run(GridDhtAtomicCache.java:3794)
*<------>*at
org.apache.ignite.internal.util.StripedExecutor$Stripe.body(StripedExecutor.java:508)
*<------>*at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:120)
*<------>*at java.lang.Thread.run(Thread.java:745)
{noformat}
I guess it is redundant information on *Node stopping* stage.
Please take a look at logs in the attachement.
was:
Steps:
# Start 3 nodes
# Almost simultaneously start all nodes
Result:
I see the following messages in log:
{noformat}
2018-12-28 12:30:06,606][ERROR][sys-stripe-8-#9][TcpCommunicationSpi] Failed to
send message to remote node [node=TcpDiscoveryNode
[id=8e884f80-f55d-4b32-9dcd-39e1af0ed2ef, addrs=ArrayList [1
class org.apache.ignite.spi.IgniteSpiException: Node is stopping.
*<------>*at
org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.reserveClient(TcpCommunicationSpi.java:2883)
*<------>*at
org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.sendMessage0(TcpCommunicationSpi.java:2743)
*<------>*at
org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.sendMessage(TcpCommunicationSpi.java:2702)
*<------>*at
org.apache.ignite.internal.managers.communication.GridIoManager.send(GridIoManager.java:1652)
*<------>*at
org.apache.ignite.internal.managers.communication.GridIoManager.sendToGridTopic(GridIoManager.java:1726)
*<------>*at
org.apache.ignite.internal.processors.cache.GridCacheIoManager.send(GridCacheIoManager.java:1240)
*<------>*at
org.apache.ignite.internal.processors.cache.GridCacheIoManager.send(GridCacheIoManager.java:1279)
*<------>*at
org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache.sendDeferredUpdateResponse(GridDhtAtomicCache.java:3548)
*<------>*at
org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache.access$3300(GridDhtAtomicCache.java:139)
*<------>*at
org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache$DeferredUpdateTimeout.run(GridDhtAtomicCache.java:3794)
*<------>*at
org.apache.ignite.internal.util.StripedExecutor$Stripe.body(StripedExecutor.java:508)
*<------>*at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:120)
*<------>*at java.lang.Thread.run(Thread.java:745)
[2018-12-28 12:30:06,658][ERROR][sys-stripe-12-#13][TcpCommunicationSpi] Failed
to send message to remote node [node=TcpDiscoveryNode
[id=8e884f80-f55d-4b32-9dcd-39e1af0ed2ef, addrs=ArrayList
class org.apache.ignite.spi.IgniteSpiException: Node is stopping.
*<------>*at
org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.reserveClient(TcpCommunicationSpi.java:2883)
*<------>*at
org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.sendMessage0(TcpCommunicationSpi.java:2743)
*<------>*at
org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.sendMessage(TcpCommunicationSpi.java:2702)
*<------>*at
org.apache.ignite.internal.managers.communication.GridIoManager.send(GridIoManager.java:1652)
*<------>*at
org.apache.ignite.internal.managers.communication.GridIoManager.sendToGridTopic(GridIoManager.java:1726)
*<------>*at
org.apache.ignite.internal.processors.cache.GridCacheIoManager.send(GridCacheIoManager.java:1240)
*<------>*at
org.apache.ignite.internal.processors.cache.GridCacheIoManager.send(GridCacheIoManager.java:1279)
*<------>*at
org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache.sendDeferredUpdateResponse(GridDhtAtomicCache.java:3548)
*<------>*at
org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache.access$3300(GridDhtAtomicCache.java:139)
*<------>*at
org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache$DeferredUpdateTimeout.run(GridDhtAtomicCache.java:3794)
*<------>*at
org.apache.ignite.internal.util.StripedExecutor$Stripe.body(StripedExecutor.java:508)
*<------>*at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:120)
*<------>*at java.lang.Thread.run(Thread.java:745)
{noformat}
I guess it is redundant information on *Node stopping* stage.
Please take a look at logs in the attachement.
> Exception during node stopping
> ------------------------------
>
> Key: IGNITE-10842
> URL: https://issues.apache.org/jira/browse/IGNITE-10842
> Project: Ignite
> Issue Type: Bug
> Affects Versions: 2.7
> Environment: branch: master
> ver. 2.8.0-SNAPSHOT#20181228-sha1:e2edf41b
> Reporter: Ilya Suntsov
> Priority: Minor
> Fix For: 2.8
>
> Attachments: ticket-logs.zip
>
>
> Steps:
> # Start 3 nodes: 1 yardstick driver and 2 servers
> # Almost simultaneously start all nodes. ( kill -9 -f "Dyardstick.server"/
> "Dyardstick.driver")
> Result:
> I see the following messages in log:
> {noformat}
> 2018-12-28 12:30:06,606][ERROR][sys-stripe-8-#9][TcpCommunicationSpi] Failed
> to send message to remote node [node=TcpDiscoveryNode
> [id=8e884f80-f55d-4b32-9dcd-39e1af0ed2ef, addrs=ArrayList [1
> class org.apache.ignite.spi.IgniteSpiException: Node is stopping.
> *<------>*at
> org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.reserveClient(TcpCommunicationSpi.java:2883)
> *<------>*at
> org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.sendMessage0(TcpCommunicationSpi.java:2743)
> *<------>*at
> org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.sendMessage(TcpCommunicationSpi.java:2702)
> *<------>*at
> org.apache.ignite.internal.managers.communication.GridIoManager.send(GridIoManager.java:1652)
> *<------>*at
> org.apache.ignite.internal.managers.communication.GridIoManager.sendToGridTopic(GridIoManager.java:1726)
> *<------>*at
> org.apache.ignite.internal.processors.cache.GridCacheIoManager.send(GridCacheIoManager.java:1240)
> *<------>*at
> org.apache.ignite.internal.processors.cache.GridCacheIoManager.send(GridCacheIoManager.java:1279)
> *<------>*at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache.sendDeferredUpdateResponse(GridDhtAtomicCache.java:3548)
> *<------>*at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache.access$3300(GridDhtAtomicCache.java:139)
> *<------>*at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache$DeferredUpdateTimeout.run(GridDhtAtomicCache.java:3794)
> *<------>*at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.body(StripedExecutor.java:508)
> *<------>*at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:120)
> *<------>*at java.lang.Thread.run(Thread.java:745)
> [2018-12-28 12:30:06,658][ERROR][sys-stripe-12-#13][TcpCommunicationSpi]
> Failed to send message to remote node [node=TcpDiscoveryNode
> [id=8e884f80-f55d-4b32-9dcd-39e1af0ed2ef, addrs=ArrayList
> class org.apache.ignite.spi.IgniteSpiException: Node is stopping.
> *<------>*at
> org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.reserveClient(TcpCommunicationSpi.java:2883)
> *<------>*at
> org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.sendMessage0(TcpCommunicationSpi.java:2743)
> *<------>*at
> org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.sendMessage(TcpCommunicationSpi.java:2702)
> *<------>*at
> org.apache.ignite.internal.managers.communication.GridIoManager.send(GridIoManager.java:1652)
> *<------>*at
> org.apache.ignite.internal.managers.communication.GridIoManager.sendToGridTopic(GridIoManager.java:1726)
> *<------>*at
> org.apache.ignite.internal.processors.cache.GridCacheIoManager.send(GridCacheIoManager.java:1240)
> *<------>*at
> org.apache.ignite.internal.processors.cache.GridCacheIoManager.send(GridCacheIoManager.java:1279)
> *<------>*at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache.sendDeferredUpdateResponse(GridDhtAtomicCache.java:3548)
> *<------>*at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache.access$3300(GridDhtAtomicCache.java:139)
> *<------>*at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache$DeferredUpdateTimeout.run(GridDhtAtomicCache.java:3794)
> *<------>*at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.body(StripedExecutor.java:508)
> *<------>*at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:120)
> *<------>*at java.lang.Thread.run(Thread.java:745)
> {noformat}
> I guess it is redundant information on *Node stopping* stage.
> Please take a look at logs in the attachement.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
