Hi, The first thing I would check is that there are no long stop-the-world GC pauses in your cluster. Get to know this JVM and system tuning page: https://apacheignite.readme.io/docs/jvm-and-system-tuning <https://apacheignite.readme.io/docs/jvm-and-system-tuning>
— Denis > On Jan 21, 2017, at 2:12 PM, hitendrapratap > <[email protected]> wrote: > > I am trying to do POC with 4 Ignite server and 2 clients. But getting the > below error on servers. > > > {"@timestamp":"2017-01-21T16:51:27.168-05:00","@version":1,"message":"Timed > out waiting for message delivery receipt (most probably, the reason is in > long GC pauses on remote node; consider tuning GC and increasing > 'ackTimeout' configuration property). Will retry to send message with > increased timeout. Current timeout: > 9990.","logger_name":"org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi","thread_name":"tcp-disco-msg-worker-#2%null%","level":"WARN","level_value":30000,"HOSTNAME":""} > {"@timestamp":"2017-01-21T16:51:27.182-05:00","@version":1,"message":"Node > is out of topology (probably, due to short-time network > problems).","logger_name":"org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi","thread_name":"tcp-disco-msg-worker-#2%null%","level":"WARN","level_value":30000,"HOSTNAME":"xxx"} > {"@timestamp":"2017-01-21T16:51:27.183-05:00","@version":1,"message":"Local > node SEGMENTED: TcpDiscoveryNode [id=89420106-c961-4286-8c4d-853e4c54af04, > addrs=[127.0.0.1,xxx], sockAddrs=[xxx:8062, /127.0.0.1:8062], discPort=8062, > order=16, intOrder=9, lastExchangeTime=1485035487180, loc=true, > ver=1.8.0#20161205-sha1:9ca40dbe, > isClient=false]","logger_name":"org.apache.ignite.internal.managers.discovery.GridDiscoveryManager","thread_name":"disco-event-worker-#17%null%","level":"WARN","level_value":30000,"HOSTNAME":"xxx"} > {"@timestamp":"2017-01-21T16:51:29.912-05:00","@version":1,"message":"Stopping > local node according to configured segmentation > policy.","logger_name":"org.apache.ignite.internal.managers.discovery.GridDiscoveryManager","thread_name":"disco-event-worker-#17%null%","level":"WARN","level_value":30000,"HOSTNAME":"xxx"} > {"@timestamp":"2017-01-21T16:51:29.912-05:00","@version":1,"message":"Node > FAILED: TcpDiscoveryNode [id=1e3bc27f-6ee8-48a0-8843-d803fcf054fd, > addrs=[127.0.0.1, xxx], sockAddrs=[xxx:8062, /xxx:8062, /127.0.0.1:8062], > discPort=8062, order=3, intOrder=3, lastExchangeTime=1485035338259, > loc=false, ver=1.8.0#20161205-sha1:9ca40dbe, > isClient=false]","logger_name":"org.apache.ignite.internal.managers.discovery.GridDiscoveryManager","thread_name":"disco-event-worker-#17%null%","level":"WARN","level_value":30000,"HOSTNAME":"xxx"} > > > > > -- > View this message in context: > http://apache-ignite-users.70518.x6.nabble.com/Timed-out-waiting-for-message-delivery-receipt-tp10171.html > Sent from the Apache Ignite Users mailing list archive at Nabble.com.
