Hello, Sorry,I don't describe clearly. My cluster stop many times. The topology destruction take place at 22:03:38,But I attach log files don't contain it. The topology destruction take place at 21:26:55,I attach log files contain it.
The stoped server node's ip is 172.21.0.183. The stoped server node's id is ac184004. The topology destruction take place at 21:26:55 in ignite-ac184004.0.log-172.21.0.183. ignite-ac184004.0.log-172.21.0.183： [21:26:55,427][WARNING][tcp-disco-msg-worker-#2%null%][TcpDiscoverySpi] Node is out of topology (probably, due to short-time network problems). [21:26:55,430][WARNING][disco-event-worker-#144%null%][GridDiscoveryManager] Local node SEGMENTED: TcpDiscoveryNode [id=ac184004-f488-40be-9dd5-dc54632bcbbe, addrs=[124.250.36.149, 127.0.0.1, 172.21.0.183], sockAddrs=[/172.21.0.183:58600, /124.250.36.149:58600, /124.250.36.149:58600, /127.0.0.1:58600, /172.21.0.183:58600], discPort=58600, order=526, intOrder=275, lastExchangeTime=1470144415424, loc=true, ver=1.6.0#20160518-sha1:0b22c45b, isClient=false] [21:26:55,466][WARNING][disco-event-worker-#144%null%][GridDiscoveryManager] Stopping local node according to configured segmentation policy. [21:26:55,467][WARNING][disco-event-worker-#144%null%][GridDiscoveryManager] Node FAILED: TcpDiscoveryNode [id=588dbb39-a124-4879-a476-3bb723e1e4d9, addrs=[124.250.36.148, 127.0.0.1, 172.21.0.182], sockAddrs=[/124.250.36.148:58600, /124.250.36.148:58600, /124.250.36.148:58600, /127.0.0.1:58600, /172.21.0.182:58600], discPort=58600, order=244, intOrder=132, lastExchangeTime=1470103699289, loc=false, ver=1.6.0#20160518-sha1:0b22c45b, isClient=false] [21:26:55,470][INFO][disco-event-worker-#144%null%][GridDiscoveryManager] Topology snapshot [ver=567, servers=1, clients=0, CPUs=32, heap=60.0GB] [21:26:55,471][WARNING][disco-event-worker-#144%null%][GridDiscoveryManager] Node FAILED: TcpDiscoveryNode [id=ea39b0d0-fb6b-483b-86d5-d2cfda7c0abf, addrs=[127.0.0.1, 172.21.0.39], sockAddrs=[/172.21.0.39:58600, /127.0.0.1:58600, /172.21.0.39:58600], discPort=58600, order=251, intOrder=136, lastExchangeTime=1470103699833, loc=false, ver=1.6.0#20160518-sha1:0b22c45b, isClient=false] [21:26:55,473][INFO][Thread-69][GridTcpRestProtocol] Command protocol successfully stopped: TCP binary [21:26:55,474][WARNING][disco-event-worker-#144%null%][GridDiscoveryManager] Node FAILED: TcpDiscoveryNode [id=51421fee-0d08-4f46-82ea-1a12f8d80f6f, addrs=[127.0.0.1, 172.21.0.40], sockAddrs=[/172.21.0.40:58600, /127.0.0.1:58600, /172.21.0.40:58600], discPort=58600, order=257, intOrder=139, lastExchangeTime=1470103699833, loc=false, ver=1.6.0#20160518-sha1:0b22c45b, isClient=false] [21:26:55,475][WARNING][disco-event-worker-#144%null%][GridDiscoveryManager] Node FAILED: TcpDiscoveryNode [id=14d75a27-f8ae-4da6-9285-f6b6abfe645c, addrs=[127.0.0.1, 172.21.0.41], sockAddrs=[/172.21.0.41:58600, /127.0.0.1:58600, /172.21.0.41:58600], discPort=58600, order=263, intOrder=142, lastExchangeTime=1470103699833, loc=false, ver=1.6.0#20160518-sha1:0b22c45b, isClient=false] [21:26:55,475][WARNING][disco-event-worker-#144%null%][GridDiscoveryManager] Node FAILED: TcpDiscoveryNode [id=2333a45f-4d81-423d-90fe-445efc233883, addrs=[127.0.0.1, 172.21.0.42], sockAddrs=[/172.21.0.42:58600, /127.0.0.1:58600, /172.21.0.42:58600], discPort=58600, order=265, intOrder=143, lastExchangeTime=1470103699833, loc=false, ver=1.6.0#20160518-sha1:0b22c45b, isClient=false] [21:26:55,476][WARNING][disco-event-worker-#144%null%][GridDiscoveryManager] Node FAILED: TcpDiscoveryNode [id=f67c2596-bf28-41d5-b79d-7e351b72768f, addrs=[127.0.0.1, 172.21.0.43], sockAddrs=[/172.21.0.43:58600, /127.0.0.1:58600, /172.21.0.43:58600], discPort=58600, order=267, intOrder=144, lastExchangeTime=1470103699833, loc=false, ver=1.6.0#20160518-sha1:0b22c45b, isClient=false] [21:26:55,477][WARNING][disco-event-worker-#144%null%][GridDiscoveryManager] Node FAILED: TcpDiscoveryNode [id=ddcbfdba-cf93-415c-a914-e84ac729ccc4, addrs=[124.250.36.139, 127.0.0.1, 172.21.0.173], sockAddrs=[/124.250.36.139:0, /124.250.36.139:0, /124.250.36.139:0, /127.0.0.1:0, /172.21.0.173:0], discPort=0, order=299, intOrder=160, lastExchangeTime=1470103699833, loc=false, ver=1.6.0#20160518-sha1:0b22c45b, isClient=true] [21:26:55,478][WARNING][disco-event-worker-#144%null%][GridDiscoveryManager] Node FAILED: TcpDiscoveryNode [id=36e21ab4-2d96-4e22-8496-755ae90253ba, addrs=[124.250.36.70, 124.250.36.74, 127.0.0.1, 172.21.0.77], sockAddrs=[/124.250.36.70:0, /124.250.36.70:0, /124.250.36.74:0, /124.250.36.74:0, /127.0.0.1:0, /127.0.0.1:0, /172.21.0.77:0], discPort=0, order=307, intOrder=164, lastExchangeTime=1470103700085, loc=false, ver=1.6.0#20160518-sha1:0b22c45b, isClient=true] [21:26:55,478][WARNING][disco-event-worker-#144%null%][GridDiscoveryManager] Node FAILED: TcpDiscoveryNode [id=048e6c2a-7520-4197-8074-a65beefac047, addrs=[124.250.36.73, 124.250.36.74, 127.0.0.1, 172.21.0.80], sockAddrs=[/124.250.36.73:0, /124.250.36.73:0, /124.250.36.73:0, /124.250.36.74:0, /124.250.36.74:0, /127.0.0.1:0, /172.21.0.80:0], discPort=0, order=313, intOrder=167, lastExchangeTime=1470103700360, loc=false, ver=1.6.0#20160518-sha1:0b22c45b, isClient=true] [21:26:55,479][WARNING][disco-event-worker-#144%null%][GridDiscoveryManager] Node FAILED: TcpDiscoveryNode [id=0a8abdd3-ebe9-4bf3-a1af-ffaa40f8c3ac, addrs=[124.250.36.196, 124.250.36.74, 127.0.0.1, 172.21.0.223], sockAddrs=[/172.21.0.223:0, /124.250.36.196:0, /124.250.36.196:0, /124.250.36.74:0, /124.250.36.74:0, /127.0.0.1:0, /172.21.0.223:0], discPort=0, order=319, intOrder=170, lastExchangeTime=1470103700511, loc=false, ver=1.6.0#20160518-sha1:0b22c45b, isClient=true] [21:26:55,480][WARNING][disco-event-worker-#144%null%][GridDiscoveryManager] Node FAILED: TcpDiscoveryNode [id=aef17bf7-ef0d-4a9b-8d7b-a87ffa42afbf, addrs=[124.250.36.69, 124.250.36.74, 124.250.36.74, 127.0.0.1, 172.21.0.76], sockAddrs=[/124.250.36.69:0, /124.250.36.69:0, /124.250.36.74:0, /124.250.36.74:0, /124.250.36.74:0, /124.250.36.74:0, test.com/69.172.200.235:0, /127.0.0.1:0, /172.21.0.76:0], discPort=0, order=358, intOrder=188, lastExchangeTime=1470103700511, loc=false, ver=1.6.0#20160518-sha1:0b22c45b, isClient=true] [21:26:55,481][WARNING][disco-event-worker-#144%null%][GridDiscoveryManager] Node FAILED: TcpDiscoveryNode [id=a51432a3-25e8-41e1-9201-ad626852af80, addrs=[124.250.36.72, 124.250.36.74, 127.0.0.1, 172.21.0.79], sockAddrs=[/124.250.36.72:0, /124.250.36.72:0, /124.250.36.72:0, /124.250.36.74:0, /124.250.36.74:0, /127.0.0.1:0, /172.21.0.79:0], discPort=0, order=359, intOrder=189, lastExchangeTime=1470103702071, loc=false, ver=1.6.0#20160518-sha1:0b22c45b, isClient=true] [21:26:55,481][WARNING][disco-event-worker-#144%null%][GridDiscoveryManager] Node FAILED: TcpDiscoveryNode [id=1178eb68-3025-4cbf-8515-d34e5a28a452, addrs=[124.250.36.71, 124.250.36.74, 127.0.0.1, 172.21.0.78], sockAddrs=[/124.250.36.71:0, /124.250.36.71:0, /124.250.36.74:0, /124.250.36.74:0, /124.250.36.74:0, /127.0.0.1:0, /172.21.0.78:0], discPort=0, order=360, intOrder=190, lastExchangeTime=1470103702957, loc=false, ver=1.6.0#20160518-sha1:0b22c45b, isClient=true] [21:26:55,483][WARNING][disco-event-worker-#144%null%][GridDiscoveryManager] Node FAILED: TcpDiscoveryNode [id=89f1d6cd-8c40-4465-86e7-b2169bb59e8c, addrs=[124.250.36.197, 124.250.36.74, 127.0.0.1, 172.21.0.224], sockAddrs=[/172.21.0.224:0, /124.250.36.197:0, /124.250.36.74:0, /124.250.36.74:0, /124.250.36.197:0, /127.0.0.1:0, /172.21.0.224:0], discPort=0, order=362, intOrder=192, lastExchangeTime=1470103703048, loc=false, ver=1.6.0#20160518-sha1:0b22c45b, isClient=true] [21:26:55,483][INFO][Thread-69][GridJettyRestProtocol] Command protocol successfully stopped: Jetty REST [21:26:55,483][WARNING][disco-event-worker-#144%null%][GridDiscoveryManager] Node FAILED: TcpDiscoveryNode [id=4e040db4-6a6e-4f90-ad1c-a4100a28b792, addrs=[124.250.36.185, 124.250.36.45, 127.0.0.1, 172.21.0.35], sockAddrs=[/172.21.0.35:0, /124.250.36.185:0, /124.250.36.45:0, /124.250.36.45:0, /124.250.36.185:0, /127.0.0.1:0, /172.21.0.35:0], discPort=0, order=366, intOrder=194, lastExchangeTime=1470103703048, loc=false, ver=1.6.0#20160518-sha1:0b22c45b, isClient=true] [21:26:55,484][WARNING][disco-event-worker-#144%null%][GridDiscoveryManager] Node FAILED: TcpDiscoveryNode [id=2f84fb8b-ec6c-435a-8175-bc87e3db252c, addrs=[124.250.36.185, 124.250.36.185, 124.250.36.46, 127.0.0.1, 172.21.0.36], sockAddrs=[/124.250.36.185:0, /124.250.36.185:0, /124.250.36.185:0, /124.250.36.185:0, /124.250.36.46:0, /124.250.36.46:0, /124.250.36.185:0, /127.0.0.1:0, /172.21.0.36:0], discPort=0, order=372, intOrder=197, lastExchangeTime=1470103703048, loc=false, ver=1.6.0#20160518-sha1:0b22c45b, isClient=true] [21:26:55,484][WARNING][disco-event-worker-#144%null%][GridDiscoveryManager] Node FAILED: TcpDiscoveryNode [id=b79cced2-1175-443b-8e7b-b73b2a622d5f, addrs=[127.0.0.1, 172.21.0.38], sockAddrs=[/172.21.0.38:58600, /127.0.0.1:58600, /172.21.0.38:58600], discPort=58600, order=390, intOrder=207, lastExchangeTime=1470103703078, loc=false, ver=1.6.0#20160518-sha1:0b22c45b, isClient=false] [21:26:55,485][WARNING][disco-event-worker-#144%null%][GridDiscoveryManager] Node FAILED: TcpDiscoveryNode [id=f0f33c05-7173-4a38-97ed-74f709514b32, addrs=[124.250.36.223, 127.0.0.1, 172.21.0.127], sockAddrs=[/172.21.0.127:0, /124.250.36.223:0, /124.250.36.223:0, /127.0.0.1:0, /172.21.0.127:0], discPort=0, order=427, intOrder=225, lastExchangeTime=1470103703078, loc=false, ver=1.6.0#20160518-sha1:0b22c45b, isClient=true] [21:26:55,486][WARNING][disco-event-worker-#144%null%][GridDiscoveryManager] Node FAILED: TcpDiscoveryNode [id=ec94b23e-f3d7-4e6d-aa22-570a248f7172, addrs=[124.250.36.222, 127.0.0.1, 172.21.0.126], sockAddrs=[/172.21.0.126:0, /124.250.36.222:0, /124.250.36.222:0, /127.0.0.1:0, /172.21.0.126:0], discPort=0, order=431, intOrder=227, lastExchangeTime=1470103703088, loc=false, ver=1.6.0#20160518-sha1:0b22c45b, isClient=true] [21:26:55,486][WARNING][disco-event-worker-#144%null%][GridDiscoveryManager] Node FAILED: TcpDiscoveryNode [id=0687433b-a7a2-47db-ba38-6d1d4f34f82e, addrs=[124.250.36.147, 127.0.0.1, 172.21.0.181], sockAddrs=[/172.21.0.181:58600, /124.250.36.147:58600, /124.250.36.147:58600, /127.0.0.1:58600, /172.21.0.181:58600], discPort=58600, order=440, intOrder=232, lastExchangeTime=1470103703088, loc=false, ver=1.6.0#20160518-sha1:0b22c45b, isClient=false] [21:26:55,487][WARNING][disco-event-worker-#144%null%][GridDiscoveryManager] Node FAILED: TcpDiscoveryNode [id=0e163fa7-091d-4804-8e8b-95feb1f0e2ef, addrs=[124.250.36.47, 127.0.0.1, 172.21.0.37, 33.33.33.1], sockAddrs=[/33.33.33.1:0, /124.250.36.47:0, /172.21.0.37:0, /127.0.0.1:0, /124.250.36.47:0, /172.21.0.37:0, /33.33.33.1:0], discPort=0, order=536, intOrder=280, lastExchangeTime=1470135253093, loc=false, ver=1.6.0#20160518-sha1:0b22c45b, isClient=true] [21:26:55,856][INFO][Thread-69][GridCacheProcessor] Stopped cache: bjdqAppRecommendingCache [21:26:55,858][INFO][Thread-69][GridCacheProcessor] Stopped cache: bjdqAppRecommendedCache [21:26:55,859][INFO][Thread-69][GridCacheProcessor] Stopped cache: yiCheAppRecommendingCache [21:26:55,860][INFO][Thread-69][GridCacheProcessor] Stopped cache: yiCheAppRecommendedCache [21:26:55,861][INFO][Thread-69][GridCacheProcessor] Stopped cache: idfaCache [21:26:55,862][INFO][Thread-69][GridCacheProcessor] Stopped cache: clickedArticleCache [21:26:55,862][INFO][Thread-69][GridCacheProcessor] Stopped cache: deviceCache [21:26:55,863][INFO][Thread-69][GridCacheProcessor] Stopped cache: ignite-marshaller-sys-cache [21:26:55,863][INFO][Thread-69][GridCacheProcessor] Stopped cache: ignite-sys-cache [21:26:55,864][INFO][Thread-69][GridCacheProcessor] Stopped cache: ignite-atomics-sys-cache [21:26:55,867][INFO][Thread-69][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1470103704338, depMode=SHARED, clsLdr=sun.misc.Launcher$AppClassLoader@18b4aac2, clsLdrId=16432094651-ac184004-f488-40be-9dd5-dc54632bcbbe, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionFullMap, pendingUndeploy=false, undeployed=true, usage=0] [21:26:55,880][INFO][Thread-69][IgniteKernal] -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Ignite-Cluster-node-stopped-tp6608p6893.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.
