Hi, Could you please provide both logs from client and from server?
On Mon, Sep 12, 2016 at 5:23 AM, ght230 <[email protected]> wrote: > I used a Ignite client to receive data from rocketMQ and put the received > data to Ignite server. > > For some reason, the Ignite client was disconnected by the cluster(maybe as > slow client), > > The above is normal, but after that, the ignite client can not reconnect to > the cluster automatically. > > Furthermore, even other client can not connect to the cluster either. > > Following the the systerm info. > > 2016-09-11 16:53:27,973 [ConsumeMessageThread_7] ERROR ErrorInfoLog - > Ignite > Client Disconnect,wait for reconnect > javax.cache.CacheException: class > org.apache.ignite.IgniteClientDisconnectedException: Data streamer has > been > closed, client node disconnected. > at > org.apache.ignite.internal.processors.cache.GridCacheUtils. > convertToCacheException(GridCacheUtils.java:1502) > at > org.apache.ignite.internal.processors.datastreamer.DataStreamerImpl. > onDisconnected(DataStreamerImpl.java:1043) > at > org.apache.ignite.internal.processors.datastreamer.DataStreamProcessor. > onDisconnected(DataStreamProcessor.java:160) > at > org.apache.ignite.internal.IgniteKernal.onDisconnected( > IgniteKernal.java:3190) > at > org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$4. > onDiscovery(GridDiscoveryManager.java:596) > at > org.apache.ignite.spi.discovery.tcp.ClientImpl$ > MessageWorker.notifyDiscovery(ClientImpl.java:2070) > at > org.apache.ignite.spi.discovery.tcp.ClientImpl$ > MessageWorker.notifyDiscovery(ClientImpl.java:2051) > at > org.apache.ignite.spi.discovery.tcp.ClientImpl$ > MessageWorker.body(ClientImpl.java:1440) > at org.apache.ignite.spi.IgniteSpiThread.run( > IgniteSpiThread.java:62) > Caused by: class org.apache.ignite.IgniteClientDisconnectedException: Data > streamer has been closed, client node disconnected. > at > org.apache.ignite.internal.util.IgniteUtils$14.apply(IgniteUtils.java:829) > at > org.apache.ignite.internal.util.IgniteUtils$14.apply(IgniteUtils.java:827) > ... 9 more > Caused by: class > org.apache.ignite.internal.IgniteClientDisconnectedCheckedException: Data > streamer has been closed, client node disconnected. > at > org.apache.ignite.internal.processors.datastreamer.DataStreamerImpl. > onDisconnected(DataStreamerImpl.java:1040) > ... 7 more > 2016-09-11 16:53:28,006 [ConsumeMessageThread_12] ERROR > org.apache.ignite.internal.processors.cache.binary. > CacheObjectBinaryProcessorImpl > - Failed to get partition > 2016-09-11 16:53:28,006 [ConsumeMessageThread_7] ERROR ErrorInfoLog - > Failed > to update message [MessageExt [queueId=1, storeSize=1311, > queueOffset=355731, sysFlag=0, bornTimestamp=1473344287142, > bornHost=/192.168.35.210:36486, storeTimestamp=1473344287142, > storeHost=/192.168.35.210:10911, msgId=C0A823D200002A9F00000029EBDE150F, > commitLogOffset=180050859279, bodyCRC=1072650690, reconsumeTimes=0, > preparedTransactionOffset=0, toString()=Message [topic=RelatedPreAlarmOrg, > flag=0, properties={TAGS=alarm, KEYS=1307637, WAIT=true, MAX_OFFSET=665658, > MIN_OFFSET=215497}, body=1168]]] to ignite,caused by > class org.apache.ignite.IgniteException: Node stopped. > at > org.apache.ignite.internal.util.IgniteUtils.convertException(IgniteUtils. > java:908) > at > org.apache.ignite.internal.util.future.IgniteFutureImpl.convertException( > IgniteFutureImpl.java:153) > at > org.apache.ignite.internal.util.future.IgniteFutureImpl. > get(IgniteFutureImpl.java:122) > at > com.ffcs.oss.ignite.rlam.service.impl.MQAlarmPushServiceImpl. > consumeMessage(MQAlarmPushServiceImpl.java:46) > at > com.alibaba.rocketmq.client.impl.consumer.ConsumeMessageConcurrentlyServ > ice$ConsumeRequest.run(ConsumeMessageConcurrentlyService.java:142) > at java.util.concurrent.Executors$RunnableAdapter. > call(Executors.java:471) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at > java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1145) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:745) > Caused by: class org.apache.ignite.IgniteCheckedException: Node stopped. > at > org.apache.ignite.internal.GridKernalGatewayImpl.setState( > GridKernalGatewayImpl.java:208) > at org.apache.ignite.internal.IgniteKernal.stop0( > IgniteKernal.java:1956) > at org.apache.ignite.internal.IgniteKernal.stop( > IgniteKernal.java:1860) > at > org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.stop0( > IgnitionEx.java:2266) > at > org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.stop( > IgnitionEx.java:2229) > at > org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance$2.run( > IgnitionEx.java:1782) > 2016-09-11 16:53:27,972 [ConsumeMessageThread_61] ERROR ErrorInfoLog - > Failed to update message [MessageExt [queueId=1, storeSize=988, > queueOffset=355723, sysFlag=0, bornTimestamp=1473344286350, > bornHost=/192.168.35.210:36486, storeTimestamp=1473344286350, > storeHost=/192.168.35.210:10911, msgId=C0A823D200002A9F00000029EBDD6CC3, > commitLogOffset=180050816195, bodyCRC=1441473701, reconsumeTimes=0, > preparedTransactionOffset=0, toString()=Message [topic=RelatedPreAlarmOrg, > flag=0, properties={TAGS=alarm, KEYS=1307607, WAIT=true, MAX_OFFSET=665658, > MIN_OFFSET=215497}, body=845]]] to ignite,caused by > class org.apache.ignite.IgniteException: Node stopped. > at > org.apache.ignite.internal.util.IgniteUtils.convertException(IgniteUtils. > java:908) > at > org.apache.ignite.internal.util.future.IgniteFutureImpl.convertException( > IgniteFutureImpl.java:153) > at > org.apache.ignite.internal.util.future.IgniteFutureImpl. > get(IgniteFutureImpl.java:122) > at > com.ffcs.oss.ignite.rlam.service.impl.MQAlarmPushServiceImpl. > consumeMessage(MQAlarmPushServiceImpl.java:46) > at > com.alibaba.rocketmq.client.impl.consumer.ConsumeMessageConcurrentlyServ > ice$ConsumeRequest.run(ConsumeMessageConcurrentlyService.java:142) > at java.util.concurrent.Executors$RunnableAdapter. > call(Executors.java:471) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at > java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1145) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:745) > Caused by: class org.apache.ignite.IgniteCheckedException: Node stopped. > at > org.apache.ignite.internal.GridKernalGatewayImpl.setState( > GridKernalGatewayImpl.java:208) > at org.apache.ignite.internal.IgniteKernal.stop0( > IgniteKernal.java:1956) > at org.apache.ignite.internal.IgniteKernal.stop( > IgniteKernal.java:1860) > at > org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.stop0( > IgnitionEx.java:2266) > at > org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.stop( > IgnitionEx.java:2229) > at > org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance$2.run( > IgnitionEx.java:1782) > 2016-09-11 16:53:28,006 [ConsumeMessageThread_12] ERROR ErrorInfoLog - > Ignite Client Disconnect,wait for reconnect > javax.cache.CacheException: class > org.apache.ignite.IgniteClientDisconnectedException: Data streamer has > been > closed, client node disconnected. > at > org.apache.ignite.internal.processors.cache.GridCacheUtils. > convertToCacheException(GridCacheUtils.java:1502) > at > org.apache.ignite.internal.processors.datastreamer.DataStreamerImpl. > onDisconnected(DataStreamerImpl.java:1043) > at > org.apache.ignite.internal.processors.datastreamer.DataStreamProcessor. > onDisconnected(DataStreamProcessor.java:160) > at > org.apache.ignite.internal.IgniteKernal.onDisconnected( > IgniteKernal.java:3190) > at > org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$4. > onDiscovery(GridDiscoveryManager.java:596) > at > org.apache.ignite.spi.discovery.tcp.ClientImpl$ > MessageWorker.notifyDiscovery(ClientImpl.java:2070) > at > org.apache.ignite.spi.discovery.tcp.ClientImpl$ > MessageWorker.notifyDiscovery(ClientImpl.java:2051) > at > org.apache.ignite.spi.discovery.tcp.ClientImpl$ > MessageWorker.body(ClientImpl.java:1440) > at org.apache.ignite.spi.IgniteSpiThread.run( > IgniteSpiThread.java:62) > Caused by: class org.apache.ignite.IgniteClientDisconnectedException: Data > streamer has been closed, client node disconnected. > at > org.apache.ignite.internal.util.IgniteUtils$14.apply(IgniteUtils.java:829) > at > org.apache.ignite.internal.util.IgniteUtils$14.apply(IgniteUtils.java:827) > ... 9 more > Caused by: class > org.apache.ignite.internal.IgniteClientDisconnectedCheckedException: Data > streamer has been closed, client node disconnected. > at > org.apache.ignite.internal.processors.datastreamer.DataStreamerImpl. > onDisconnected(DataStreamerImpl.java:1040) > ... 7 more > 2016-09-11 16:53:27,972 [ConsumeMessageThread_64] ERROR ErrorInfoLog - > Failed to update message [MessageExt [queueId=1, storeSize=1142, > queueOffset=355724, sysFlag=0, bornTimestamp=1473344286350, > bornHost=/192.168.35.210:36486, storeTimestamp=1473344286351, > storeHost=/192.168.35.210:10911, msgId=C0A823D200002A9F00000029EBDD7D0E, > commitLogOffset=180050820366, bodyCRC=1258097122, reconsumeTimes=0, > preparedTransactionOffset=0, toString()=Message [topic=RelatedPreAlarmOrg, > flag=0, properties={TAGS=alarm, KEYS=1307607, WAIT=true, MAX_OFFSET=665658, > MIN_OFFSET=215497}, body=999]]] to ignite,caused by > class org.apache.ignite.IgniteException: Node stopped. > at > org.apache.ignite.internal.util.IgniteUtils.convertException(IgniteUtils. > java:908) > at > org.apache.ignite.internal.util.future.IgniteFutureImpl.convertException( > IgniteFutureImpl.java:153) > at > org.apache.ignite.internal.util.future.IgniteFutureImpl. > get(IgniteFutureImpl.java:122) > at > com.ffcs.oss.ignite.rlam.service.impl.MQAlarmPushServiceImpl. > consumeMessage(MQAlarmPushServiceImpl.java:46) > at > com.alibaba.rocketmq.client.impl.consumer.ConsumeMessageConcurrentlyServ > ice$ConsumeRequest.run(ConsumeMessageConcurrentlyService.java:142) > at java.util.concurrent.Executors$RunnableAdapter. > call(Executors.java:471) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at > java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1145) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:745) > Caused by: class org.apache.ignite.IgniteCheckedException: Node stopped. > at > org.apache.ignite.internal.GridKernalGatewayImpl.setState( > GridKernalGatewayImpl.java:208) > at org.apache.ignite.internal.IgniteKernal.stop0( > IgniteKernal.java:1956) > at org.apache.ignite.internal.IgniteKernal.stop( > IgniteKernal.java:1860) > at > org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.stop0( > IgnitionEx.java:2266) > at > org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.stop( > IgnitionEx.java:2229) > at > org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance$2.run( > IgnitionEx.java:1782) > > > > -- > View this message in context: http://apache-ignite-users. > 70518.x6.nabble.com/Slow-clients-can-not-reconnect-to- > the-cluster-tp7665.html > Sent from the Apache Ignite Users mailing list archive at Nabble.com. > -- Vladislav Pyatkov
