I used a Ignite client to receive data from rocketMQ and put the received
data to Ignite server.
For some reason, the Ignite client was disconnected by the cluster(maybe as
slow client),
The above is normal, but after that, the ignite client can not reconnect to
the cluster automatically.
Furthermore, even other client can not connect to the cluster either.
Following the the systerm info.
2016-09-11 16:53:27,973 [ConsumeMessageThread_7] ERROR ErrorInfoLog - Ignite
Client Disconnect,wait for reconnect
javax.cache.CacheException: class
org.apache.ignite.IgniteClientDisconnectedException: Data streamer has been
closed, client node disconnected.
at
org.apache.ignite.internal.processors.cache.GridCacheUtils.convertToCacheException(GridCacheUtils.java:1502)
at
org.apache.ignite.internal.processors.datastreamer.DataStreamerImpl.onDisconnected(DataStreamerImpl.java:1043)
at
org.apache.ignite.internal.processors.datastreamer.DataStreamProcessor.onDisconnected(DataStreamProcessor.java:160)
at
org.apache.ignite.internal.IgniteKernal.onDisconnected(IgniteKernal.java:3190)
at
org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$4.onDiscovery(GridDiscoveryManager.java:596)
at
org.apache.ignite.spi.discovery.tcp.ClientImpl$MessageWorker.notifyDiscovery(ClientImpl.java:2070)
at
org.apache.ignite.spi.discovery.tcp.ClientImpl$MessageWorker.notifyDiscovery(ClientImpl.java:2051)
at
org.apache.ignite.spi.discovery.tcp.ClientImpl$MessageWorker.body(ClientImpl.java:1440)
at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:62)
Caused by: class org.apache.ignite.IgniteClientDisconnectedException: Data
streamer has been closed, client node disconnected.
at
org.apache.ignite.internal.util.IgniteUtils$14.apply(IgniteUtils.java:829)
at
org.apache.ignite.internal.util.IgniteUtils$14.apply(IgniteUtils.java:827)
... 9 more
Caused by: class
org.apache.ignite.internal.IgniteClientDisconnectedCheckedException: Data
streamer has been closed, client node disconnected.
at
org.apache.ignite.internal.processors.datastreamer.DataStreamerImpl.onDisconnected(DataStreamerImpl.java:1040)
... 7 more
2016-09-11 16:53:28,006 [ConsumeMessageThread_12] ERROR
org.apache.ignite.internal.processors.cache.binary.CacheObjectBinaryProcessorImpl
- Failed to get partition
2016-09-11 16:53:28,006 [ConsumeMessageThread_7] ERROR ErrorInfoLog - Failed
to update message [MessageExt [queueId=1, storeSize=1311,
queueOffset=355731, sysFlag=0, bornTimestamp=1473344287142,
bornHost=/192.168.35.210:36486, storeTimestamp=1473344287142,
storeHost=/192.168.35.210:10911, msgId=C0A823D200002A9F00000029EBDE150F,
commitLogOffset=180050859279, bodyCRC=1072650690, reconsumeTimes=0,
preparedTransactionOffset=0, toString()=Message [topic=RelatedPreAlarmOrg,
flag=0, properties={TAGS=alarm, KEYS=1307637, WAIT=true, MAX_OFFSET=665658,
MIN_OFFSET=215497}, body=1168]]] to ignite,caused by
class org.apache.ignite.IgniteException: Node stopped.
at
org.apache.ignite.internal.util.IgniteUtils.convertException(IgniteUtils.java:908)
at
org.apache.ignite.internal.util.future.IgniteFutureImpl.convertException(IgniteFutureImpl.java:153)
at
org.apache.ignite.internal.util.future.IgniteFutureImpl.get(IgniteFutureImpl.java:122)
at
com.ffcs.oss.ignite.rlam.service.impl.MQAlarmPushServiceImpl.consumeMessage(MQAlarmPushServiceImpl.java:46)
at
com.alibaba.rocketmq.client.impl.consumer.ConsumeMessageConcurrentlyService$ConsumeRequest.run(ConsumeMessageConcurrentlyService.java:142)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: class org.apache.ignite.IgniteCheckedException: Node stopped.
at
org.apache.ignite.internal.GridKernalGatewayImpl.setState(GridKernalGatewayImpl.java:208)
at org.apache.ignite.internal.IgniteKernal.stop0(IgniteKernal.java:1956)
at org.apache.ignite.internal.IgniteKernal.stop(IgniteKernal.java:1860)
at
org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.stop0(IgnitionEx.java:2266)
at
org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.stop(IgnitionEx.java:2229)
at
org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance$2.run(IgnitionEx.java:1782)
2016-09-11 16:53:27,972 [ConsumeMessageThread_61] ERROR ErrorInfoLog -
Failed to update message [MessageExt [queueId=1, storeSize=988,
queueOffset=355723, sysFlag=0, bornTimestamp=1473344286350,
bornHost=/192.168.35.210:36486, storeTimestamp=1473344286350,
storeHost=/192.168.35.210:10911, msgId=C0A823D200002A9F00000029EBDD6CC3,
commitLogOffset=180050816195, bodyCRC=1441473701, reconsumeTimes=0,
preparedTransactionOffset=0, toString()=Message [topic=RelatedPreAlarmOrg,
flag=0, properties={TAGS=alarm, KEYS=1307607, WAIT=true, MAX_OFFSET=665658,
MIN_OFFSET=215497}, body=845]]] to ignite,caused by
class org.apache.ignite.IgniteException: Node stopped.
at
org.apache.ignite.internal.util.IgniteUtils.convertException(IgniteUtils.java:908)
at
org.apache.ignite.internal.util.future.IgniteFutureImpl.convertException(IgniteFutureImpl.java:153)
at
org.apache.ignite.internal.util.future.IgniteFutureImpl.get(IgniteFutureImpl.java:122)
at
com.ffcs.oss.ignite.rlam.service.impl.MQAlarmPushServiceImpl.consumeMessage(MQAlarmPushServiceImpl.java:46)
at
com.alibaba.rocketmq.client.impl.consumer.ConsumeMessageConcurrentlyService$ConsumeRequest.run(ConsumeMessageConcurrentlyService.java:142)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: class org.apache.ignite.IgniteCheckedException: Node stopped.
at
org.apache.ignite.internal.GridKernalGatewayImpl.setState(GridKernalGatewayImpl.java:208)
at org.apache.ignite.internal.IgniteKernal.stop0(IgniteKernal.java:1956)
at org.apache.ignite.internal.IgniteKernal.stop(IgniteKernal.java:1860)
at
org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.stop0(IgnitionEx.java:2266)
at
org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.stop(IgnitionEx.java:2229)
at
org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance$2.run(IgnitionEx.java:1782)
2016-09-11 16:53:28,006 [ConsumeMessageThread_12] ERROR ErrorInfoLog -
Ignite Client Disconnect,wait for reconnect
javax.cache.CacheException: class
org.apache.ignite.IgniteClientDisconnectedException: Data streamer has been
closed, client node disconnected.
at
org.apache.ignite.internal.processors.cache.GridCacheUtils.convertToCacheException(GridCacheUtils.java:1502)
at
org.apache.ignite.internal.processors.datastreamer.DataStreamerImpl.onDisconnected(DataStreamerImpl.java:1043)
at
org.apache.ignite.internal.processors.datastreamer.DataStreamProcessor.onDisconnected(DataStreamProcessor.java:160)
at
org.apache.ignite.internal.IgniteKernal.onDisconnected(IgniteKernal.java:3190)
at
org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$4.onDiscovery(GridDiscoveryManager.java:596)
at
org.apache.ignite.spi.discovery.tcp.ClientImpl$MessageWorker.notifyDiscovery(ClientImpl.java:2070)
at
org.apache.ignite.spi.discovery.tcp.ClientImpl$MessageWorker.notifyDiscovery(ClientImpl.java:2051)
at
org.apache.ignite.spi.discovery.tcp.ClientImpl$MessageWorker.body(ClientImpl.java:1440)
at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:62)
Caused by: class org.apache.ignite.IgniteClientDisconnectedException: Data
streamer has been closed, client node disconnected.
at
org.apache.ignite.internal.util.IgniteUtils$14.apply(IgniteUtils.java:829)
at
org.apache.ignite.internal.util.IgniteUtils$14.apply(IgniteUtils.java:827)
... 9 more
Caused by: class
org.apache.ignite.internal.IgniteClientDisconnectedCheckedException: Data
streamer has been closed, client node disconnected.
at
org.apache.ignite.internal.processors.datastreamer.DataStreamerImpl.onDisconnected(DataStreamerImpl.java:1040)
... 7 more
2016-09-11 16:53:27,972 [ConsumeMessageThread_64] ERROR ErrorInfoLog -
Failed to update message [MessageExt [queueId=1, storeSize=1142,
queueOffset=355724, sysFlag=0, bornTimestamp=1473344286350,
bornHost=/192.168.35.210:36486, storeTimestamp=1473344286351,
storeHost=/192.168.35.210:10911, msgId=C0A823D200002A9F00000029EBDD7D0E,
commitLogOffset=180050820366, bodyCRC=1258097122, reconsumeTimes=0,
preparedTransactionOffset=0, toString()=Message [topic=RelatedPreAlarmOrg,
flag=0, properties={TAGS=alarm, KEYS=1307607, WAIT=true, MAX_OFFSET=665658,
MIN_OFFSET=215497}, body=999]]] to ignite,caused by
class org.apache.ignite.IgniteException: Node stopped.
at
org.apache.ignite.internal.util.IgniteUtils.convertException(IgniteUtils.java:908)
at
org.apache.ignite.internal.util.future.IgniteFutureImpl.convertException(IgniteFutureImpl.java:153)
at
org.apache.ignite.internal.util.future.IgniteFutureImpl.get(IgniteFutureImpl.java:122)
at
com.ffcs.oss.ignite.rlam.service.impl.MQAlarmPushServiceImpl.consumeMessage(MQAlarmPushServiceImpl.java:46)
at
com.alibaba.rocketmq.client.impl.consumer.ConsumeMessageConcurrentlyService$ConsumeRequest.run(ConsumeMessageConcurrentlyService.java:142)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: class org.apache.ignite.IgniteCheckedException: Node stopped.
at
org.apache.ignite.internal.GridKernalGatewayImpl.setState(GridKernalGatewayImpl.java:208)
at org.apache.ignite.internal.IgniteKernal.stop0(IgniteKernal.java:1956)
at org.apache.ignite.internal.IgniteKernal.stop(IgniteKernal.java:1860)
at
org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.stop0(IgnitionEx.java:2266)
at
org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.stop(IgnitionEx.java:2229)
at
org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance$2.run(IgnitionEx.java:1782)
--
View this message in context:
http://apache-ignite-users.70518.x6.nabble.com/Slow-clients-can-not-reconnect-to-the-cluster-tp7665.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.
