Finally managed to reproduce but it went slightly different this time.
The node was not removed from the cluster after the 10 minutes like I said.
It seemed to work again after 15 minutes.
But meanwhile all the requests I sent to my node1 that were using the cache
remained pending.
Logs
Node1
/2018-07-04 15:14:41,232 WARN o.apache.ignite.internal.diagnostic - Found
long running cache future [startTime=15:13:03.909, curTime=15:14:41.223,
fut=GridNearAtomicSingleUpdateFuture [reqState=Primary
[id=d0daf95e-49c0-4071-b6bc-cd7e279c0582, opRes=true, expCnt=2, rcvdCnt=1,
primaryRes=false, done=false,
waitFor=[a0830a00-1970-43b4-b143-6e1947f0059f],
rcvd=[4313271e-8273-4f28-bcab-aac3a43e6722]],
super=GridNearAtomicAbstractUpdateFuture [remapCnt=100,
topVer=AffinityTopologyVersion [topVer=5, minorTopVer=1], remapTopVer=null,
err=null, futId=507917, super=GridFutureAdapter [ignoreInterrupts=false,
state=INIT, res=null, hash=1016566303]]]]
2018-07-04 15:15:41,236 WARN o.apache.ignite.internal.diagnostic - Found
long running cache future [startTime=15:14:38.102, curTime=15:15:41.227,
fut=GridDhtAtomicSingleUpdateFuture [allUpdated=true,
super=GridDhtAtomicAbstractUpdateFuture [futId=622594, resCnt=1,
addedReader=false, dhtRes={d0daf95e-49c0-4071-b6bc-cd7e279c0582=[res=false,
size=1, nearSize=0], a0830a00-1970-43b4-b143-6e1947f0059f=[res=true, size=1,
nearSize=0]}]]]
2018-07-04 15:15:41,240 WARN o.apache.ignite.internal.diagnostic - Found
long running cache future [startTime=15:14:38.102, curTime=15:15:41.227,
fut=GridNearAtomicSingleUpdateFuture [reqState=Primary
[id=4313271e-8273-4f28-bcab-aac3a43e6722, opRes=true, expCnt=2, rcvdCnt=1,
primaryRes=true, done=false, waitFor=[d0daf95e-49c0-4071-b6bc-cd7e279c0582],
rcvd=[a0830a00-1970-43b4-b143-6e1947f0059f]],
super=GridNearAtomicAbstractUpdateFuture [remapCnt=100,
topVer=AffinityTopologyVersion [topVer=5, minorTopVer=1], remapTopVer=null,
err=null, futId=622593, super=GridFutureAdapter [ignoreInterrupts=false,
state=INIT, res=null, hash=2076320652]]]]
2018-07-04 15:17:41,247 WARN o.apache.ignite.internal.diagnostic - Found
long running cache future [startTime=15:14:53.759, curTime=15:17:41.246,
fut=GridNearAtomicSingleUpdateFuture [reqState=Primary
[id=d0daf95e-49c0-4071-b6bc-cd7e279c0582, opRes=true, expCnt=2, rcvdCnt=1,
primaryRes=false, done=false,
waitFor=[a0830a00-1970-43b4-b143-6e1947f0059f],
rcvd=[4313271e-8273-4f28-bcab-aac3a43e6722]],
super=GridNearAtomicAbstractUpdateFuture [remapCnt=100,
topVer=AffinityTopologyVersion [topVer=5, minorTopVer=1], remapTopVer=null,
err=null, futId=507918, super=GridFutureAdapter [ignoreInterrupts=false,
state=INIT, res=null, hash=870007217]]]]
2018-07-04 15:17:41,248 WARN o.apache.ignite.internal.diagnostic - Found
long running cache future [startTime=15:14:44.440, curTime=15:17:41.246,
fut=GridNearAtomicSingleUpdateFuture [reqState=Primary
[id=d0daf95e-49c0-4071-b6bc-cd7e279c0582, opRes=true, expCnt=2, rcvdCnt=1,
primaryRes=false, done=false,
waitFor=[a0830a00-1970-43b4-b143-6e1947f0059f],
rcvd=[4313271e-8273-4f28-bcab-aac3a43e6722]],
super=GridNearAtomicAbstractUpdateFuture [remapCnt=100,
topVer=AffinityTopologyVersion [topVer=5, minorTopVer=1], remapTopVer=null,
err=null, futId=409607, super=GridFutureAdapter [ignoreInterrupts=false,
state=INIT, res=null, hash=1258252543]]]]/
Node2
/2018-07-04 15:14:37,826 WARN o.apache.ignite.internal.diagnostic - Found
long running cache future [startTime=15:13:03.909, curTime=15:14:37.824,
fut=GridDhtAtomicSingleUpdateFuture [allUpdated=true,
super=GridDhtAtomicAbstractUpdateFuture [futId=475137, resCnt=1,
addedReader=false, dhtRes={a0830a00-1970-43b4-b143-6e1947f0059f=[res=false,
size=1, nearSize=0], 4313271e-8273-4f28-bcab-aac3a43e6722=[res=true, size=1,
nearSize=0]}]]]
2018-07-04 15:17:37,834 WARN o.apache.ignite.internal.diagnostic - Found
long running cache future [startTime=15:16:23.876, curTime=15:17:37.830,
fut=GridDhtAtomicSingleUpdateFuture [allUpdated=true,
super=GridDhtAtomicAbstractUpdateFuture [futId=475138, resCnt=1,
addedReader=false, dhtRes={a0830a00-1970-43b4-b143-6e1947f0059f=[res=false,
size=1, nearSize=0], 4313271e-8273-4f28-bcab-aac3a43e6722=[res=true, size=1,
nearSize=0]}]]]
2018-07-04 15:17:37,837 WARN o.apache.ignite.internal.diagnostic - Found
long running cache future [startTime=15:16:23.876, curTime=15:17:37.830,
fut=GridDhtAtomicSingleUpdateFuture [allUpdated=true,
super=GridDhtAtomicAbstractUpdateFuture [futId=491521, resCnt=1,
addedReader=false, dhtRes={a0830a00-1970-43b4-b143-6e1947f0059f=[res=false,
size=1, nearSize=0], 4313271e-8273-4f28-bcab-aac3a43e6722=[res=true, size=1,
nearSize=0]}]]]/
Node3
Nothing
Configuration
/Using org.apache.ignite.configuration.IgniteConfiguration, and setting the
following values:
setIgniteInstanceName <= <name>
setConsistentId <= <name>
setIgniteHome <= <path>
setAddressResolver <= new BasicAddressResolver(<mappings>)
setMarshaller <= new OptimizedMarshaller( true )
setDataStorageConfiguration <= new DataStorageConfiguration()
getDefaultDataRegionConfiguration().setMaxSize <= <heap max size>
setConnectorConfiguration <= null
setClientConnectorConfiguration <= null
setLocalHost <= <localhost>
setDiscoverySpi <= new TcpDiscoverySpi()
setLocalPort <= 47500
setLocalPortRange <= 0
setLocalAddress <= <localhost>
setReconnectCount <= 10
setAckTimeout <= 2000L
setJoinTimeout <= 0L
setNetworkTimeout <= 5000L
setSocketTimeout <= 2000L
setStatisticsPrintFrequency <= 0
setGridLogger <= new Log4JWrapper(...)
setMetricsLogFrequency <= 0
setClassLoader <= new ContainerSweepClassLoader(<bundle>, <classloader>)/
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/