Hi Rick, Looks weird. Cache operation on replicated cache on server node should not failed when other node leaved. Would you please attach logs?
Ignite 2.0 ETA should be release on next week. But seems, it may delays for 1-2 weeks as there is neither node freeze happened nor vote started. On Fri, Apr 21, 2017 at 12:10 PM, rick_tem <[email protected]> wrote: > Hi Andrey, > > Thanks for you response. Still seems to be problematic. See below. Any > idea when 2.0 will be available? Recall I had one Ignite as a client in > Jboss and two Ignite servers. What I've done is force the Jboss into a > server, and start one other Ignite instance (two Ignite server nodes, 0 > clients). Now when I kill the Ignite node, I did get some exceptions in > the > Jboss console and at least once I had some remove cache operations fail. I > don't believe this should happen in replicated mode and assume this is the > same bug. So to get around that, I catch any exception around the > cache.remove(key) and retry, but since, I haven't been able to reproduce > it. > I'll try to see if I can write a test case for it. Regardless, whether > client or server, I think we shouldn't expect failures in replicated mode > with the below config, correct? Oracle Coherence doesn't fail when you > take > down a node in replicated mode. > > Thanks, > Rick > > <bean class="org.apache.ignite. > configuration.CacheConfiguration"> > <property name="name" > value="MyCache" /> > <property name="cacheMode" > value="REPLICATED" /> > <property name="memoryMode" > value="ONHEAP_TIERED" /> > > <property name="offHeapMaxMemory" > value="#{10 * 1024L * 1024L * 1024L}" > /> > <property name="evictionPolicy"> > > <bean > class="org.apache.ignite.cache.eviction.lru.LruEvictionPolicy"> > > <property > name="maxSize" value="1000000" /> > </bean> > </property> > <property name="atomicityMode" > value="TRANSACTIONAL" /> > <property name="backups" value="1" > /> > <property > name="writeSynchronizationMode" > value="FULL_SYNC" /> > <property name="statisticsEnabled" > value="true" /> > </bean> > </list> > </property> > > > C:\java\GitHub\ignite1.9\ignite-1.9\modules [ignite-1.9 ≡ +20 ~14 -0 !]> > git > apply --verbose --check 4473.patch > Checking patch > modules/core/src/main/java/org/apache/ignite/internal/ > IgniteNeedReconnectException.java... > error: while searching for: > > error: patch failed: > modules/core/src/main/java/org/apache/ignite/internal/ > IgniteNeedReconnectException.java:0 > error: > modules/core/src/main/java/org/apache/ignite/internal/ > IgniteNeedReconnectException.java: > patch does not apply > Checking patch > modules/core/src/main/java/org/apache/ignite/spi/ > discovery/tcp/TcpDiscoverySpi.java... > error: while searching for: > return ignite().configuration().getSslContextFactory() != null; > } > > /** > * <strong>FOR TEST ONLY!!!</strong> > */ > > error: patch failed: > modules/core/src/main/java/org/apache/ignite/spi/ > discovery/tcp/TcpDiscoverySpi.java:1933 > error: > modules/core/src/main/java/org/apache/ignite/spi/ > discovery/tcp/TcpDiscoverySpi.java: > patch does not apply > Checking patch > modules/core/src/test/java/org/apache/ignite/testsuites/ > IgniteClientReconnectTestSuite.java... > error: while searching for: > import org.apache.ignite.internal.IgniteClientReconnectServicesTest; > import org.apache.ignite.internal.IgniteClientReconnectStopTest; > import org.apache.ignite.internal.IgniteClientReconnectStreamerTest; > > /** > * > > error: patch failed: > modules/core/src/test/java/org/apache/ignite/testsuites/ > IgniteClientReconnectTestSuite.java:29 > error: > modules/core/src/test/java/org/apache/ignite/testsuites/ > IgniteClientReconnectTestSuite.java: > patch does not apply > Checking patch > modules/core/src/main/java/org/apache/ignite/internal/IgniteKernal.java... > error: while searching for: > /** Periodic starvation check interval. */ > private static final long PERIODIC_STARVATION_CHECK_FREQ = 1000 * 30; > > /** */ > @GridToStringExclude > private GridKernalContextImpl ctx; > > error: patch failed: > modules/core/src/main/java/org/apache/ignite/internal/ > IgniteKernal.java:253 > error: > modules/core/src/main/java/org/apache/ignite/internal/IgniteKernal.java: > patch does not apply > Checking patch > modules/core/src/main/java/org/apache/ignite/spi/ > discovery/tcp/ServerImpl.java... > error: while searching for: > throw new UnsupportedOperationException(); > } > > /** {@inheritDoc} */ > @Override protected IgniteSpiThread workerThread() { > return msgWorker; > > error: patch failed: > modules/core/src/main/java/org/apache/ignite/spi/ > discovery/tcp/ServerImpl.java:1589 > error: > modules/core/src/main/java/org/apache/ignite/spi/ > discovery/tcp/ServerImpl.java: > patch does not apply > Checking patch > modules/core/src/test/java/org/apache/ignite/internal/ > IgniteClientReconnectCacheTest.java... > error: while searching for: > try { > > Ignition.start(optimize(getConfiguration(getTestGridName(SRV_CNT)))); > > fail(); > > return false; > } > catch (IgniteClientDisconnectedException e) { > log.info("Expected start error: " + e); > > error: patch failed: > modules/core/src/test/java/org/apache/ignite/internal/ > IgniteClientReconnectCacheTest.java:700 > error: > modules/core/src/test/java/org/apache/ignite/internal/ > IgniteClientReconnectCacheTest.java: > patch does not apply > Checking patch > modules/core/src/test/java/org/apache/ignite/internal/ > IgniteClientRejoinTest.java... > error: while searching for: > > error: patch failed: > modules/core/src/test/java/org/apache/ignite/internal/ > IgniteClientRejoinTest.java:0 > error: > modules/core/src/test/java/org/apache/ignite/internal/ > IgniteClientRejoinTest.java: > patch does not apply > Checking patch > modules/core/src/main/java/org/apache/ignite/spi/ > discovery/tcp/ClientImpl.java... > error: while searching for: > /** */ > private static final Object SPI_RECONNECT_FAILED = > "SPI_RECONNECT_FAILED"; > > /** Remote nodes. */ > private final ConcurrentMap<UUID, TcpDiscoveryNode> rmtNodes = new > ConcurrentHashMap8<>(); > > > error: patch failed: > modules/core/src/main/java/org/apache/ignite/spi/ > discovery/tcp/ClientImpl.java:127 > error: > modules/core/src/main/java/org/apache/ignite/spi/ > discovery/tcp/ClientImpl.java: > patch does not apply > Checking patch > modules/core/src/main/java/org/apache/ignite/internal/processors/cache/ > GridCachePartitionExchangeManager.java... > error: while searching for: > import java.util.concurrent.locks.ReadWriteLock; > import java.util.concurrent.locks.ReentrantReadWriteLock; > import org.apache.ignite.IgniteCheckedException; > import org.apache.ignite.IgniteSystemProperties; > import org.apache.ignite.cache.affinity.AffinityFunction; > import org.apache.ignite.cluster.ClusterNode; > > error: patch failed: > modules/core/src/main/java/org/apache/ignite/internal/processors/cache/ > GridCachePartitionExchangeManager.java:43 > error: > modules/core/src/main/java/org/apache/ignite/internal/processors/cache/ > GridCachePartitionExchangeManager.java: > patch does not apply > Checking patch > modules/core/src/main/java/org/apache/ignite/internal/ > GridKernalGatewayImpl.java... > error: while searching for: > > /** */ > @GridToStringExclude > private IgniteFutureImpl<?> reconnectFut; > > /** */ > private final AtomicReference<GridKernalState> state = new > AtomicReference<>(GridKernalState.STOPPED); > > error: patch failed: > modules/core/src/main/java/org/apache/ignite/internal/ > GridKernalGatewayImpl.java:44 > error: > modules/core/src/main/java/org/apache/ignite/internal/ > GridKernalGatewayImpl.java: > patch does not apply > Checking patch > modules/core/src/main/java/org/apache/ignite/spi/discovery/tcp/ > TcpDiscoveryImpl.java... > error: while searching for: > import org.apache.ignite.IgniteException; > import org.apache.ignite.IgniteLogger; > import org.apache.ignite.cluster.ClusterNode; > import org.apache.ignite.internal.IgniteInterruptedCheckedException; > import org.apache.ignite.internal.util.typedef.internal.LT; > import org.apache.ignite.internal.util.typedef.internal.U; > > error: patch failed: > modules/core/src/main/java/org/apache/ignite/spi/discovery/tcp/ > TcpDiscoveryImpl.java:29 > error: > modules/core/src/main/java/org/apache/ignite/spi/discovery/tcp/ > TcpDiscoveryImpl.java: > patch does not apply > Checking patch > modules/core/src/main/java/org/apache/ignite/internal/ > processors/cache/distributed/dht/GridDhtAssignmentFetchFuture.java... > error: while searching for: > import org.apache.ignite.internal.util.future.GridFutureAdapter; > import org.apache.ignite.internal.util.tostring.GridToStringInclude; > import org.apache.ignite.internal.util.typedef.T2; > import org.apache.ignite.internal.util.typedef.internal.CU; > import org.apache.ignite.internal.util.typedef.internal.S; > import org.apache.ignite.internal.util.typedef.internal.U; > > error: patch failed: > modules/core/src/main/java/org/apache/ignite/internal/ > processors/cache/distributed/dht/GridDhtAssignmentFetchFuture.java:33 > error: > modules/core/src/main/java/org/apache/ignite/internal/ > processors/cache/distributed/dht/GridDhtAssignmentFetchFuture.java: > patch does not apply > Checking patch > modules/core/src/main/java/org/apache/ignite/internal/ > processors/cache/distributed/dht/preloader/GridDhtPartitionsExchangeFutur > e.java... > error: while searching for: > > package > org.apache.ignite.internal.processors.cache.distributed.dht.preloader; > > import java.util.ArrayList; > import java.util.Collection; > import java.util.Collections; > > error: patch failed: > modules/core/src/main/java/org/apache/ignite/internal/ > processors/cache/distributed/dht/preloader/GridDhtPartitionsExchangeFutur > e.java:17 > error: > modules/core/src/main/java/org/apache/ignite/internal/ > processors/cache/distributed/dht/preloader/GridDhtPartitionsExchangeFutur > e.java: > patch does not apply > Checking patch > modules/core/src/main/java/org/apache/ignite/internal/processors/service/ > GridServiceProcessor.java... > error: while searching for: > } > } > > /** > * Deployment callback. > * > * @param dep Service deployment. > * @param topVer Topology version. > */ > private void onDeployment(final GridServiceDeployment dep, final > AffinityTopologyVersion topVer) { > // Retry forever. > try { > AffinityTopologyVersion newTopVer = > ctx.discovery().topologyVersionEx(); > > // If topology version changed, reassignment will happen > from topology event. > if (newTopVer.equals(topVer)) > reassign(dep, topVer); > } > catch (IgniteCheckedException e) { > if (!(e instanceof ClusterTopologyCheckedException)) > log.error("Failed to do service reassignment (will > retry): " + dep.configuration().getName(), e); > > AffinityTopologyVersion newTopVer = > ctx.discovery().topologyVersionEx(); > > if (!newTopVer.equals(topVer)) { > assert newTopVer.compareTo(topVer) > 0; > > // Reassignment will happen from topology event. > return; > } > > ctx.timeout().addTimeoutObject(new GridTimeoutObject() { > private IgniteUuid id = IgniteUuid.randomUuid(); > > private long start = System.currentTimeMillis(); > > @Override public IgniteUuid timeoutId() { > return id; > } > > @Override public long endTime() { > return start + RETRY_TIMEOUT; > } > > @Override public void onTimeout() { > if (!busyLock.enterBusy()) > return; > > try { > // Try again. > onDeployment(dep, topVer); > } > finally { > busyLock.leaveBusy(); > } > } > }); > } > } > > > error: patch failed: > modules/core/src/main/java/org/apache/ignite/internal/processors/service/ > GridServiceProcessor.java:1508 > error: > modules/core/src/main/java/org/apache/ignite/internal/processors/service/ > GridServiceProcessor.java: > patch does not apply > Checking patch > modules/core/src/main/java/org/apache/ignite/internal/managers/discovery/ > GridDiscoveryManager.java... > error: while searching for: > import org.apache.ignite.spi.discovery.DiscoverySpiListener; > import org.apache.ignite.spi.discovery.DiscoverySpiNodeAuthenticator; > import org.apache.ignite.spi.discovery.DiscoverySpiOrderSupport; > import org.apache.ignite.thread.IgniteThread; > import org.jetbrains.annotations.Nullable; > import org.jsr166.ConcurrentHashMap8; > > error: patch failed: > modules/core/src/main/java/org/apache/ignite/internal/managers/discovery/ > GridDiscoveryManager.java:112 > error: > modules/core/src/main/java/org/apache/ignite/internal/managers/discovery/ > GridDiscoveryManager.java: > patch does not apply > Checking patch > modules/core/src/test/java/org/apache/ignite/spi/discovery/tcp/ > TcpClientDiscoverySpiSelfTest.java... > error: while searching for: > import java.util.concurrent.atomic.AtomicInteger; > import org.apache.ignite.Ignite; > import org.apache.ignite.IgniteCheckedException; > import org.apache.ignite.IgniteInterruptedException; > import org.apache.ignite.IgniteMessaging; > import org.apache.ignite.IgniteState; > > error: patch failed: > modules/core/src/test/java/org/apache/ignite/spi/discovery/tcp/ > TcpClientDiscoverySpiSelfTest.java:32 > error: > modules/core/src/test/java/org/apache/ignite/spi/discovery/tcp/ > TcpClientDiscoverySpiSelfTest.java: > patch does not apply > C:\java\GitHub\ignite1.9\ignite-1.9\modules [ignite-1.9 ≡ +20 ~14 -0 !]> > > > > -- > View this message in context: http://apache-ignite-users. > 70518.x6.nabble.com/IgniteCacheProxy-connection- > failure-in-REPLICATAED-mode-tp11769p12140.html > Sent from the Apache Ignite Users mailing list archive at Nabble.com. > -- Best regards, Andrey V. Mashenkov
