[ https://issues.apache.org/jira/browse/IGNITE-25398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Roman Puchkovskiy updated IGNITE-25398: --------------------------------------- Description: The following exception happened and was propagated to the Failure Processor: 2025-05-16T06:59:28,491][ERROR][%ihaprt_throtz_3344%Raft-Group-Client-4][FailureManager] Critical system error detected. Will be handled accordingly to configured handler [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], failureCtx=CRITICAL_ERROR] org.apache.ignite.internal.failure.StackTraceCapturingException: Rebalance failover subscription on elected primary replica failed [groupId=26_part_0]. at org.apache.ignite.internal.failure.FailureManager.process(FailureManager.java:153) ~[ignite-failure-handler-9.1.127-SNAPSHOT.jar:?] at org.apache.ignite.internal.failure.FailureManager.process(FailureManager.java:130) ~[ignite-failure-handler-9.1.127-SNAPSHOT.jar:?] at org.apache.ignite.internal.replicator.ReplicaImpl.lambda$registerFailoverCallback$2(ReplicaImpl.java:187) ~[ignite-replicator-9.1.127-SNAPSHOT.jar:?] at java.base/java.util.concurrent.CompletableFuture.uniExceptionally(CompletableFuture.java:990) [?:?] at java.base/java.util.concurrent.CompletableFuture$UniExceptionally.tryFire(CompletableFuture.java:974) [?:?] at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:510) [?:?] at java.base/java.util.concurrent.CompletableFuture.postFire(CompletableFuture.java:614) [?:?] at java.base/java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:844) [?:?] at java.base/java.util.concurrent.CompletableFuture$Completion.run(CompletableFuture.java:482) [?:?] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) [?:?] at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304) [?:?] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?] at java.base/java.lang.Thread.run(Thread.java:833) [?:?] Caused by: java.util.concurrent.CompletionException: org.apache.ignite.internal.network.RecipientLeftException: IGN-NETWORK-5 TraceId:a9ceb148-91e4-4a72-9bbd-3e114798f55b at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:332) ~[?:?] at java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:347) ~[?:?] at java.base/java.util.concurrent.CompletableFuture$UniCompose.tryFire(CompletableFuture.java:1141) ~[?:?] at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:510) ~[?:?] at java.base/java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:2162) ~[?:?] at org.apache.ignite.internal.network.OutNetworkObject.failAcknowledgement(OutNetworkObject.java:87) ~[ignite-network-9.1.127-SNAPSHOT.jar:?] at org.apache.ignite.internal.network.recovery.RecoveryDescriptor.dispose(RecoveryDescriptor.java:257) ~[ignite-network-9.1.127-SNAPSHOT.jar:?] at org.apache.ignite.internal.network.netty.ConnectionManager.blockAndDisposeDescriptor(ConnectionManager.java:702) ~[ignite-network-9.1.127-SNAPSHOT.jar:?] at org.apache.ignite.internal.network.netty.ConnectionManager.disposeRecoveryDescriptorsOfLeftNode(ConnectionManager.java:670) ~[ignite-network-9.1.127-SNAPSHOT.jar:?] at org.apache.ignite.internal.network.netty.ConnectionManager.lambda$handleNodeLeft$9(ConnectionManager.java:646) ~[ignite-network-9.1.127-SNAPSHOT.jar:?] at java.base/java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:863) ~[?:?] at java.base/java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:841) ~[?:?] at java.base/java.util.concurrent.CompletableFuture$Completion.run(CompletableFuture.java:482) ~[?:?] ... 3 more Such exceptions should be treated as recoverable. > Handle RecipientLeftException in topology-aware raft client > ----------------------------------------------------------- > > Key: IGNITE-25398 > URL: https://issues.apache.org/jira/browse/IGNITE-25398 > Project: Ignite > Issue Type: Improvement > Reporter: Roman Puchkovskiy > Assignee: Roman Puchkovskiy > Priority: Major > Labels: ignite-3 > > The following exception happened and was propagated to the Failure Processor: > > 2025-05-16T06:59:28,491][ERROR][%ihaprt_throtz_3344%Raft-Group-Client-4][FailureManager] > Critical system error detected. Will be handled accordingly to configured > handler [hnd=NoOpFailureHandler [super=AbstractFailureHandler > [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, > SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], failureCtx=CRITICAL_ERROR] > org.apache.ignite.internal.failure.StackTraceCapturingException: Rebalance > failover subscription on elected primary replica failed [groupId=26_part_0]. > at > org.apache.ignite.internal.failure.FailureManager.process(FailureManager.java:153) > ~[ignite-failure-handler-9.1.127-SNAPSHOT.jar:?] > at > org.apache.ignite.internal.failure.FailureManager.process(FailureManager.java:130) > ~[ignite-failure-handler-9.1.127-SNAPSHOT.jar:?] > at > org.apache.ignite.internal.replicator.ReplicaImpl.lambda$registerFailoverCallback$2(ReplicaImpl.java:187) > ~[ignite-replicator-9.1.127-SNAPSHOT.jar:?] > at > java.base/java.util.concurrent.CompletableFuture.uniExceptionally(CompletableFuture.java:990) > [?:?] > at > java.base/java.util.concurrent.CompletableFuture$UniExceptionally.tryFire(CompletableFuture.java:974) > [?:?] > at > java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:510) > [?:?] > at > java.base/java.util.concurrent.CompletableFuture.postFire(CompletableFuture.java:614) > [?:?] > at > java.base/java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:844) > [?:?] > at > java.base/java.util.concurrent.CompletableFuture$Completion.run(CompletableFuture.java:482) > [?:?] > at > java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) > [?:?] > at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?] > at > java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304) > [?:?] > at > java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) > [?:?] > at > java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) > [?:?] > at java.base/java.lang.Thread.run(Thread.java:833) [?:?] > Caused by: java.util.concurrent.CompletionException: > org.apache.ignite.internal.network.RecipientLeftException: IGN-NETWORK-5 > TraceId:a9ceb148-91e4-4a72-9bbd-3e114798f55b > at > java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:332) > ~[?:?] > at > java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:347) > ~[?:?] > at > java.base/java.util.concurrent.CompletableFuture$UniCompose.tryFire(CompletableFuture.java:1141) > ~[?:?] > at > java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:510) > ~[?:?] > at > java.base/java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:2162) > ~[?:?] > at > org.apache.ignite.internal.network.OutNetworkObject.failAcknowledgement(OutNetworkObject.java:87) > ~[ignite-network-9.1.127-SNAPSHOT.jar:?] > at > org.apache.ignite.internal.network.recovery.RecoveryDescriptor.dispose(RecoveryDescriptor.java:257) > ~[ignite-network-9.1.127-SNAPSHOT.jar:?] > at > org.apache.ignite.internal.network.netty.ConnectionManager.blockAndDisposeDescriptor(ConnectionManager.java:702) > ~[ignite-network-9.1.127-SNAPSHOT.jar:?] > at > org.apache.ignite.internal.network.netty.ConnectionManager.disposeRecoveryDescriptorsOfLeftNode(ConnectionManager.java:670) > ~[ignite-network-9.1.127-SNAPSHOT.jar:?] > at > org.apache.ignite.internal.network.netty.ConnectionManager.lambda$handleNodeLeft$9(ConnectionManager.java:646) > ~[ignite-network-9.1.127-SNAPSHOT.jar:?] > at > java.base/java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:863) > ~[?:?] > at > java.base/java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:841) > ~[?:?] > at > java.base/java.util.concurrent.CompletableFuture$Completion.run(CompletableFuture.java:482) > ~[?:?] > ... 3 more > > Such exceptions should be treated as recoverable. -- This message was sent by Atlassian Jira (v8.20.10#820010)