Alexey Scherbakov created IGNITE-23236:
------------------------------------------

             Summary:  ReplicaTimeoutException with very high parallelism level
                 Key: IGNITE-23236
                 URL: https://issues.apache.org/jira/browse/IGNITE-23236
             Project: Ignite
          Issue Type: Bug
            Reporter: Alexey Scherbakov
             Fix For: 3.0


How to reproduce:
1. Set large number of JMH threads in UpsertKvBenchmark (I've used 4444)
2. Fix it to suppport concurrency (replace int id with AtomicInteger id

The bechmark produces ReplicaTimeoutException soon after execution.
{noformat}
org.apache.ignite.tx.TransactionException: IGN-REP-3 
TraceId:4540ebf5-5b94-4ce4-88d8-818bea5e6449 Replication is timed out 
[replicaGrpId=10_part_1]
        at 
java.base/java.lang.invoke.MethodHandle.invokeWithArguments(MethodHandle.java:733)
        at 
org.apache.ignite.internal.util.ExceptionUtils$1.copy(ExceptionUtils.java:789)
        at 
org.apache.ignite.internal.util.ExceptionUtils$ExceptionFactory.createCopy(ExceptionUtils.java:723)
        at 
org.apache.ignite.internal.util.ExceptionUtils.copyExceptionWithCause(ExceptionUtils.java:525)
        at 
org.apache.ignite.internal.util.ViewUtils.copyExceptionWithCauseIfPossible(ViewUtils.java:91)
        at 
org.apache.ignite.internal.util.ViewUtils.ensurePublicException(ViewUtils.java:71)
        at org.apache.ignite.internal.util.ViewUtils.sync(ViewUtils.java:54)
        at 
org.apache.ignite.internal.table.KeyValueBinaryViewImpl.put(KeyValueBinaryViewImpl.java:206)
        at 
org.apache.ignite.internal.table.KeyValueBinaryViewImpl.put(KeyValueBinaryViewImpl.java:70)
        at 
org.apache.ignite.internal.table.PublicApiThreadingKeyValueView.lambda$put$12(PublicApiThreadingKeyValueView.java:117)
        at 
org.apache.ignite.internal.thread.PublicApiThreading.lambda$execUserSyncOperation$1(PublicApiThreading.java:116)
        at 
org.apache.ignite.internal.thread.PublicApiThreading.executeWithRole(PublicApiThreading.java:144)
        at 
org.apache.ignite.internal.thread.PublicApiThreading.execUserSyncOperation(PublicApiThreading.java:102)
        at 
org.apache.ignite.internal.thread.PublicApiThreading.execUserSyncOperation(PublicApiThreading.java:115)
        at 
org.apache.ignite.internal.table.PublicApiThreadingViewBase.executeSyncOp(PublicApiThreadingViewBase.java:111)
        at 
org.apache.ignite.internal.table.PublicApiThreadingKeyValueView.put(PublicApiThreadingKeyValueView.java:117)
        at 
org.apache.ignite.internal.restart.RestartProofKeyValueView.lambda$put$12(RestartProofKeyValueView.java:118)
        at 
org.apache.ignite.internal.restart.RestartProofApiObject.lambda$consumeAttached$1(RestartProofApiObject.java:55)
        at 
org.apache.ignite.internal.restart.IgniteAttachmentLock.consumeAttached(IgniteAttachmentLock.java:75)
        at 
org.apache.ignite.internal.restart.RestartProofApiObject.consumeAttached(RestartProofApiObject.java:55)
        at 
org.apache.ignite.internal.restart.RestartProofKeyValueView.put(RestartProofKeyValueView.java:118)
        at 
org.apache.ignite.internal.benchmark.UpsertKvBenchmark.upsert(UpsertKvBenchmark.java:87)
        at 
org.apache.ignite.internal.benchmark.jmh_generated.UpsertKvBenchmark_upsert_jmhTest.upsert_Throughput(UpsertKvBenchmark_upsert_jmhTest.java:78)
        at 
java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:103)
        at java.base/java.lang.reflect.Method.invoke(Method.java:580)
        at 
org.openjdk.jmh.runner.BenchmarkHandler$BenchmarkTask.call(BenchmarkHandler.java:527)
        at 
org.openjdk.jmh.runner.BenchmarkHandler$BenchmarkTask.call(BenchmarkHandler.java:504)
        at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:317)
        at 
java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:572)
        at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:317)
        at 
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
        at 
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
        at java.base/java.lang.Thread.run(Thread.java:1583)
Caused by: org.apache.ignite.tx.TransactionException: IGN-REP-3 
TraceId:4540ebf5-5b94-4ce4-88d8-818bea5e6449 Replication is timed out 
[replicaGrpId=10_part_1]
        at 
org.apache.ignite.internal.tx.TransactionExceptionMapperProvider.lambda$mappers$1(TransactionExceptionMapperProvider.java:44)
        at 
org.apache.ignite.internal.lang.IgniteExceptionMapper.map(IgniteExceptionMapper.java:61)
        at 
org.apache.ignite.internal.lang.IgniteExceptionMapperUtil.map(IgniteExceptionMapperUtil.java:195)
        at 
org.apache.ignite.internal.lang.IgniteExceptionMapperUtil.mapToPublicException(IgniteExceptionMapperUtil.java:125)
        at 
org.apache.ignite.internal.lang.IgniteExceptionMapperUtil.mapToPublicException(IgniteExceptionMapperUtil.java:88)
        at 
org.apache.ignite.internal.lang.IgniteExceptionMapperUtil.lambda$convertToPublicFuture$3(IgniteExceptionMapperUtil.java:178)
        at 
java.base/java.util.concurrent.CompletableFuture.uniHandle(CompletableFuture.java:934)
        at 
java.base/java.util.concurrent.CompletableFuture$UniHandle.tryFire(CompletableFuture.java:911)
        at 
java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:510)
        at 
java.base/java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:2194)
        at 
org.apache.ignite.internal.replicator.ReplicaService.lambda$sendToReplica$0(ReplicaService.java:148)
        ... 3 more
Caused by: 
org.apache.ignite.internal.replicator.exception.ReplicationTimeoutException: 
IGN-REP-3 TraceId:4540ebf5-5b94-4ce4-88d8-818bea5e6449 Replication is timed out 
[replicaGrpId=10_part_1]
        ... 4 more{noformat}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to