[
https://issues.apache.org/jira/browse/IGNITE-23334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17886322#comment-17886322
]
Igor edited comment on IGNITE-23334 at 10/2/24 8:56 AM:
--------------------------------------------------------
One day before similar issue was happened on RocksDB storage, but on that build
there were no such issues on Aipersist storage. Because different timings of
this issue started, the issues are split into 2 different for different
storages.
was (Author: JIRAUSER299771):
One day before similar issue was happened on RocksDB storage, but on that build
there were no such issues on Aipersist storage. Because different timings of
this issue started, the issues are split into 2 different for different
storages.
> Aipersist: repeat of create table and drop column leads to freeze of client
> ---------------------------------------------------------------------------
>
> Key: IGNITE-23334
> URL: https://issues.apache.org/jira/browse/IGNITE-23334
> Project: Ignite
> Issue Type: Bug
> Environment: 3 nodes cluster running locally.
> Reporter: Igor
> Priority: Critical
> Attachments: server_logs.zip
>
>
> h3. Steps to reproduce:
> Run the next queries in cycle with 50 repeats in single connection:
> {code:java}
> drop table if exists dropNoMoreIndexedColumn
> create zone if not exists "rocksdb" engine rocksdb
> create table dropNoMoreIndexedColumn(k1 TIMESTAMP not null, k2 INTEGER not
> null, v0 TINYINT not null, v1 SMALLINT not null, v2 INTEGER not null, v3
> BIGINT not null, v4 VARCHAR not null, v5 TIMESTAMP not null, primary key (k1,
> k2)) with PRIMARY_ZONE='rocksdb'
> create index dropNoMoreIndexedColumn_v1idx on dropNoMoreIndexedColumn using
> TREE (v1)
> drop index dropNoMoreIndexedColumn_v1idx
> alter table dropNoMoreIndexedColumn drop column v1 {code}
> h3. Expected:
> All queries are executed.
> h3. Actual:
> On repeat 31 the client freeze for infinite amount of time.
> h3. Analysis:
> With storages aimem and aipersist the issue is not happen.
> The servers contain repeated error in logs:
>
> {code:java}
> 2024-10-02 02:59:59:572 +0000
> [INFO][%DropColumnsTest_cluster_2%JRaft-FSMCaller-Disruptormetastorage_stripe_0-0][MetaStorageWriteHandler]
> Idempotent command cache cleanup started [evictionTimestamp=HybridTimestamp
> [physical=2024-10-02 02:59:59:569 +0000, logical=55036,
> composite=113235591139809020]].
> 2024-10-02 02:59:59:626 +0000
> [INFO][%DropColumnsTest_cluster_2%JRaft-FSMCaller-Disruptormetastorage_stripe_0-0][MetaStorageWriteHandler]
> Idempotent command cache cleanup finished [evictionTimestamp=HybridTimestamp
> [physical=2024-10-02 02:59:59:569 +0000, logical=55036,
> composite=113235591139809020], cleanupCompletionTimestamp=HybridTimestamp
> [physical=2024-10-02 02:59:59:626 +0000, logical=0,
> composite=113235591143489536], removedEntriesCount=278, cacheSize=0].
> 2024-10-02 02:59:59:695 +0000
> [WARNING][%DropColumnsTest_cluster_2%JRaft-FSMCaller-Disruptormetastorage_stripe_0-0][LeaseUpdater]
> Lease update invocation failed because of concurrent update.
> 2024-10-02 03:00:00:213 +0000
> [WARNING][%DropColumnsTest_cluster_2%JRaft-FSMCaller-Disruptormetastorage_stripe_0-0][LeaseUpdater]
> Lease update invocation failed because of concurrent update.
> 2024-10-02 03:00:00:248 +0000
> [INFO][%DropColumnsTest_cluster_2%resource-vacuum-executor-0][VolatileTxStateMetaStorage]
> Vacuum started [vacuumObservationTimestamp=1727838000248,
> txnResourceTtl=30000].
> 2024-10-02 03:00:00:248 +0000
> [INFO][%DropColumnsTest_cluster_2%resource-vacuum-executor-0][VolatileTxStateMetaStorage]
> Vacuum finished [vacuumObservationTimestamp=1727838000248,
> txnResourceTtl=30000, vacuumizedTxnsCount=0,
> vacuumizedPersistentTxnStatesCount=0, markedAsInitiallyDetectedTxnsCount=0,
> alreadyMarkedTxnsCount=0, skippedForFurtherProcessingUnfinishedTxnsCount=0].
> 2024-10-02 03:00:00:710 +0000
> [INFO][%DropColumnsTest_cluster_2%lease-updater][LeaseUpdater] Leases updated
> (printed once per 10 iteration(s)): [inCurrentIteration=LeaseStats
> [leasesCreated=2025, leasesPublished=0, leasesProlonged=0,
> leasesWithoutCandidates=0], active=0, currentAssignmentsSize=2025].
> 2024-10-02 03:00:00:730 +0000
> [WARNING][%DropColumnsTest_cluster_2%JRaft-FSMCaller-Disruptormetastorage_stripe_0-0][LeaseUpdater]
> Lease update invocation failed because of concurrent update.
> 2024-10-02 03:00:01:244 +0000
> [WARNING][%DropColumnsTest_cluster_2%JRaft-FSMCaller-Disruptormetastorage_stripe_0-0][LeaseUpdater]
> Lease update invocation failed because of concurrent update.
> 2024-10-02 03:00:01:759 +0000
> [WARNING][%DropColumnsTest_cluster_2%JRaft-FSMCaller-Disruptormetastorage_stripe_0-0][LeaseUpdater]
> Lease update invocation failed because of concurrent update.
> 2024-10-02 03:00:02:276 +0000
> [WARNING][%DropColumnsTest_cluster_2%JRaft-FSMCaller-Disruptormetastorage_stripe_0-0][LeaseUpdater]
> Lease update invocation failed because of concurrent update.
> 2024-10-02 03:00:02:793 +0000
> [WARNING][%DropColumnsTest_cluster_2%JRaft-FSMCaller-Disruptormetastorage_stripe_0-0][LeaseUpdater]
> Lease update invocation failed because of concurrent update.
> 2024-10-02 03:00:03:310 +0000
> [WARNING][%DropColumnsTest_cluster_2%JRaft-FSMCaller-Disruptormetastorage_stripe_0-0][LeaseUpdater]
> Lease update invocation failed because of concurrent update.
> 2024-10-02 03:00:03:826 +0000
> [WARNING][%DropColumnsTest_cluster_2%JRaft-FSMCaller-Disruptormetastorage_stripe_0-0][LeaseUpdater]
> Lease update invocation failed because of concurrent update.
> 2024-10-02 03:00:04:337 +0000
> [WARNING][%DropColumnsTest_cluster_2%JRaft-FSMCaller-Disruptormetastorage_stripe_0-0][LeaseUpdater]
> Lease update invocation failed because of concurrent update.
> 2024-10-02 03:00:04:856 +0000
> [WARNING][%DropColumnsTest_cluster_2%JRaft-FSMCaller-Disruptormetastorage_stripe_0-0][LeaseUpdater]
> Lease update invocation failed because of concurrent update.
> 2024-10-02 03:00:05:373 +0000
> [WARNING][%DropColumnsTest_cluster_2%JRaft-FSMCaller-Disruptormetastorage_stripe_0-0][LeaseUpdater]
> Lease update invocation failed because of concurrent update.
> 2024-10-02 03:00:05:896 +0000
> [WARNING][%DropColumnsTest_cluster_2%JRaft-FSMCaller-Disruptormetastorage_stripe_0-0][LeaseUpdater]
> Lease update invocation failed because of concurrent update.
> 2024-10-02 03:00:06:393 +0000
> [INFO][%DropColumnsTest_cluster_2%lease-updater][LeaseUpdater] Leases updated
> (printed once per 10 iteration(s)): [inCurrentIteration=LeaseStats
> [leasesCreated=2025, leasesPublished=0, leasesProlonged=0,
> leasesWithoutCandidates=0], active=0, currentAssignmentsSize=2025]. {code}
> [^server_logs.zip]
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
