Pavel Pereslegin created IGNITE-17456:
-----------------------------------------
Summary: After node restart, there are duplicate messages about
WAL segment compression.
Key: IGNITE-17456
URL: https://issues.apache.org/jira/browse/IGNITE-17456
Project: Ignite
Issue Type: Bug
Reporter: Pavel Pereslegin
Assignee: Pavel Pereslegin
If you enable compression of WAL segments and at the same time set the WAL
archive size too small, then compression will not actually occur, but after
each node restart, "fake" notifications about segment compression are
sequentially written to the log from the beginning (see log example below).
{noformat}
[2022-08-02T14:46:33,757][INFO
][test-runner-#1%wal.WalCompactionAfterRestartTest%][FileWriteAheadLogManager]
Resolved write ahead log work directory:
/home/xtern/src/java/ignite/work/db/wal/node00-63fb6fa2-fcea-42aa-a3c8-b36cd330ba7c
[2022-08-02T14:46:33,757][INFO
][test-runner-#1%wal.WalCompactionAfterRestartTest%][FileWriteAheadLogManager]
Resolved write ahead log archive directory:
/home/xtern/src/java/ignite/work/db/wal/archive/node00-63fb6fa2-fcea-42aa-a3c8-b36cd330ba7c
[2022-08-02T14:46:33,759][INFO
][test-runner-#1%wal.WalCompactionAfterRestartTest%][FileWriteAheadLogManager]
Enqueuing segment for compression [idx=0]
[2022-08-02T14:46:33,759][INFO
][test-runner-#1%wal.WalCompactionAfterRestartTest%][FileWriteAheadLogManager]
Enqueuing segment for compression [idx=1]
[2022-08-02T14:46:33,759][INFO
][test-runner-#1%wal.WalCompactionAfterRestartTest%][FileWriteAheadLogManager]
Enqueuing segment for compression [idx=2]
[2022-08-02T14:46:33,759][INFO
][test-runner-#1%wal.WalCompactionAfterRestartTest%][FileWriteAheadLogManager]
Enqueuing segment for compression [idx=3]
...
[2022-08-02T14:46:33,761][INFO
][test-runner-#1%wal.WalCompactionAfterRestartTest%][FileWriteAheadLogManager]
Enqueuing segment for compression [idx=49]
[2022-08-02T14:46:33,761][INFO
][test-runner-#1%wal.WalCompactionAfterRestartTest%][FileHandleManagerImpl]
Initialized write-ahead log manager [mode=LOG_ONLY]
...
[2022-08-02T14:46:34,084][INFO
][wal-file-compressor-%wal.WalCompactionAfterRestartTest0%-1-#133%wal.WalCompactionAfterRestartTest0%][FileWriteAheadLogManager]
Segment compressed notification [idx=0]
[2022-08-02T14:46:34,084][INFO
][wal-file-compressor-%wal.WalCompactionAfterRestartTest0%-0-#131%wal.WalCompactionAfterRestartTest0%][FileWriteAheadLogManager]
Segment compressed notification [idx=1]
[2022-08-02T14:46:34,084][INFO
][wal-file-compressor-%wal.WalCompactionAfterRestartTest0%-0-#131%wal.WalCompactionAfterRestartTest0%][FileWriteAheadLogManager]
Segment compressed notification [idx=2]
[2022-08-02T14:46:34,084][INFO
][wal-file-compressor-%wal.WalCompactionAfterRestartTest0%-0-#131%wal.WalCompactionAfterRestartTest0%][FileWriteAheadLogManager]
Segment compressed notification [idx=3]
...
[2022-08-02T14:46:34,092][INFO
][wal-file-compressor-%wal.WalCompactionAfterRestartTest0%-0-#131%wal.WalCompactionAfterRestartTest0%][FileWriteAheadLogManager]
Segment compressed notification [idx=49]
[2022-08-02T14:46:34,093][INFO
][exchange-worker-#127%wal.WalCompactionAfterRestartTest0%][GridCacheProcessor]
Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache,
startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]]
{noformat}
Reproducer:
{code:java}
private final ListeningTestLogger logger = new ListeningTestLogger(log);
/** {@inheritDoc} */
@Override protected IgniteConfiguration getConfiguration(String name)
throws Exception {
IgniteConfiguration cfg = super.getConfiguration(name);
cfg.setGridLogger(logger)
.setDataStorageConfiguration(new DataStorageConfiguration()
.setDefaultDataRegionConfiguration(new DataRegionConfiguration()
.setPersistenceEnabled(true))
.setWalSegmentSize(512 * 1024)
.setMaxWalArchiveSize(512 * 1024)
.setWalCompactionEnabled(true)
);
return cfg;
}
@Test
public void testCompactionDuplicationNotificationsOnRestart() throws
Exception {
String msg = "Segment compressed notification [idx=0]";
LogListener exactOnceMsg = LogListener.matches(msg).times(1).build();
LogListener duplicationMsgCheck =
LogListener.matches(msg).times(0).build();
logger.registerListener(exactOnceMsg);
IgniteEx ignite = startGrid(0);
ignite.cluster().state(ClusterState.ACTIVE);
for (int i = 0; i < 1_000; i++)
ignite.getOrCreateCache(DEFAULT_CACHE_NAME).put(i, i);
assertTrue(ignite.context().cache().context().wal().lastCompactedSegment() > 0);
assertTrue(exactOnceMsg.check());
// Restart grid.
stopGrid(0);
logger.registerListener(duplicationMsgCheck);
ignite = startGrid(0);
ignite.cluster().state(ClusterState.ACTIVE);
assertTrue("Duplicate notification present after restart.",
duplicationMsgCheck.check());
}
{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
