Ivan Bessonov created IGNITE-27586:
--------------------------------------

             Summary: Compaction speed is too low in comparison with checkpoint 
speed
                 Key: IGNITE-27586
                 URL: https://issues.apache.org/jira/browse/IGNITE-27586
             Project: Ignite
          Issue Type: Improvement
          Components: storage engines ai3
            Reporter: Ivan Bessonov


{code:java}
2026-01-14 14:59:47:682 +0000 
[INFO][%cac-dpd-cde-gg-aks-dev-4%checkpoint-thread][Checkpointer] Checkpoint 
started [checkpointId=c9c27d78-7acc-41d8-8b96-5e793c61c5a2, 
beforeWriteLockTime=3ms, writeLockWait=0us, beforeCheckpointBeginTime=3772us, 
markCheckpointBeginTime=1959us, writeLockHoldTime=2029us, 
splitAndSortPagesDuration=5ms, pages=13748, reason='Triggered by replicator']
2026-01-14 14:59:49:484 +0000 
[INFO][%cac-dpd-cde-gg-aks-dev-4%checkpoint-thread][Checkpointer] Checkpoint 
finished [checkpointId=c9c27d78-7acc-41d8-8b96-5e793c61c5a2, 
writtenPages=13748, fsyncFiles=46, pagesWriteTime=64ms, fsyncTime=1532ms, 
replicatorLogSyncTime=204ms, waitCompletePageReplacementTime=0ms, 
totalTime=1813ms, avgIoWriteSpeed=119MB/s, avgWriteSpeed=118MB/s]

... 

2026-01-14 14:59:49:484 +0000 
[INFO][%cac-dpd-cde-gg-aks-dev-4%compaction-thread][Compactor] Starting new 
compaction round [compactionId=0da72346-7204-4f77-a68d-8981141f80b0, files=23]
2026-01-14 15:00:00:407 +0000 
[INFO][%cac-dpd-cde-gg-aks-dev-4%compaction-thread][Compactor] Compaction round 
finished [compactionId=0da72346-7204-4f77-a68d-8981141f80b0, pages=8338, 
skipped=0, duration=10922ms, avgWriteSpeed=12MB/s]{code}
One is 118mbps, other is 12mbps. They are located next to each other in the 
log, and this is a general pattern in the "load data" scenario. We should check 
if that's normal or not, and possibly find a way to increase the speed of 
compaction.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to