[
https://issues.apache.org/jira/browse/IGNITE-23115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kirill Tkalenko updated IGNITE-23115:
-------------------------------------
Description:
As far as I know, writing multiple files from multiple threads is more
efficient that writing a single file from multiple threads. But that's exactly
what we do.
We should make an alternative implementation that would distribute partitions
between threads and check if it performs better than current implementation.
The POC showed that writing dirty pages of a partition by one thread is more
efficient than by several threads concurrently.
PR: [ignite-3/pull/4366|https://github.com/apache/ignite-3/pull/4366].
Test: *org.apache.ignite.internal.storage.pagememory.mv.CpWritePagesTest*.
Logs: [^_Run_Unit_Tests_auto-generated_Run_Unit_Tests_2_32600.log.zip] .
Results:
{noformat}
CpWritePagesTest#testMultiThreadNotUseAsync
Checkpoint started [checkpointId=a468d7ed-60ad-456d-9f68-dbec4ac1d14b,
checkpointBeforeWriteLockTime=48ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=1ms, checkpointWriteLockHoldTime=3ms,
splitAndSortPagesDuration=1469ms, pages=755304, reason='test']
Checkpoint finished [checkpointId=a468d7ed-60ad-456d-9f68-dbec4ac1d14b,
pages=755304, pagesWriteTime=3858ms, fsyncTime=5533ms, totalTime=10915ms]
Checkpoint started
[checkpointId=8880bbfa-1690-44b4-8080-d159964d4167,
checkpointBeforeWriteLockTime=16ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=1ms, checkpointWriteLockHoldTime=1ms,
splitAndSortPagesDuration=1491ms, pages=755285, reason='test']
Checkpoint finished [checkpointId=8880bbfa-1690-44b4-8080-d159964d4167,
pages=755285, pagesWriteTime=3181ms, fsyncTime=5766ms, totalTime=10458ms]
Checkpoint started
[checkpointId=5f1aac0c-cefb-4196-8437-569cedb654bb,
checkpointBeforeWriteLockTime=16ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=1ms,
splitAndSortPagesDuration=1073ms, pages=755299, reason='test']
Checkpoint finished [checkpointId=5f1aac0c-cefb-4196-8437-569cedb654bb,
pages=755299, pagesWriteTime=3136ms, fsyncTime=5780ms, totalTime=10008ms]
Checkpoint started
[checkpointId=0c28193f-7cef-4875-8b74-092f50aa6f16,
checkpointBeforeWriteLockTime=16ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
splitAndSortPagesDuration=1063ms, pages=755285, reason='test']
Checkpoint finished [checkpointId=0c28193f-7cef-4875-8b74-092f50aa6f16,
pages=755285, pagesWriteTime=3084ms, fsyncTime=5760ms, totalTime=9925ms]
Checkpoint started
[checkpointId=38824368-f2d6-41b5-b2c6-4c63b85e9aa0,
checkpointBeforeWriteLockTime=15ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=1ms, checkpointWriteLockHoldTime=1ms,
splitAndSortPagesDuration=1238ms, pages=755302, reason='test']
Checkpoint finished [checkpointId=38824368-f2d6-41b5-b2c6-4c63b85e9aa0,
pages=755302, pagesWriteTime=3098ms, fsyncTime=5767ms, totalTime=10121ms]
Checkpoint started
[checkpointId=fca461f9-ba64-4457-9501-23c9b9e10770,
checkpointBeforeWriteLockTime=17ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
splitAndSortPagesDuration=1565ms, pages=755307, reason='test']
Checkpoint finished [checkpointId=fca461f9-ba64-4457-9501-23c9b9e10770,
pages=755307, pagesWriteTime=4300ms, fsyncTime=5761ms, totalTime=11644ms]
Checkpoint started
[checkpointId=f65a7686-ff73-4d14-9839-c4517ee1feab,
checkpointBeforeWriteLockTime=8ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=1ms,
splitAndSortPagesDuration=1079ms, pages=755307, reason='test']
Checkpoint finished [checkpointId=f65a7686-ff73-4d14-9839-c4517ee1feab,
pages=755307, pagesWriteTime=3392ms, fsyncTime=5766ms, totalTime=10247ms]
Checkpoint started
[checkpointId=8c052dd6-83ee-4a53-9e2d-fd3f896c01c2,
checkpointBeforeWriteLockTime=15ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=1ms, checkpointWriteLockHoldTime=1ms,
splitAndSortPagesDuration=1502ms, pages=755284, reason='test']
Checkpoint finished [checkpointId=8c052dd6-83ee-4a53-9e2d-fd3f896c01c2,
pages=755284, pagesWriteTime=3977ms, fsyncTime=5770ms, totalTime=11266ms]
Checkpoint started
[checkpointId=799b852f-ada7-4308-9528-ce751541f2fc,
checkpointBeforeWriteLockTime=14ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
splitAndSortPagesDuration=1100ms, pages=755303, reason='test']
Checkpoint finished [checkpointId=799b852f-ada7-4308-9528-ce751541f2fc,
pages=755303, pagesWriteTime=3059ms, fsyncTime=5768ms, totalTime=9943ms]
Checkpoint started
[checkpointId=e3979b6a-8959-4d0e-85c7-71992ad5a980,
checkpointBeforeWriteLockTime=16ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
splitAndSortPagesDuration=1143ms, pages=755321, reason='test']
Checkpoint finished [checkpointId=e3979b6a-8959-4d0e-85c7-71992ad5a980,
pages=755321, pagesWriteTime=3162ms, fsyncTime=7885ms, totalTime=12208ms]
CpWritePagesTest#testOneThreadNotUseAsync
Checkpoint started
[checkpointId=696d50c3-24e4-48fc-965d-dacf26f567e1,
checkpointBeforeWriteLockTime=14ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=1ms, checkpointWriteLockHoldTime=1ms,
splitAndSortPagesDuration=1236ms, pages=755307, reason='test']
Checkpoint finished [checkpointId=696d50c3-24e4-48fc-965d-dacf26f567e1,
pages=755307, pagesWriteTime=1672ms, fsyncTime=5767ms, totalTime=8694ms]
Checkpoint started
[checkpointId=9fd4ac3b-3904-4bee-8db1-6b94752b8448,
checkpointBeforeWriteLockTime=13ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=1ms, checkpointWriteLockHoldTime=1ms,
splitAndSortPagesDuration=986ms, pages=755260, reason='test']
Checkpoint finished [checkpointId=9fd4ac3b-3904-4bee-8db1-6b94752b8448,
pages=755260, pagesWriteTime=2045ms, fsyncTime=5671ms, totalTime=8717ms]
Checkpoint started
[checkpointId=f6652d34-4186-4f73-a6ec-39312e47b45f,
checkpointBeforeWriteLockTime=14ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
splitAndSortPagesDuration=1187ms, pages=755317, reason='test']
Checkpoint finished [checkpointId=f6652d34-4186-4f73-a6ec-39312e47b45f,
pages=755317, pagesWriteTime=2364ms, fsyncTime=5763ms, totalTime=9329ms]
Checkpoint started
[checkpointId=34569d9e-0275-4251-8cbb-a01ea15cc707,
checkpointBeforeWriteLockTime=14ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
splitAndSortPagesDuration=1117ms, pages=755312, reason='test']
Checkpoint finished [checkpointId=34569d9e-0275-4251-8cbb-a01ea15cc707,
pages=755312, pagesWriteTime=1597ms, fsyncTime=5762ms, totalTime=8491ms]
Checkpoint started
[checkpointId=6107abbf-59d8-4b24-8c98-5f6084a87cfe,
checkpointBeforeWriteLockTime=14ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
splitAndSortPagesDuration=1063ms, pages=755296, reason='test']
Checkpoint finished [checkpointId=6107abbf-59d8-4b24-8c98-5f6084a87cfe,
pages=755296, pagesWriteTime=1585ms, fsyncTime=5765ms, totalTime=8428ms]
Checkpoint started
[checkpointId=ba2a5857-fbf2-48ab-8b50-ea0051682944,
checkpointBeforeWriteLockTime=15ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
splitAndSortPagesDuration=1088ms, pages=755284, reason='test']
Checkpoint finished [checkpointId=ba2a5857-fbf2-48ab-8b50-ea0051682944,
pages=755284, pagesWriteTime=1593ms, fsyncTime=5767ms, totalTime=8464ms]
Checkpoint started
[checkpointId=88549591-b5ac-4a96-87a0-55c365aab1e1,
checkpointBeforeWriteLockTime=15ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
splitAndSortPagesDuration=1235ms, pages=755284, reason='test']
Checkpoint finished [checkpointId=88549591-b5ac-4a96-87a0-55c365aab1e1,
pages=755284, pagesWriteTime=1953ms, fsyncTime=5760ms, totalTime=8965ms]
Checkpoint started
[checkpointId=6a6353d6-ce39-4270-85ff-e566ff99ac8f,
checkpointBeforeWriteLockTime=14ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
splitAndSortPagesDuration=1325ms, pages=755311, reason='test']
Checkpoint finished [checkpointId=6a6353d6-ce39-4270-85ff-e566ff99ac8f,
pages=755311, pagesWriteTime=2032ms, fsyncTime=5770ms, totalTime=9142ms]
Checkpoint started
[checkpointId=651796ab-8404-4d5a-a71e-5bb3fbeaae82,
checkpointBeforeWriteLockTime=14ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
splitAndSortPagesDuration=1052ms, pages=755287, reason='test']
Checkpoint finished [checkpointId=651796ab-8404-4d5a-a71e-5bb3fbeaae82,
pages=755287, pagesWriteTime=2223ms, fsyncTime=5766ms, totalTime=9056ms]
Checkpoint started
[checkpointId=298dca4e-52e9-49b3-a4bb-9bcc52aab3f7,
checkpointBeforeWriteLockTime=14ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=1ms, checkpointWriteLockHoldTime=1ms,
splitAndSortPagesDuration=1125ms, pages=755296, reason='test']
Checkpoint finished [checkpointId=298dca4e-52e9-49b3-a4bb-9bcc52aab3f7,
pages=755296, pagesWriteTime=1626ms, fsyncTime=5763ms, totalTime=8530ms]
CpWritePagesTest#testMultiThreadUseAsync
Checkpoint started
[checkpointId=4b123be0-02d7-4f1c-93e8-37f66d45179f,
checkpointBeforeWriteLockTime=15ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
splitAndSortPagesDuration=1125ms, pages=755341, reason='test']
Checkpoint finished [checkpointId=4b123be0-02d7-4f1c-93e8-37f66d45179f,
pages=755341, pagesWriteTime=7300ms, fsyncTime=6863ms, totalTime=15303ms]
Checkpoint started
[checkpointId=23f04398-aa39-4a50-8615-df9f9353d898,
checkpointBeforeWriteLockTime=14ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
splitAndSortPagesDuration=1423ms, pages=755306, reason='test']
Checkpoint finished [checkpointId=23f04398-aa39-4a50-8615-df9f9353d898,
pages=755306, pagesWriteTime=7765ms, fsyncTime=7264ms, totalTime=16467ms]
Checkpoint started
[checkpointId=50cc2f1e-2be6-4ffb-bc41-55b79bec6401,
checkpointBeforeWriteLockTime=15ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=1ms,
splitAndSortPagesDuration=1457ms, pages=755337, reason='test']
Checkpoint finished [checkpointId=50cc2f1e-2be6-4ffb-bc41-55b79bec6401,
pages=755337, pagesWriteTime=6396ms, fsyncTime=5771ms, totalTime=13643ms]
Checkpoint started
[checkpointId=c2f30b40-b1a3-4bbf-b8e4-f3f11c87f789,
checkpointBeforeWriteLockTime=16ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
splitAndSortPagesDuration=1042ms, pages=755282, reason='test']
Checkpoint finished [checkpointId=c2f30b40-b1a3-4bbf-b8e4-f3f11c87f789,
pages=755282, pagesWriteTime=5963ms, fsyncTime=5770ms, totalTime=12794ms]
Checkpoint started
[checkpointId=0ac1db51-79bb-4afd-bb40-525ab515488a,
checkpointBeforeWriteLockTime=16ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
splitAndSortPagesDuration=1316ms, pages=755336, reason='test']
Checkpoint finished [checkpointId=0ac1db51-79bb-4afd-bb40-525ab515488a,
pages=755336, pagesWriteTime=6012ms, fsyncTime=5767ms, totalTime=13113ms]
Checkpoint started [checkpointId=f916da9f-4706-4882-9cfd-0467562d3256,
checkpointBeforeWriteLockTime=14ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=1ms, checkpointWriteLockHoldTime=1ms,
splitAndSortPagesDuration=1142ms, pages=755262, reason='test']
Checkpoint finished [checkpointId=f916da9f-4706-4882-9cfd-0467562d3256,
pages=755262, pagesWriteTime=6117ms, fsyncTime=7718ms, totalTime=14994ms]
Checkpoint started [checkpointId=6357381a-09be-4ab0-bd83-5b9b3ad1f613,
checkpointBeforeWriteLockTime=15ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
splitAndSortPagesDuration=1095ms, pages=755298, reason='test']
Checkpoint finished [checkpointId=6357381a-09be-4ab0-bd83-5b9b3ad1f613,
pages=755298, pagesWriteTime=6059ms, fsyncTime=5574ms, totalTime=12744ms]
Checkpoint started
[checkpointId=b250c459-c4dc-42a7-9a9d-df222d4c6f6c,
checkpointBeforeWriteLockTime=15ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
splitAndSortPagesDuration=1088ms, pages=755326, reason='test']
Checkpoint finished [checkpointId=b250c459-c4dc-42a7-9a9d-df222d4c6f6c,
pages=755326, pagesWriteTime=5144ms, fsyncTime=5766ms, totalTime=12014ms]
Checkpoint started
[checkpointId=5caca15a-74c1-4b8e-94cc-3089bec59f74,
checkpointBeforeWriteLockTime=15ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
splitAndSortPagesDuration=1178ms, pages=755304, reason='test']
Checkpoint finished [checkpointId=5caca15a-74c1-4b8e-94cc-3089bec59f74,
pages=755304, pagesWriteTime=5503ms, fsyncTime=5772ms, totalTime=12469ms]
Checkpoint started
[checkpointId=99bda466-038c-460e-9be1-9eec8a784dc6,
checkpointBeforeWriteLockTime=14ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
splitAndSortPagesDuration=1315ms, pages=755260, reason='test']
Checkpoint finished [checkpointId=99bda466-038c-460e-9be1-9eec8a784dc6,
pages=755260, pagesWriteTime=5333ms, fsyncTime=5771ms, totalTime=12435ms]
CpWritePagesTest#testOneThreadUseAsync
Checkpoint started
[checkpointId=c9436f06-71d7-49af-a035-20a467a47310,
checkpointBeforeWriteLockTime=16ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=1ms, checkpointWriteLockHoldTime=1ms,
splitAndSortPagesDuration=1084ms, pages=755328, reason='test']
Checkpoint finished [checkpointId=c9436f06-71d7-49af-a035-20a467a47310,
pages=755328, pagesWriteTime=4409ms, fsyncTime=5771ms, totalTime=11283ms]
Checkpoint started
[checkpointId=44bddd5b-77fa-4cd0-ac78-3a2abf6305b3,
checkpointBeforeWriteLockTime=15ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
splitAndSortPagesDuration=1249ms, pages=755298, reason='test']
Checkpoint finished [checkpointId=44bddd5b-77fa-4cd0-ac78-3a2abf6305b3,
pages=755298, pagesWriteTime=5005ms, fsyncTime=5765ms, totalTime=12035ms]
Checkpoint started
[checkpointId=bc3bb678-19e8-4aef-8466-4c2c3dbeff84,
checkpointBeforeWriteLockTime=14ms, checkpointWriteLockWait=1ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
splitAndSortPagesDuration=1141ms, pages=755325, reason='test']
Checkpoint finished [checkpointId=bc3bb678-19e8-4aef-8466-4c2c3dbeff84,
pages=755325, pagesWriteTime=4467ms, fsyncTime=5302ms, totalTime=10926ms]
Checkpoint started
[checkpointId=7283c7b4-12a9-4a25-9268-f1c807674d46,
checkpointBeforeWriteLockTime=14ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
splitAndSortPagesDuration=1121ms, pages=755278, reason='test']
Checkpoint finished [checkpointId=7283c7b4-12a9-4a25-9268-f1c807674d46,
pages=755278, pagesWriteTime=4544ms, fsyncTime=5768ms, totalTime=11448ms]
Checkpoint started
[checkpointId=acd654a9-5da7-45e3-b646-165a0b72c70b,
checkpointBeforeWriteLockTime=16ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=1ms, checkpointWriteLockHoldTime=1ms,
splitAndSortPagesDuration=1133ms, pages=755334, reason='test']
Checkpoint finished [checkpointId=acd654a9-5da7-45e3-b646-165a0b72c70b,
pages=755334, pagesWriteTime=4180ms, fsyncTime=5542ms, totalTime=10874ms]
Checkpoint started
[checkpointId=1d9d6f3d-efce-4dbc-9268-46a32903c606,
checkpointBeforeWriteLockTime=15ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
splitAndSortPagesDuration=1244ms, pages=755297, reason='test']
Checkpoint finished [checkpointId=1d9d6f3d-efce-4dbc-9268-46a32903c606,
pages=755297, pagesWriteTime=4336ms, fsyncTime=5773ms, totalTime=11369ms]
Checkpoint started
[checkpointId=fffcbf15-a912-4447-88ba-870a5b76ec53,
checkpointBeforeWriteLockTime=15ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
splitAndSortPagesDuration=1296ms, pages=755274, reason='test']
Checkpoint finished [checkpointId=fffcbf15-a912-4447-88ba-870a5b76ec53,
pages=755274, pagesWriteTime=4387ms, fsyncTime=5768ms, totalTime=11467ms]
Checkpoint started
[checkpointId=be171217-31b3-4242-bc0e-ea5c921e5da6,
checkpointBeforeWriteLockTime=16ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
splitAndSortPagesDuration=1052ms, pages=755298, reason='test']
Checkpoint finished [checkpointId=be171217-31b3-4242-bc0e-ea5c921e5da6,
pages=755298, pagesWriteTime=4348ms, fsyncTime=5787ms, totalTime=11204ms]
Checkpoint started
[checkpointId=7b64b2ff-8493-412e-9f0f-59e6eefc1d3b,
checkpointBeforeWriteLockTime=15ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
splitAndSortPagesDuration=1344ms, pages=755305, reason='test']
Checkpoint finished [checkpointId=7b64b2ff-8493-412e-9f0f-59e6eefc1d3b,
pages=755305, pagesWriteTime=4153ms, fsyncTime=5767ms, totalTime=11280ms]
Checkpoint started
[checkpointId=1bb07aaa-3fcb-4744-8eb3-3f9bba87ac17,
checkpointBeforeWriteLockTime=14ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
splitAndSortPagesDuration=1303ms, pages=755319, reason='test']
Checkpoint finished [checkpointId=1bb07aaa-3fcb-4744-8eb3-3f9bba87ac17,
pages=755319, pagesWriteTime=4231ms, fsyncTime=5311ms, totalTime=10864ms]
{noformat}
*{color:#DE350B}Total{color}* - needs to be implemented.
was:
As far as I know, writing multiple files from multiple threads is more
efficient that writing a single file from multiple threads. But that's exactly
what we do.
We should make an alternative implementation that would distribute partitions
between threads and check if it performs better than current implementation.
The POC showed that writing dirty pages of a partition by one thread is more
efficient than by several threads concurrently.
PR: [ignite-3/pull/4366|https://github.com/apache/ignite-3/pull/4366].
Test: *org.apache.ignite.internal.storage.pagememory.mv.CpWritePagesTest*.
Logs: [^_Run_Unit_Tests_auto-generated_Run_Unit_Tests_2_32600.log.zip] .
Results:
{noformat}
CpWritePagesTest#testMultiThreadNotUseAsync
Checkpoint started
[checkpointId=a468d7ed-60ad-456d-9f68-dbec4ac1d14b,
checkpointBeforeWriteLockTime=48ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=1ms, checkpointWriteLockHoldTime=3ms,
splitAndSortPagesDuration=1469ms, pages=755304, reason='test']
Checkpoint finished [checkpointId=a468d7ed-60ad-456d-9f68-dbec4ac1d14b,
pages=755304, pagesWriteTime=3858ms, fsyncTime=5533ms, totalTime=10915ms]
Checkpoint started
[checkpointId=8880bbfa-1690-44b4-8080-d159964d4167,
checkpointBeforeWriteLockTime=16ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=1ms, checkpointWriteLockHoldTime=1ms,
splitAndSortPagesDuration=1491ms, pages=755285, reason='test']
Checkpoint finished [checkpointId=8880bbfa-1690-44b4-8080-d159964d4167,
pages=755285, pagesWriteTime=3181ms, fsyncTime=5766ms, totalTime=10458ms]
Checkpoint started
[checkpointId=5f1aac0c-cefb-4196-8437-569cedb654bb,
checkpointBeforeWriteLockTime=16ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=1ms,
splitAndSortPagesDuration=1073ms, pages=755299, reason='test']
Checkpoint finished [checkpointId=5f1aac0c-cefb-4196-8437-569cedb654bb,
pages=755299, pagesWriteTime=3136ms, fsyncTime=5780ms, totalTime=10008ms]
Checkpoint started
[checkpointId=0c28193f-7cef-4875-8b74-092f50aa6f16,
checkpointBeforeWriteLockTime=16ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
splitAndSortPagesDuration=1063ms, pages=755285, reason='test']
Checkpoint finished [checkpointId=0c28193f-7cef-4875-8b74-092f50aa6f16,
pages=755285, pagesWriteTime=3084ms, fsyncTime=5760ms, totalTime=9925ms]
Checkpoint started
[checkpointId=38824368-f2d6-41b5-b2c6-4c63b85e9aa0,
checkpointBeforeWriteLockTime=15ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=1ms, checkpointWriteLockHoldTime=1ms,
splitAndSortPagesDuration=1238ms, pages=755302, reason='test']
Checkpoint finished [checkpointId=38824368-f2d6-41b5-b2c6-4c63b85e9aa0,
pages=755302, pagesWriteTime=3098ms, fsyncTime=5767ms, totalTime=10121ms]
Checkpoint started
[checkpointId=fca461f9-ba64-4457-9501-23c9b9e10770,
checkpointBeforeWriteLockTime=17ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
splitAndSortPagesDuration=1565ms, pages=755307, reason='test']
Checkpoint finished [checkpointId=fca461f9-ba64-4457-9501-23c9b9e10770,
pages=755307, pagesWriteTime=4300ms, fsyncTime=5761ms, totalTime=11644ms]
Checkpoint started
[checkpointId=f65a7686-ff73-4d14-9839-c4517ee1feab,
checkpointBeforeWriteLockTime=8ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=1ms,
splitAndSortPagesDuration=1079ms, pages=755307, reason='test']
Checkpoint finished [checkpointId=f65a7686-ff73-4d14-9839-c4517ee1feab,
pages=755307, pagesWriteTime=3392ms, fsyncTime=5766ms, totalTime=10247ms]
Checkpoint started
[checkpointId=8c052dd6-83ee-4a53-9e2d-fd3f896c01c2,
checkpointBeforeWriteLockTime=15ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=1ms, checkpointWriteLockHoldTime=1ms,
splitAndSortPagesDuration=1502ms, pages=755284, reason='test']
Checkpoint finished [checkpointId=8c052dd6-83ee-4a53-9e2d-fd3f896c01c2,
pages=755284, pagesWriteTime=3977ms, fsyncTime=5770ms, totalTime=11266ms]
Checkpoint started
[checkpointId=799b852f-ada7-4308-9528-ce751541f2fc,
checkpointBeforeWriteLockTime=14ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
splitAndSortPagesDuration=1100ms, pages=755303, reason='test']
Checkpoint finished [checkpointId=799b852f-ada7-4308-9528-ce751541f2fc,
pages=755303, pagesWriteTime=3059ms, fsyncTime=5768ms, totalTime=9943ms]
Checkpoint started
[checkpointId=e3979b6a-8959-4d0e-85c7-71992ad5a980,
checkpointBeforeWriteLockTime=16ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
splitAndSortPagesDuration=1143ms, pages=755321, reason='test']
Checkpoint finished [checkpointId=e3979b6a-8959-4d0e-85c7-71992ad5a980,
pages=755321, pagesWriteTime=3162ms, fsyncTime=7885ms, totalTime=12208ms]
CpWritePagesTest#testOneThreadNotUseAsync
Checkpoint started
[checkpointId=696d50c3-24e4-48fc-965d-dacf26f567e1,
checkpointBeforeWriteLockTime=14ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=1ms, checkpointWriteLockHoldTime=1ms,
splitAndSortPagesDuration=1236ms, pages=755307, reason='test']
Checkpoint finished [checkpointId=696d50c3-24e4-48fc-965d-dacf26f567e1,
pages=755307, pagesWriteTime=1672ms, fsyncTime=5767ms, totalTime=8694ms]
Checkpoint started
[checkpointId=9fd4ac3b-3904-4bee-8db1-6b94752b8448,
checkpointBeforeWriteLockTime=13ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=1ms, checkpointWriteLockHoldTime=1ms,
splitAndSortPagesDuration=986ms, pages=755260, reason='test']
Checkpoint finished [checkpointId=9fd4ac3b-3904-4bee-8db1-6b94752b8448,
pages=755260, pagesWriteTime=2045ms, fsyncTime=5671ms, totalTime=8717ms]
Checkpoint started
[checkpointId=f6652d34-4186-4f73-a6ec-39312e47b45f,
checkpointBeforeWriteLockTime=14ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
splitAndSortPagesDuration=1187ms, pages=755317, reason='test']
Checkpoint finished [checkpointId=f6652d34-4186-4f73-a6ec-39312e47b45f,
pages=755317, pagesWriteTime=2364ms, fsyncTime=5763ms, totalTime=9329ms]
Checkpoint started
[checkpointId=34569d9e-0275-4251-8cbb-a01ea15cc707,
checkpointBeforeWriteLockTime=14ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
splitAndSortPagesDuration=1117ms, pages=755312, reason='test']
Checkpoint finished [checkpointId=34569d9e-0275-4251-8cbb-a01ea15cc707,
pages=755312, pagesWriteTime=1597ms, fsyncTime=5762ms, totalTime=8491ms]
Checkpoint started
[checkpointId=6107abbf-59d8-4b24-8c98-5f6084a87cfe,
checkpointBeforeWriteLockTime=14ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
splitAndSortPagesDuration=1063ms, pages=755296, reason='test']
Checkpoint finished [checkpointId=6107abbf-59d8-4b24-8c98-5f6084a87cfe,
pages=755296, pagesWriteTime=1585ms, fsyncTime=5765ms, totalTime=8428ms]
Checkpoint started
[checkpointId=ba2a5857-fbf2-48ab-8b50-ea0051682944,
checkpointBeforeWriteLockTime=15ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
splitAndSortPagesDuration=1088ms, pages=755284, reason='test']
Checkpoint finished [checkpointId=ba2a5857-fbf2-48ab-8b50-ea0051682944,
pages=755284, pagesWriteTime=1593ms, fsyncTime=5767ms, totalTime=8464ms]
Checkpoint started
[checkpointId=88549591-b5ac-4a96-87a0-55c365aab1e1,
checkpointBeforeWriteLockTime=15ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
splitAndSortPagesDuration=1235ms, pages=755284, reason='test']
Checkpoint finished [checkpointId=88549591-b5ac-4a96-87a0-55c365aab1e1,
pages=755284, pagesWriteTime=1953ms, fsyncTime=5760ms, totalTime=8965ms]
Checkpoint started
[checkpointId=6a6353d6-ce39-4270-85ff-e566ff99ac8f,
checkpointBeforeWriteLockTime=14ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
splitAndSortPagesDuration=1325ms, pages=755311, reason='test']
Checkpoint finished [checkpointId=6a6353d6-ce39-4270-85ff-e566ff99ac8f,
pages=755311, pagesWriteTime=2032ms, fsyncTime=5770ms, totalTime=9142ms]
Checkpoint started
[checkpointId=651796ab-8404-4d5a-a71e-5bb3fbeaae82,
checkpointBeforeWriteLockTime=14ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
splitAndSortPagesDuration=1052ms, pages=755287, reason='test']
Checkpoint finished [checkpointId=651796ab-8404-4d5a-a71e-5bb3fbeaae82,
pages=755287, pagesWriteTime=2223ms, fsyncTime=5766ms, totalTime=9056ms]
Checkpoint started
[checkpointId=298dca4e-52e9-49b3-a4bb-9bcc52aab3f7,
checkpointBeforeWriteLockTime=14ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=1ms, checkpointWriteLockHoldTime=1ms,
splitAndSortPagesDuration=1125ms, pages=755296, reason='test']
Checkpoint finished [checkpointId=298dca4e-52e9-49b3-a4bb-9bcc52aab3f7,
pages=755296, pagesWriteTime=1626ms, fsyncTime=5763ms, totalTime=8530ms]
CpWritePagesTest#testMultiThreadUseAsync
Checkpoint started
[checkpointId=4b123be0-02d7-4f1c-93e8-37f66d45179f,
checkpointBeforeWriteLockTime=15ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
splitAndSortPagesDuration=1125ms, pages=755341, reason='test']
Checkpoint finished [checkpointId=4b123be0-02d7-4f1c-93e8-37f66d45179f,
pages=755341, pagesWriteTime=7300ms, fsyncTime=6863ms, totalTime=15303ms]
Checkpoint started
[checkpointId=23f04398-aa39-4a50-8615-df9f9353d898,
checkpointBeforeWriteLockTime=14ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
splitAndSortPagesDuration=1423ms, pages=755306, reason='test']
Checkpoint finished [checkpointId=23f04398-aa39-4a50-8615-df9f9353d898,
pages=755306, pagesWriteTime=7765ms, fsyncTime=7264ms, totalTime=16467ms]
Checkpoint started
[checkpointId=50cc2f1e-2be6-4ffb-bc41-55b79bec6401,
checkpointBeforeWriteLockTime=15ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=1ms,
splitAndSortPagesDuration=1457ms, pages=755337, reason='test']
Checkpoint finished [checkpointId=50cc2f1e-2be6-4ffb-bc41-55b79bec6401,
pages=755337, pagesWriteTime=6396ms, fsyncTime=5771ms, totalTime=13643ms]
Checkpoint started
[checkpointId=c2f30b40-b1a3-4bbf-b8e4-f3f11c87f789,
checkpointBeforeWriteLockTime=16ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
splitAndSortPagesDuration=1042ms, pages=755282, reason='test']
Checkpoint finished [checkpointId=c2f30b40-b1a3-4bbf-b8e4-f3f11c87f789,
pages=755282, pagesWriteTime=5963ms, fsyncTime=5770ms, totalTime=12794ms]
Checkpoint started
[checkpointId=0ac1db51-79bb-4afd-bb40-525ab515488a,
checkpointBeforeWriteLockTime=16ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
splitAndSortPagesDuration=1316ms, pages=755336, reason='test']
Checkpoint finished [checkpointId=0ac1db51-79bb-4afd-bb40-525ab515488a,
pages=755336, pagesWriteTime=6012ms, fsyncTime=5767ms, totalTime=13113ms]
Checkpoint started [checkpointId=f916da9f-4706-4882-9cfd-0467562d3256,
checkpointBeforeWriteLockTime=14ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=1ms, checkpointWriteLockHoldTime=1ms,
splitAndSortPagesDuration=1142ms, pages=755262, reason='test']
Checkpoint finished [checkpointId=f916da9f-4706-4882-9cfd-0467562d3256,
pages=755262, pagesWriteTime=6117ms, fsyncTime=7718ms, totalTime=14994ms]
Checkpoint started [checkpointId=6357381a-09be-4ab0-bd83-5b9b3ad1f613,
checkpointBeforeWriteLockTime=15ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
splitAndSortPagesDuration=1095ms, pages=755298, reason='test']
Checkpoint finished [checkpointId=6357381a-09be-4ab0-bd83-5b9b3ad1f613,
pages=755298, pagesWriteTime=6059ms, fsyncTime=5574ms, totalTime=12744ms]
Checkpoint started
[checkpointId=b250c459-c4dc-42a7-9a9d-df222d4c6f6c,
checkpointBeforeWriteLockTime=15ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
splitAndSortPagesDuration=1088ms, pages=755326, reason='test']
Checkpoint finished [checkpointId=b250c459-c4dc-42a7-9a9d-df222d4c6f6c,
pages=755326, pagesWriteTime=5144ms, fsyncTime=5766ms, totalTime=12014ms]
Checkpoint started
[checkpointId=5caca15a-74c1-4b8e-94cc-3089bec59f74,
checkpointBeforeWriteLockTime=15ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
splitAndSortPagesDuration=1178ms, pages=755304, reason='test']
Checkpoint finished [checkpointId=5caca15a-74c1-4b8e-94cc-3089bec59f74,
pages=755304, pagesWriteTime=5503ms, fsyncTime=5772ms, totalTime=12469ms]
Checkpoint started
[checkpointId=99bda466-038c-460e-9be1-9eec8a784dc6,
checkpointBeforeWriteLockTime=14ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
splitAndSortPagesDuration=1315ms, pages=755260, reason='test']
Checkpoint finished [checkpointId=99bda466-038c-460e-9be1-9eec8a784dc6,
pages=755260, pagesWriteTime=5333ms, fsyncTime=5771ms, totalTime=12435ms]
CpWritePagesTest#testOneThreadUseAsync
Checkpoint started
[checkpointId=c9436f06-71d7-49af-a035-20a467a47310,
checkpointBeforeWriteLockTime=16ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=1ms, checkpointWriteLockHoldTime=1ms,
splitAndSortPagesDuration=1084ms, pages=755328, reason='test']
Checkpoint finished [checkpointId=c9436f06-71d7-49af-a035-20a467a47310,
pages=755328, pagesWriteTime=4409ms, fsyncTime=5771ms, totalTime=11283ms]
Checkpoint started
[checkpointId=44bddd5b-77fa-4cd0-ac78-3a2abf6305b3,
checkpointBeforeWriteLockTime=15ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
splitAndSortPagesDuration=1249ms, pages=755298, reason='test']
Checkpoint finished [checkpointId=44bddd5b-77fa-4cd0-ac78-3a2abf6305b3,
pages=755298, pagesWriteTime=5005ms, fsyncTime=5765ms, totalTime=12035ms]
Checkpoint started
[checkpointId=bc3bb678-19e8-4aef-8466-4c2c3dbeff84,
checkpointBeforeWriteLockTime=14ms, checkpointWriteLockWait=1ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
splitAndSortPagesDuration=1141ms, pages=755325, reason='test']
Checkpoint finished [checkpointId=bc3bb678-19e8-4aef-8466-4c2c3dbeff84,
pages=755325, pagesWriteTime=4467ms, fsyncTime=5302ms, totalTime=10926ms]
Checkpoint started
[checkpointId=7283c7b4-12a9-4a25-9268-f1c807674d46,
checkpointBeforeWriteLockTime=14ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
splitAndSortPagesDuration=1121ms, pages=755278, reason='test']
Checkpoint finished [checkpointId=7283c7b4-12a9-4a25-9268-f1c807674d46,
pages=755278, pagesWriteTime=4544ms, fsyncTime=5768ms, totalTime=11448ms]
Checkpoint started
[checkpointId=acd654a9-5da7-45e3-b646-165a0b72c70b,
checkpointBeforeWriteLockTime=16ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=1ms, checkpointWriteLockHoldTime=1ms,
splitAndSortPagesDuration=1133ms, pages=755334, reason='test']
Checkpoint finished [checkpointId=acd654a9-5da7-45e3-b646-165a0b72c70b,
pages=755334, pagesWriteTime=4180ms, fsyncTime=5542ms, totalTime=10874ms]
Checkpoint started
[checkpointId=1d9d6f3d-efce-4dbc-9268-46a32903c606,
checkpointBeforeWriteLockTime=15ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
splitAndSortPagesDuration=1244ms, pages=755297, reason='test']
Checkpoint finished [checkpointId=1d9d6f3d-efce-4dbc-9268-46a32903c606,
pages=755297, pagesWriteTime=4336ms, fsyncTime=5773ms, totalTime=11369ms]
Checkpoint started
[checkpointId=fffcbf15-a912-4447-88ba-870a5b76ec53,
checkpointBeforeWriteLockTime=15ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
splitAndSortPagesDuration=1296ms, pages=755274, reason='test']
Checkpoint finished [checkpointId=fffcbf15-a912-4447-88ba-870a5b76ec53,
pages=755274, pagesWriteTime=4387ms, fsyncTime=5768ms, totalTime=11467ms]
Checkpoint started
[checkpointId=be171217-31b3-4242-bc0e-ea5c921e5da6,
checkpointBeforeWriteLockTime=16ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
splitAndSortPagesDuration=1052ms, pages=755298, reason='test']
Checkpoint finished [checkpointId=be171217-31b3-4242-bc0e-ea5c921e5da6,
pages=755298, pagesWriteTime=4348ms, fsyncTime=5787ms, totalTime=11204ms]
Checkpoint started
[checkpointId=7b64b2ff-8493-412e-9f0f-59e6eefc1d3b,
checkpointBeforeWriteLockTime=15ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
splitAndSortPagesDuration=1344ms, pages=755305, reason='test']
Checkpoint finished [checkpointId=7b64b2ff-8493-412e-9f0f-59e6eefc1d3b,
pages=755305, pagesWriteTime=4153ms, fsyncTime=5767ms, totalTime=11280ms]
Checkpoint started
[checkpointId=1bb07aaa-3fcb-4744-8eb3-3f9bba87ac17,
checkpointBeforeWriteLockTime=14ms, checkpointWriteLockWait=0ms,
checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
splitAndSortPagesDuration=1303ms, pages=755319, reason='test']
Checkpoint finished [checkpointId=1bb07aaa-3fcb-4744-8eb3-3f9bba87ac17,
pages=755319, pagesWriteTime=4231ms, fsyncTime=5311ms, totalTime=10864ms]
{noformat}
*{color:#DE350B}Total{color}* - needs to be implemented.
> Checkpoint single partition from a single thread
> ------------------------------------------------
>
> Key: IGNITE-23115
> URL: https://issues.apache.org/jira/browse/IGNITE-23115
> Project: Ignite
> Issue Type: Improvement
> Reporter: Ivan Bessonov
> Assignee: Kirill Tkalenko
> Priority: Major
> Labels: ignite-3
> Attachments:
> _Run_Unit_Tests_auto-generated_Run_Unit_Tests_2_32600.log.zip
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> As far as I know, writing multiple files from multiple threads is more
> efficient that writing a single file from multiple threads. But that's
> exactly what we do.
> We should make an alternative implementation that would distribute partitions
> between threads and check if it performs better than current implementation.
> The POC showed that writing dirty pages of a partition by one thread is more
> efficient than by several threads concurrently.
> PR: [ignite-3/pull/4366|https://github.com/apache/ignite-3/pull/4366].
> Test: *org.apache.ignite.internal.storage.pagememory.mv.CpWritePagesTest*.
> Logs: [^_Run_Unit_Tests_auto-generated_Run_Unit_Tests_2_32600.log.zip] .
> Results:
> {noformat}
> CpWritePagesTest#testMultiThreadNotUseAsync
> Checkpoint started [checkpointId=a468d7ed-60ad-456d-9f68-dbec4ac1d14b,
> checkpointBeforeWriteLockTime=48ms, checkpointWriteLockWait=0ms,
> checkpointListenersExecuteTime=1ms, checkpointWriteLockHoldTime=3ms,
> splitAndSortPagesDuration=1469ms, pages=755304, reason='test']
> Checkpoint finished [checkpointId=a468d7ed-60ad-456d-9f68-dbec4ac1d14b,
> pages=755304, pagesWriteTime=3858ms, fsyncTime=5533ms, totalTime=10915ms]
>
> Checkpoint started
> [checkpointId=8880bbfa-1690-44b4-8080-d159964d4167,
> checkpointBeforeWriteLockTime=16ms, checkpointWriteLockWait=0ms,
> checkpointListenersExecuteTime=1ms, checkpointWriteLockHoldTime=1ms,
> splitAndSortPagesDuration=1491ms, pages=755285, reason='test']
> Checkpoint finished [checkpointId=8880bbfa-1690-44b4-8080-d159964d4167,
> pages=755285, pagesWriteTime=3181ms, fsyncTime=5766ms, totalTime=10458ms]
>
> Checkpoint started
> [checkpointId=5f1aac0c-cefb-4196-8437-569cedb654bb,
> checkpointBeforeWriteLockTime=16ms, checkpointWriteLockWait=0ms,
> checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=1ms,
> splitAndSortPagesDuration=1073ms, pages=755299, reason='test']
> Checkpoint finished [checkpointId=5f1aac0c-cefb-4196-8437-569cedb654bb,
> pages=755299, pagesWriteTime=3136ms, fsyncTime=5780ms, totalTime=10008ms]
>
> Checkpoint started
> [checkpointId=0c28193f-7cef-4875-8b74-092f50aa6f16,
> checkpointBeforeWriteLockTime=16ms, checkpointWriteLockWait=0ms,
> checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
> splitAndSortPagesDuration=1063ms, pages=755285, reason='test']
> Checkpoint finished [checkpointId=0c28193f-7cef-4875-8b74-092f50aa6f16,
> pages=755285, pagesWriteTime=3084ms, fsyncTime=5760ms, totalTime=9925ms]
>
> Checkpoint started
> [checkpointId=38824368-f2d6-41b5-b2c6-4c63b85e9aa0,
> checkpointBeforeWriteLockTime=15ms, checkpointWriteLockWait=0ms,
> checkpointListenersExecuteTime=1ms, checkpointWriteLockHoldTime=1ms,
> splitAndSortPagesDuration=1238ms, pages=755302, reason='test']
> Checkpoint finished [checkpointId=38824368-f2d6-41b5-b2c6-4c63b85e9aa0,
> pages=755302, pagesWriteTime=3098ms, fsyncTime=5767ms, totalTime=10121ms]
>
> Checkpoint started
> [checkpointId=fca461f9-ba64-4457-9501-23c9b9e10770,
> checkpointBeforeWriteLockTime=17ms, checkpointWriteLockWait=0ms,
> checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
> splitAndSortPagesDuration=1565ms, pages=755307, reason='test']
> Checkpoint finished [checkpointId=fca461f9-ba64-4457-9501-23c9b9e10770,
> pages=755307, pagesWriteTime=4300ms, fsyncTime=5761ms, totalTime=11644ms]
> Checkpoint started
> [checkpointId=f65a7686-ff73-4d14-9839-c4517ee1feab,
> checkpointBeforeWriteLockTime=8ms, checkpointWriteLockWait=0ms,
> checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=1ms,
> splitAndSortPagesDuration=1079ms, pages=755307, reason='test']
> Checkpoint finished [checkpointId=f65a7686-ff73-4d14-9839-c4517ee1feab,
> pages=755307, pagesWriteTime=3392ms, fsyncTime=5766ms, totalTime=10247ms]
>
> Checkpoint started
> [checkpointId=8c052dd6-83ee-4a53-9e2d-fd3f896c01c2,
> checkpointBeforeWriteLockTime=15ms, checkpointWriteLockWait=0ms,
> checkpointListenersExecuteTime=1ms, checkpointWriteLockHoldTime=1ms,
> splitAndSortPagesDuration=1502ms, pages=755284, reason='test']
> Checkpoint finished [checkpointId=8c052dd6-83ee-4a53-9e2d-fd3f896c01c2,
> pages=755284, pagesWriteTime=3977ms, fsyncTime=5770ms, totalTime=11266ms]
>
> Checkpoint started
> [checkpointId=799b852f-ada7-4308-9528-ce751541f2fc,
> checkpointBeforeWriteLockTime=14ms, checkpointWriteLockWait=0ms,
> checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
> splitAndSortPagesDuration=1100ms, pages=755303, reason='test']
> Checkpoint finished [checkpointId=799b852f-ada7-4308-9528-ce751541f2fc,
> pages=755303, pagesWriteTime=3059ms, fsyncTime=5768ms, totalTime=9943ms]
>
> Checkpoint started
> [checkpointId=e3979b6a-8959-4d0e-85c7-71992ad5a980,
> checkpointBeforeWriteLockTime=16ms, checkpointWriteLockWait=0ms,
> checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
> splitAndSortPagesDuration=1143ms, pages=755321, reason='test']
> Checkpoint finished [checkpointId=e3979b6a-8959-4d0e-85c7-71992ad5a980,
> pages=755321, pagesWriteTime=3162ms, fsyncTime=7885ms, totalTime=12208ms]
> CpWritePagesTest#testOneThreadNotUseAsync
> Checkpoint started
> [checkpointId=696d50c3-24e4-48fc-965d-dacf26f567e1,
> checkpointBeforeWriteLockTime=14ms, checkpointWriteLockWait=0ms,
> checkpointListenersExecuteTime=1ms, checkpointWriteLockHoldTime=1ms,
> splitAndSortPagesDuration=1236ms, pages=755307, reason='test']
> Checkpoint finished [checkpointId=696d50c3-24e4-48fc-965d-dacf26f567e1,
> pages=755307, pagesWriteTime=1672ms, fsyncTime=5767ms, totalTime=8694ms]
>
> Checkpoint started
> [checkpointId=9fd4ac3b-3904-4bee-8db1-6b94752b8448,
> checkpointBeforeWriteLockTime=13ms, checkpointWriteLockWait=0ms,
> checkpointListenersExecuteTime=1ms, checkpointWriteLockHoldTime=1ms,
> splitAndSortPagesDuration=986ms, pages=755260, reason='test']
> Checkpoint finished [checkpointId=9fd4ac3b-3904-4bee-8db1-6b94752b8448,
> pages=755260, pagesWriteTime=2045ms, fsyncTime=5671ms, totalTime=8717ms]
>
> Checkpoint started
> [checkpointId=f6652d34-4186-4f73-a6ec-39312e47b45f,
> checkpointBeforeWriteLockTime=14ms, checkpointWriteLockWait=0ms,
> checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
> splitAndSortPagesDuration=1187ms, pages=755317, reason='test']
> Checkpoint finished [checkpointId=f6652d34-4186-4f73-a6ec-39312e47b45f,
> pages=755317, pagesWriteTime=2364ms, fsyncTime=5763ms, totalTime=9329ms]
> Checkpoint started
> [checkpointId=34569d9e-0275-4251-8cbb-a01ea15cc707,
> checkpointBeforeWriteLockTime=14ms, checkpointWriteLockWait=0ms,
> checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
> splitAndSortPagesDuration=1117ms, pages=755312, reason='test']
> Checkpoint finished [checkpointId=34569d9e-0275-4251-8cbb-a01ea15cc707,
> pages=755312, pagesWriteTime=1597ms, fsyncTime=5762ms, totalTime=8491ms]
> Checkpoint started
> [checkpointId=6107abbf-59d8-4b24-8c98-5f6084a87cfe,
> checkpointBeforeWriteLockTime=14ms, checkpointWriteLockWait=0ms,
> checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
> splitAndSortPagesDuration=1063ms, pages=755296, reason='test']
> Checkpoint finished [checkpointId=6107abbf-59d8-4b24-8c98-5f6084a87cfe,
> pages=755296, pagesWriteTime=1585ms, fsyncTime=5765ms, totalTime=8428ms]
>
> Checkpoint started
> [checkpointId=ba2a5857-fbf2-48ab-8b50-ea0051682944,
> checkpointBeforeWriteLockTime=15ms, checkpointWriteLockWait=0ms,
> checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
> splitAndSortPagesDuration=1088ms, pages=755284, reason='test']
> Checkpoint finished [checkpointId=ba2a5857-fbf2-48ab-8b50-ea0051682944,
> pages=755284, pagesWriteTime=1593ms, fsyncTime=5767ms, totalTime=8464ms]
> Checkpoint started
> [checkpointId=88549591-b5ac-4a96-87a0-55c365aab1e1,
> checkpointBeforeWriteLockTime=15ms, checkpointWriteLockWait=0ms,
> checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
> splitAndSortPagesDuration=1235ms, pages=755284, reason='test']
> Checkpoint finished [checkpointId=88549591-b5ac-4a96-87a0-55c365aab1e1,
> pages=755284, pagesWriteTime=1953ms, fsyncTime=5760ms, totalTime=8965ms]
> Checkpoint started
> [checkpointId=6a6353d6-ce39-4270-85ff-e566ff99ac8f,
> checkpointBeforeWriteLockTime=14ms, checkpointWriteLockWait=0ms,
> checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
> splitAndSortPagesDuration=1325ms, pages=755311, reason='test']
> Checkpoint finished [checkpointId=6a6353d6-ce39-4270-85ff-e566ff99ac8f,
> pages=755311, pagesWriteTime=2032ms, fsyncTime=5770ms, totalTime=9142ms]
>
> Checkpoint started
> [checkpointId=651796ab-8404-4d5a-a71e-5bb3fbeaae82,
> checkpointBeforeWriteLockTime=14ms, checkpointWriteLockWait=0ms,
> checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
> splitAndSortPagesDuration=1052ms, pages=755287, reason='test']
> Checkpoint finished [checkpointId=651796ab-8404-4d5a-a71e-5bb3fbeaae82,
> pages=755287, pagesWriteTime=2223ms, fsyncTime=5766ms, totalTime=9056ms]
> Checkpoint started
> [checkpointId=298dca4e-52e9-49b3-a4bb-9bcc52aab3f7,
> checkpointBeforeWriteLockTime=14ms, checkpointWriteLockWait=0ms,
> checkpointListenersExecuteTime=1ms, checkpointWriteLockHoldTime=1ms,
> splitAndSortPagesDuration=1125ms, pages=755296, reason='test']
> Checkpoint finished [checkpointId=298dca4e-52e9-49b3-a4bb-9bcc52aab3f7,
> pages=755296, pagesWriteTime=1626ms, fsyncTime=5763ms, totalTime=8530ms]
> CpWritePagesTest#testMultiThreadUseAsync
> Checkpoint started
> [checkpointId=4b123be0-02d7-4f1c-93e8-37f66d45179f,
> checkpointBeforeWriteLockTime=15ms, checkpointWriteLockWait=0ms,
> checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
> splitAndSortPagesDuration=1125ms, pages=755341, reason='test']
> Checkpoint finished [checkpointId=4b123be0-02d7-4f1c-93e8-37f66d45179f,
> pages=755341, pagesWriteTime=7300ms, fsyncTime=6863ms, totalTime=15303ms]
>
> Checkpoint started
> [checkpointId=23f04398-aa39-4a50-8615-df9f9353d898,
> checkpointBeforeWriteLockTime=14ms, checkpointWriteLockWait=0ms,
> checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
> splitAndSortPagesDuration=1423ms, pages=755306, reason='test']
> Checkpoint finished [checkpointId=23f04398-aa39-4a50-8615-df9f9353d898,
> pages=755306, pagesWriteTime=7765ms, fsyncTime=7264ms, totalTime=16467ms]
>
> Checkpoint started
> [checkpointId=50cc2f1e-2be6-4ffb-bc41-55b79bec6401,
> checkpointBeforeWriteLockTime=15ms, checkpointWriteLockWait=0ms,
> checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=1ms,
> splitAndSortPagesDuration=1457ms, pages=755337, reason='test']
> Checkpoint finished [checkpointId=50cc2f1e-2be6-4ffb-bc41-55b79bec6401,
> pages=755337, pagesWriteTime=6396ms, fsyncTime=5771ms, totalTime=13643ms]
> Checkpoint started
> [checkpointId=c2f30b40-b1a3-4bbf-b8e4-f3f11c87f789,
> checkpointBeforeWriteLockTime=16ms, checkpointWriteLockWait=0ms,
> checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
> splitAndSortPagesDuration=1042ms, pages=755282, reason='test']
> Checkpoint finished [checkpointId=c2f30b40-b1a3-4bbf-b8e4-f3f11c87f789,
> pages=755282, pagesWriteTime=5963ms, fsyncTime=5770ms, totalTime=12794ms]
>
> Checkpoint started
> [checkpointId=0ac1db51-79bb-4afd-bb40-525ab515488a,
> checkpointBeforeWriteLockTime=16ms, checkpointWriteLockWait=0ms,
> checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
> splitAndSortPagesDuration=1316ms, pages=755336, reason='test']
> Checkpoint finished [checkpointId=0ac1db51-79bb-4afd-bb40-525ab515488a,
> pages=755336, pagesWriteTime=6012ms, fsyncTime=5767ms, totalTime=13113ms]
>
> Checkpoint started [checkpointId=f916da9f-4706-4882-9cfd-0467562d3256,
> checkpointBeforeWriteLockTime=14ms, checkpointWriteLockWait=0ms,
> checkpointListenersExecuteTime=1ms, checkpointWriteLockHoldTime=1ms,
> splitAndSortPagesDuration=1142ms, pages=755262, reason='test']
> Checkpoint finished [checkpointId=f916da9f-4706-4882-9cfd-0467562d3256,
> pages=755262, pagesWriteTime=6117ms, fsyncTime=7718ms, totalTime=14994ms]
> Checkpoint started [checkpointId=6357381a-09be-4ab0-bd83-5b9b3ad1f613,
> checkpointBeforeWriteLockTime=15ms, checkpointWriteLockWait=0ms,
> checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
> splitAndSortPagesDuration=1095ms, pages=755298, reason='test']
> Checkpoint finished [checkpointId=6357381a-09be-4ab0-bd83-5b9b3ad1f613,
> pages=755298, pagesWriteTime=6059ms, fsyncTime=5574ms, totalTime=12744ms]
>
> Checkpoint started
> [checkpointId=b250c459-c4dc-42a7-9a9d-df222d4c6f6c,
> checkpointBeforeWriteLockTime=15ms, checkpointWriteLockWait=0ms,
> checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
> splitAndSortPagesDuration=1088ms, pages=755326, reason='test']
> Checkpoint finished [checkpointId=b250c459-c4dc-42a7-9a9d-df222d4c6f6c,
> pages=755326, pagesWriteTime=5144ms, fsyncTime=5766ms, totalTime=12014ms]
>
> Checkpoint started
> [checkpointId=5caca15a-74c1-4b8e-94cc-3089bec59f74,
> checkpointBeforeWriteLockTime=15ms, checkpointWriteLockWait=0ms,
> checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
> splitAndSortPagesDuration=1178ms, pages=755304, reason='test']
> Checkpoint finished [checkpointId=5caca15a-74c1-4b8e-94cc-3089bec59f74,
> pages=755304, pagesWriteTime=5503ms, fsyncTime=5772ms, totalTime=12469ms]
>
> Checkpoint started
> [checkpointId=99bda466-038c-460e-9be1-9eec8a784dc6,
> checkpointBeforeWriteLockTime=14ms, checkpointWriteLockWait=0ms,
> checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
> splitAndSortPagesDuration=1315ms, pages=755260, reason='test']
> Checkpoint finished [checkpointId=99bda466-038c-460e-9be1-9eec8a784dc6,
> pages=755260, pagesWriteTime=5333ms, fsyncTime=5771ms, totalTime=12435ms]
>
> CpWritePagesTest#testOneThreadUseAsync
> Checkpoint started
> [checkpointId=c9436f06-71d7-49af-a035-20a467a47310,
> checkpointBeforeWriteLockTime=16ms, checkpointWriteLockWait=0ms,
> checkpointListenersExecuteTime=1ms, checkpointWriteLockHoldTime=1ms,
> splitAndSortPagesDuration=1084ms, pages=755328, reason='test']
> Checkpoint finished [checkpointId=c9436f06-71d7-49af-a035-20a467a47310,
> pages=755328, pagesWriteTime=4409ms, fsyncTime=5771ms, totalTime=11283ms]
> Checkpoint started
> [checkpointId=44bddd5b-77fa-4cd0-ac78-3a2abf6305b3,
> checkpointBeforeWriteLockTime=15ms, checkpointWriteLockWait=0ms,
> checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
> splitAndSortPagesDuration=1249ms, pages=755298, reason='test']
> Checkpoint finished [checkpointId=44bddd5b-77fa-4cd0-ac78-3a2abf6305b3,
> pages=755298, pagesWriteTime=5005ms, fsyncTime=5765ms, totalTime=12035ms]
>
> Checkpoint started
> [checkpointId=bc3bb678-19e8-4aef-8466-4c2c3dbeff84,
> checkpointBeforeWriteLockTime=14ms, checkpointWriteLockWait=1ms,
> checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
> splitAndSortPagesDuration=1141ms, pages=755325, reason='test']
> Checkpoint finished [checkpointId=bc3bb678-19e8-4aef-8466-4c2c3dbeff84,
> pages=755325, pagesWriteTime=4467ms, fsyncTime=5302ms, totalTime=10926ms]
>
> Checkpoint started
> [checkpointId=7283c7b4-12a9-4a25-9268-f1c807674d46,
> checkpointBeforeWriteLockTime=14ms, checkpointWriteLockWait=0ms,
> checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
> splitAndSortPagesDuration=1121ms, pages=755278, reason='test']
> Checkpoint finished [checkpointId=7283c7b4-12a9-4a25-9268-f1c807674d46,
> pages=755278, pagesWriteTime=4544ms, fsyncTime=5768ms, totalTime=11448ms]
>
> Checkpoint started
> [checkpointId=acd654a9-5da7-45e3-b646-165a0b72c70b,
> checkpointBeforeWriteLockTime=16ms, checkpointWriteLockWait=0ms,
> checkpointListenersExecuteTime=1ms, checkpointWriteLockHoldTime=1ms,
> splitAndSortPagesDuration=1133ms, pages=755334, reason='test']
> Checkpoint finished [checkpointId=acd654a9-5da7-45e3-b646-165a0b72c70b,
> pages=755334, pagesWriteTime=4180ms, fsyncTime=5542ms, totalTime=10874ms]
>
> Checkpoint started
> [checkpointId=1d9d6f3d-efce-4dbc-9268-46a32903c606,
> checkpointBeforeWriteLockTime=15ms, checkpointWriteLockWait=0ms,
> checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
> splitAndSortPagesDuration=1244ms, pages=755297, reason='test']
> Checkpoint finished [checkpointId=1d9d6f3d-efce-4dbc-9268-46a32903c606,
> pages=755297, pagesWriteTime=4336ms, fsyncTime=5773ms, totalTime=11369ms]
> Checkpoint started
> [checkpointId=fffcbf15-a912-4447-88ba-870a5b76ec53,
> checkpointBeforeWriteLockTime=15ms, checkpointWriteLockWait=0ms,
> checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
> splitAndSortPagesDuration=1296ms, pages=755274, reason='test']
> Checkpoint finished [checkpointId=fffcbf15-a912-4447-88ba-870a5b76ec53,
> pages=755274, pagesWriteTime=4387ms, fsyncTime=5768ms, totalTime=11467ms]
> Checkpoint started
> [checkpointId=be171217-31b3-4242-bc0e-ea5c921e5da6,
> checkpointBeforeWriteLockTime=16ms, checkpointWriteLockWait=0ms,
> checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
> splitAndSortPagesDuration=1052ms, pages=755298, reason='test']
> Checkpoint finished [checkpointId=be171217-31b3-4242-bc0e-ea5c921e5da6,
> pages=755298, pagesWriteTime=4348ms, fsyncTime=5787ms, totalTime=11204ms]
>
> Checkpoint started
> [checkpointId=7b64b2ff-8493-412e-9f0f-59e6eefc1d3b,
> checkpointBeforeWriteLockTime=15ms, checkpointWriteLockWait=0ms,
> checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
> splitAndSortPagesDuration=1344ms, pages=755305, reason='test']
> Checkpoint finished [checkpointId=7b64b2ff-8493-412e-9f0f-59e6eefc1d3b,
> pages=755305, pagesWriteTime=4153ms, fsyncTime=5767ms, totalTime=11280ms]
> Checkpoint started
> [checkpointId=1bb07aaa-3fcb-4744-8eb3-3f9bba87ac17,
> checkpointBeforeWriteLockTime=14ms, checkpointWriteLockWait=0ms,
> checkpointListenersExecuteTime=0ms, checkpointWriteLockHoldTime=0ms,
> splitAndSortPagesDuration=1303ms, pages=755319, reason='test']
> Checkpoint finished [checkpointId=1bb07aaa-3fcb-4744-8eb3-3f9bba87ac17,
> pages=755319, pagesWriteTime=4231ms, fsyncTime=5311ms, totalTime=10864ms]
> {noformat}
> *{color:#DE350B}Total{color}* - needs to be implemented.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)