Hello? What's delay of checkpoint?
I fail to see how 82206 is catastrophically worse than 65681. To me it sounds like sensible increase. Regards, -- Ilya Kasnacheev чт, 28 февр. 2019 г. в 19:01, Antonio Conforti <[email protected]>: > Hello Ilya, > > > if I well interpret the log for example of node with consitentid 7 what I > see is a constant increment of dirty pages: > > 2019-02-27 17:04:42.206 INFO 41153 --- [oint-thread-#67] > i.i.p.c.p.GridCacheDatabaseSharedManager : Checkpoint finished > [cpId=b3d5b34c-60d3-4c39-af0f-5de6d41686f3, pages=65681, > markPos=FileWALPointer [idx=16, fileOff=24231459, len=75645], > walSegmentsCleared=6, walSegmentsCovered=[10 - 15], markDuration=74ms, > pagesWrite=1429ms, fsync=101ms, total=1604ms] > 2019-02-27 17:07:42.244 INFO 41153 --- [oint-thread-#67] > i.i.p.c.p.GridCacheDatabaseSharedManager : Checkpoint finished > [cpId=83cc0c0a-9427-465d-a290-f8a56c366528, pages=69139, > markPos=FileWALPointer [idx=22, fileOff=41402244, len=75645], > walSegmentsCleared=6, walSegmentsCovered=[16 - 21], markDuration=26ms, > pagesWrite=1521ms, fsync=101ms, total=1648ms] > 2019-02-27 17:10:42.553 INFO 41153 --- [oint-thread-#67] > i.i.p.c.p.GridCacheDatabaseSharedManager : Checkpoint finished > [cpId=4fe0396f-5ece-4016-a269-119d5ecd8d16, pages=72896, > markPos=FileWALPointer [idx=29, fileOff=6850845, len=75645], > walSegmentsCleared=12, walSegmentsCovered=[22 - 28], markDuration=28ms, > pagesWrite=1713ms, fsync=207ms, total=1948ms] > 2019-02-27 17:13:45.214 INFO 41153 --- [oint-thread-#67] > i.i.p.c.p.GridCacheDatabaseSharedManager : Checkpoint finished > [cpId=a309e6a2-865d-439e-ab6d-11ef9641c8b0, pages=75381, > markPos=FileWALPointer [idx=35, fileOff=48279077, len=75645], > walSegmentsCleared=7, walSegmentsCovered=[29 - 34], markDuration=44ms, > pagesWrite=4446ms, fsync=112ms, total=4602ms] > 2019-02-27 17:16:42.728 INFO 41153 --- [oint-thread-#67] > i.i.p.c.p.GridCacheDatabaseSharedManager : Checkpoint finished > [cpId=0299f7d3-8ed0-4f0b-8499-14e46d3bef13, pages=78944, > markPos=FileWALPointer [idx=42, fileOff=39209416, len=75645], > walSegmentsCleared=6, walSegmentsCovered=[35 - 41], markDuration=28ms, > pagesWrite=1989ms, fsync=95ms, total=2112ms] > 2019-02-27 17:19:40.829 INFO 41153 --- [r-stripe-10-#27] > o.a.i.i.p.c.p.pagemem.PageMemoryImpl : Throttling is applied to page > modifications [percentOfPartTime=0.31, markDirty=22777 pages/sec, > checkpointWrite=11469 pages/sec, estIdealMarkDirty=226519 pages/sec, > curDirty=0.00, maxDirty=0.07, avgParkTime=122057 ns, pages: (total=82206, > evicted=0, written=10035, synced=0, cpBufUsed=27, cpBufTotal=518215)] > 2019-02-27 17:19:50.524 INFO 41153 --- [oint-thread-#67] > i.i.p.c.p.GridCacheDatabaseSharedManager : Checkpoint finished > [cpId=f323c2fd-d358-469e-8e12-d2ae1391a546, pages=82206, > markPos=FileWALPointer [idx=49, fileOff=42053202, len=75645], > walSegmentsCleared=8, walSegmentsCovered=[42 - 48], markDuration=27ms, > pagesWrite=9749ms, fsync=123ms, total=9899ms] > 2019-02-27 17:22:40.885 INFO 41153 --- [r-stripe-11-#28] > o.a.i.i.p.c.p.pagemem.PageMemoryImpl : Throttling is applied to page > modifications [percentOfPartTime=0.23, markDirty=14449 pages/sec, > checkpointWrite=6729 pages/sec, estIdealMarkDirty=166922 pages/sec, > curDirty=0.00, maxDirty=0.09, avgParkTime=108997 ns, pages: (total=68092, > evicted=0, written=13266, synced=0, cpBufUsed=12, cpBufTotal=518215)] > > > I try to explain better: > > I see at every finished checkpoint a constant increease of dirty pages and > a > consequent duration increase of checkpoint: > > 1) at 17:04:42.206 dirty pages are 65681 with a delay of checkpoint of > 1604ms > 2) at 17:19:50.524 dirty pages are 82206 with a delay of checkpoint of > 9899ms > > > So in only 15 minutes with constant rate of 4000 entry/sec I observe a > increment of delay of about 9 times respect to start of simulation and the > consequent apllication of throttling how reported in the log at 17:19:40. > > I expected a constant number of dirty page and a consequent constant delay > of checkpoint. > > Do you have any suggestion about that? > > Thanks a lot. > > > > -- > Sent from: http://apache-ignite-users.70518.x6.nabble.com/ >
