[
https://issues.apache.org/jira/browse/IGNITE-7533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16347192#comment-16347192
]
Dmitriy Pavlov commented on IGNITE-7533:
----------------------------------------
Warning is also generated each 10secs if throttling is applied and affects
current mark process more than 20%
{noformat}
Throttling is applied for page mark [weight=0,27, mark speed=18299 pages/sec,
checkpoint write speed=19016 pages/sec, est.ideal mark=18301 pages/sec,
curDirty=0,06, targetDirty=0,06, avgParkTime=117471 ns]
{noformat}
> Throttle writting threads according fsync progress and checkpoint writting
> speed instead of region fill
> -------------------------------------------------------------------------------------------------------
>
> Key: IGNITE-7533
> URL: https://issues.apache.org/jira/browse/IGNITE-7533
> Project: Ignite
> Issue Type: Improvement
> Components: persistence
> Affects Versions: 2.3
> Reporter: Dmitriy Pavlov
> Assignee: Dmitriy Pavlov
> Priority: Major
> Fix For: 2.5
>
> Attachments: image (2).png, imageRatioBased.png, imageSpeedBased.png
>
>
> Throttling implemented under IGNITE-6334 is based on region fill percentage
> (ditry pages ratio) and current checkpoint progress.
> But actual progress of writting is based on write operation complete, but not
> on fsync() complete.
> Suppose following stage of CP is currently running: most of data is being
> written and fsync is started. Fsync on experiments requires more time than
> write, but throttling is disabled for that stage. There is enough time to
> unthrottled grid to fill remaining 16% of clear pages to get sufficient 75%
> of dirty pages and writes stops.
> Fsync progress is to be included in checkpoint progress, but actual fsync
> progress reported by OS is irregular both on Linux and Windows. See picture,
> green line is fsync progress, and yellow is write complete.
> Because fsync progress reported is not regular (the differences are 3-4
> orders of magnitude) it is suggested to implement new speed based throttling
> policy.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
