ASF GitHub Bot commented on IGNITE-7182:

GitHub user dspavlov opened a pull request:


    IGNITE-7182 Supported striped dirty page storage in skip list maps  

    And quick sort with early cp pages write start

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/gridgain/apache-ignite ignite-7182-buckets2

Alternatively you can review and apply these changes as the patch at:


To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #3830
commit f5fbd1a8951f73897aaadea2656ec35ede852762
Author: dpavlov <dpavlov@...>
Date:   2018-04-16T14:36:02Z

    IGNITE-7182 Supported striped dirty page storage in skip list maps and 
quick sort with early cp pages write start


> Slow sorting of pages collection on checkpoint begin can cause zero dropdown 
> even with throttling enabled
> ---------------------------------------------------------------------------------------------------------
>                 Key: IGNITE-7182
>                 URL: https://issues.apache.org/jira/browse/IGNITE-7182
>             Project: Ignite
>          Issue Type: Improvement
>          Components: persistence
>    Affects Versions: 2.3
>            Reporter: Ivan Rakov
>            Assignee: Dmitriy Pavlov
>            Priority: Major
>             Fix For: 2.6
> Tests show that GridCacheDatabaseSharedManager#splitAndSortCpPagesIfNeeded 
> call can last several seconds on nodes with big amount of memory (>10GB). We 
> should optimize sorting algorithm, possibly making it multithreaded.
> Another option to make pages write throttling more smooth is to get rid of 
> this heuristic:
> {noformat}
>                 // Starting with 0.05 to avoid throttle right after 
> checkpoint start
>                 // 7/12 is maximum ratio of dirty pages
>                 dirtyRatioThreshold = (dirtyRatioThreshold * 0.95 + 0.05) * 7 
> / 12;
> {noformat}
> We should replace "magic" lower bound 0.05 * 7 / 12 with the real percentage 
> of dirty pages at the moment of 
> GridCacheDatabaseSharedManager.Checkpointer#markCheckpointBegin call return.

This message was sent by Atlassian JIRA

Reply via email to