[
https://issues.apache.org/jira/browse/IGNITE-7182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16439521#comment-16439521
]
ASF GitHub Bot commented on IGNITE-7182:
----------------------------------------
GitHub user dspavlov opened a pull request:
https://github.com/apache/ignite/pull/3830
IGNITE-7182 Supported striped dirty page storage in skip list maps
And quick sort with early cp pages write start
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/gridgain/apache-ignite ignite-7182-buckets2
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/ignite/pull/3830.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #3830
----
commit f5fbd1a8951f73897aaadea2656ec35ede852762
Author: dpavlov <dpavlov@...>
Date: 2018-04-16T14:36:02Z
IGNITE-7182 Supported striped dirty page storage in skip list maps and
quick sort with early cp pages write start
----
> Slow sorting of pages collection on checkpoint begin can cause zero dropdown
> even with throttling enabled
> ---------------------------------------------------------------------------------------------------------
>
> Key: IGNITE-7182
> URL: https://issues.apache.org/jira/browse/IGNITE-7182
> Project: Ignite
> Issue Type: Improvement
> Components: persistence
> Affects Versions: 2.3
> Reporter: Ivan Rakov
> Assignee: Dmitriy Pavlov
> Priority: Major
> Fix For: 2.6
>
>
> Tests show that GridCacheDatabaseSharedManager#splitAndSortCpPagesIfNeeded
> call can last several seconds on nodes with big amount of memory (>10GB). We
> should optimize sorting algorithm, possibly making it multithreaded.
> Another option to make pages write throttling more smooth is to get rid of
> this heuristic:
> {noformat}
> // Starting with 0.05 to avoid throttle right after
> checkpoint start
> // 7/12 is maximum ratio of dirty pages
> dirtyRatioThreshold = (dirtyRatioThreshold * 0.95 + 0.05) * 7
> / 12;
> {noformat}
> We should replace "magic" lower bound 0.05 * 7 / 12 with the real percentage
> of dirty pages at the moment of
> GridCacheDatabaseSharedManager.Checkpointer#markCheckpointBegin call return.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
