Prewarming of page memory after node restart

[Дмитрий Сорокин]

Hi Igniters!



I want to propose the new feature for Ignite - prewarming of page memory.



The essence of prewarming feature is that after restarting the node is to
load into memory those pages that were loaded before last shutdown. I have
implemented the PoC of prewarming of page memory, which makes dump of IDs
of loaded pages before node shutdown and, optionally, at runtime. When node
restarts, special worker loads the pages with saved IDs in memory, and
restore phase depending on configuration may or may not to wait the end of
prewarming process. Persentage of hottest loaded pages may be configured,
if dumping of all of ones is not need. Prewarming process is multithreaded
(optionally) and has heuristical throttling algorithm.
PrewarmingConfiguration is the only change of public API, and was added as
property of DataRegionConfiguration, which non-null value enables the
prewarming feature.

Link to the Jira ticket: https://issues.apache.org/jira/browse/IGNITE-11457

Link to the PR: https://github.com/apache/ignite/pull/6223.



I would like to receive feedback on this prewarming feature concept.

[jira] [Created] (IGNITE-11457) Prewarming of page memory after node restart

[Dmitriy Sorokin (JIRA)]

Dmitriy Sorokin created IGNITE-11457:


 Summary: Prewarming of page memory after node restart
 Key: IGNITE-11457
 URL: https://issues.apache.org/jira/browse/IGNITE-11457
 Project: Ignite
  Issue Type: New Feature
Reporter: Dmitriy Sorokin
Assignee: Dmitriy Sorokin


The essence of page memory prewarming feature is that after restarting the node 
is to load into memory those pages that were loaded before last shutdown. This 
approach allows to get fully prewarmed node or even cluster just after one has 
been restarted.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)