Kirill Tkalenko created IGNITE-27308:
----------------------------------------
Summary: Improve the delta file merge pause strategy
Key: IGNITE-27308
URL: https://issues.apache.org/jira/browse/IGNITE-27308
Project: Ignite
Issue Type: Improvement
Reporter: Kirill Tkalenko
Assignee: Kirill Tkalenko
Fix For: 3.2
Currently, when a checkpoint occurs, we abort the merge of delta files into
partition files and then restore it after the checkpoint completes.
If disk writes are slow enough during intensive inserts, we could end up with
checkpoints piling up one after another and the merge of delta files never
occurs. This could lead to a rapid increase in the number of delta files and an
error about too many files being open.
A more flexible approach is needed.
For example, if the number of delta files in a partition is no more than 4, we
can abort the merge. If it's more but less than 10, we can slow down the merge
slightly. But if it's more, we won't slow down or stop anything.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
