[
https://issues.apache.org/jira/browse/IGNITE-13912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17268745#comment-17268745
]
shivakumar commented on IGNITE-13912:
-------------------------------------
Hi [[email protected]]
I compiled master branch code and did my stability test, unfortunately again
facing same issue, WAL growing without any limit with continuous high speed
data ingestion (continuous sql inserts)
I have attached WAL total size graph (wal_usage.PNG), wal directory contents
(wal_dir_contents.txt) also attached logs of one of the server node (DEBUG log
and grep for wal) (wal-checkpoint-logs.txt)
These are the parameters set as part of ignite configurations;
<property name="writeThrottlingEnabled" value="true"/>
<property name="checkpointFrequency" value="#\{1 * 60 * 1000}"/>
<property name="walSegmentSize" value="#\{1L * 1024 * 1024 * 1024}"/>
<property name="maxWalArchiveSize" value="#\{10L * 1024 * 1024 * 1024}"/>
<property name="storagePath" value="/opt/ignite/persistence/"/>
<property name="walPath" value="/opt/ignite/wal/"/>
<property name="walArchivePath" value="/opt/ignite/wal/"/>
<property name="walMode" value="FSYNC"/>
Please let me know if you need any information.
If you feel any property has to be set please let me know.
Thanks
Shiva
> Incorrect calculation of WAL segments that should be deleted from WAL archive
> -----------------------------------------------------------------------------
>
> Key: IGNITE-13912
> URL: https://issues.apache.org/jira/browse/IGNITE-13912
> Project: Ignite
> Issue Type: Bug
> Components: persistence
> Reporter: Kirill Tkalenko
> Assignee: Kirill Tkalenko
> Priority: Critical
> Fix For: 2.10
>
> Attachments: wal-checkpoint-logs, wal_dir_contents, wal_usage.PNG,
> wal_usage_dec12.PNG, wal_usage_dec22nd_binary.PNG
>
> Time Spent: 20m
> Remaining Estimate: 0h
>
> Now there is an incorrect calculation of WAL segments that should be deleted
> from WAL archive. Since we delete only those segments whose total size should
> not exceed *DataStorageConfiguration#maxWalArchiveSize *
> IGNITE_THRESHOLD_WAL_ARCHIVE_SIZE_PERCENTAGE*, but should be up to
> DataStorageConfiguration#maxWalArchiveSize *
> IGNITE_THRESHOLD_WAL_ARCHIVE_SIZE_PERCENTAGE*. Therefore, an excess of
> *DataStorageConfiguration#maxWalArchiveSize* occurs.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
