[
https://issues.apache.org/jira/browse/IGNITE-26622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aleksandr Polovtsev updated IGNITE-26622:
-----------------------------------------
Description:
When reading data from segment files, we call `SegmentFile.openExisting`, which
"mmaps" the whole file into memory. This is not very effective when reading
consecutive data from the same file over and over again. We need to introduce
some kind of a cache, that will ideally allow us to call "mmap" only once. Or
the code should be reworked to use regular file API to read bytes directly.
The same approach can be extended to reading from index files.
was:When reading data from segment files, we call `SegmentFile.openExisting`,
which "mmaps" the whole file into memory. This is not very effective when
reading consecutive data from the same file over and over again. We need to
introduce some kind of a cache, that will ideally allow us to call "mmap" only
once. Or the code should be reworked to use regular file API to read bytes
directly.
> Add recently opened segment file cache
> --------------------------------------
>
> Key: IGNITE-26622
> URL: https://issues.apache.org/jira/browse/IGNITE-26622
> Project: Ignite
> Issue Type: Improvement
> Reporter: Aleksandr Polovtsev
> Priority: Major
> Labels: ignite-3
>
> When reading data from segment files, we call `SegmentFile.openExisting`,
> which "mmaps" the whole file into memory. This is not very effective when
> reading consecutive data from the same file over and over again. We need to
> introduce some kind of a cache, that will ideally allow us to call "mmap"
> only once. Or the code should be reworked to use regular file API to read
> bytes directly.
> The same approach can be extended to reading from index files.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
