[
https://issues.apache.org/jira/browse/LUCENE-9539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17200789#comment-17200789
]
ASF subversion and git services commented on LUCENE-9539:
---------------------------------------------------------
Commit 17c285d61743da0c06735e06235b20bd5aac4e14 in lucene-solr's branch
refs/heads/master from Simon Willnauer
[ https://gitbox.apache.org/repos/asf?p=lucene-solr.git;h=17c285d ]
LUCENE-9539: Remove caches from SortingCodecReader (#1909)
SortingCodecReader keeps all docvalues in memory that are loaded from this
reader.
Yet, this reader should only be used for merging which happens sequentially.
This makes
caching docvalues unnecessary.
Co-authored-by: Jim Ferenczi <[email protected]>
> Improve memory footprint of SortingCodecReader
> ----------------------------------------------
>
> Key: LUCENE-9539
> URL: https://issues.apache.org/jira/browse/LUCENE-9539
> Project: Lucene - Core
> Issue Type: Improvement
> Reporter: Simon Willnauer
> Priority: Major
> Time Spent: 3h 20m
> Remaining Estimate: 0h
>
> SortingCodecReader is a very memory heavy since it needs to re-sort and load
> large parts of the index into memory. We can try to make it more efficient by
> using more compact internal data-structures, remove the caches it uses
> provided we define it's usage as a merge only reader wrapper. Ultimately we
> need to find a way to allow the reader or some other structure to minimize
> its heap memory. One way is to slice existing readers and merge them in
> multiple steps. There will be multiple steps towards a more useable version
> of this class.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
