[
https://issues.apache.org/jira/browse/LUCENE-9539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17200080#comment-17200080
]
ASF subversion and git services commented on LUCENE-9539:
---------------------------------------------------------
Commit 705faa3b2c02f350c928babc731685e1bfaf1027 in lucene-solr's branch
refs/heads/branch_8x from Simon Willnauer
[ https://gitbox.apache.org/repos/asf?p=lucene-solr.git;h=705faa3 ]
LUCENE-9539: Use more compact datastructures for sorting doc-values (#1908)
This change cuts over from object based data-structures to primitive /
compressed data-structures.
> Improve memory footprint of SortingCodecReader
> ----------------------------------------------
>
> Key: LUCENE-9539
> URL: https://issues.apache.org/jira/browse/LUCENE-9539
> Project: Lucene - Core
> Issue Type: Improvement
> Reporter: Simon Willnauer
> Priority: Major
> Time Spent: 50m
> Remaining Estimate: 0h
>
> SortingCodecReader is a very memory heavy since it needs to re-sort and load
> large parts of the index into memory. We can try to make it more efficient by
> using more compact internal data-structures, remove the caches it uses
> provided we define it's usage as a merge only reader wrapper. Ultimately we
> need to find a way to allow the reader or some other structure to minimize
> its heap memory. One way is to slice existing readers and merge them in
> multiple steps. There will be multiple steps towards a more useable version
> of this class.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
