[
https://issues.apache.org/jira/browse/LUCENE-8590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16710304#comment-16710304
]
ASF subversion and git services commented on LUCENE-8590:
---------------------------------------------------------
Commit b0e6a92ede321dc6932348978bed1a4c04a70d8c in lucene-solr's branch
refs/heads/master from [~simonw]
[ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=b0e6a92 ]
LUCENE-8590: Optimize DocValues update datastructures
Today we are using a LinkedHashMap to buffer doc-values updates in
BufferedUpdates. This on the one hand uses an Object based datastructure
and on the other requires re-encoding the data into a more compact
representation
once the BufferedUpdates are frozen. This change uses a more compact
represenation
for the updates already in the BufferedUpdates in a parallel-array like
datastructure
that can be reused in FrozenBufferedDeletes. It also adds an much simpler to use
API to consume the updates and allows for internal memory optimization for
common
case updates.
> Optimize DocValues update datastructures
> ----------------------------------------
>
> Key: LUCENE-8590
> URL: https://issues.apache.org/jira/browse/LUCENE-8590
> Project: Lucene - Core
> Issue Type: Improvement
> Reporter: Simon Willnauer
> Priority: Major
> Fix For: 7.6, master (8.0)
>
> Time Spent: 3h 40m
> Remaining Estimate: 0h
>
> Today we are using a LinkedHashMap to buffer doc-values updates in
> BufferedUpdates. This on the one hand uses an Object based datastructure
> and on the other requires re-encoding the data into a more compact
> representation
> once the BufferedUpdates are frozen. This change uses a more compact
> represenation
> for the updates already in the BufferedUpdates in a parallel-array like
> datastructure
> that can be reused in FrozenBufferedDeletes. It also adds an much simpler
> to use
> API to consume the updates and allows for internal memory optimization
> for common
> case updates.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
