Robert Muir created LUCENE-5744:
-----------------------------------
Summary: Try to move some more norms/docvalues merging out of
SegmentMerger
Key: LUCENE-5744
URL: https://issues.apache.org/jira/browse/LUCENE-5744
Project: Lucene - Core
Issue Type: New Feature
Reporter: Robert Muir
Today, SegmentMerger opens up all the norms/docvalues and calls merge on the
codec.
Can we improve this? In general these things are lazy-loaded, but it would be
nice for example, in the case of norms or memory docvalues, to not actually
load up things into their hashmap during merging (this would be just a few
lines of code), or maybe in the future, even stream the data from disk if not
loaded already.
This would help a lot with RAM spikes during merging, which can happen if
someone has a lot of "latent" norms, e.g. fields they rarely search on.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
