GitHub user s1monw opened a pull request:
https://github.com/apache/lucene-solr/pull/521
LUCENE-8598: Improve field updates packed values
DocValuesFieldUpdats are using compact settings for packet ints that causes
dramatic slowdowns when the updates are finished and sorted. Moving to the
default
accepted overhead ratio yields up to 4x improvements in applying updates.
This change
also improves the packing of numeric values since we know the value range
in advance and
can choose a different packing scheme in such a case.
Overall this change yields a good performance improvement since 99% of the
times of applying
DV field updates are spend in the sort method which essentially makes
applying the updates
4x faster.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/s1monw/lucene-solr improve_packing
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/lucene-solr/pull/521.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #521
----
commit e6aecc1994f4116f92d51a3841f2cda01e73e70b
Author: Simon Willnauer <simonw@...>
Date: 2018-12-09T18:13:20Z
LUCENE-8598: Improve field updates packed values
DocValuesFieldUpdats are using compact settings for packet ints that causes
dramatic slowdowns when the updates are finished and sorted. Moving to the
default
accepted overhead ratio yields up to 4x improvements in applying updates.
This change
also improves the packing of numeric values since we know the value range
in advance and
can choose a different packing scheme in such a case.
Overall this change yields a good performance improvement since 99% of the
times of applying
DV field updates are spend in the sort method which essentially makes
applying the updates
4x faster.
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
