Viral Gandhi created LUCENE-9378:
------------------------------------
Summary: Configurable compression for BinaryDocValues
Key: LUCENE-9378
URL: https://issues.apache.org/jira/browse/LUCENE-9378
Project: Lucene - Core
Issue Type: Improvement
Reporter: Viral Gandhi
Lucene 8.5.1 includes a change to always [compress
BinaryDocValues|https://issues.apache.org/jira/browse/LUCENE-9211]. This caused
(~30%) reduction in our red-line QPS (throughput).
We think users should be given some way to opt-in for this compression feature
instead of always being enabled which can have a substantial query time cost as
we saw during our upgrade. [~mikemccand] suggested one possible approach by
introducing a *mode* in Lucene84DocValuesFormat (COMPRESSED and UNCOMPRESSED)
and allowing users to create a custom Codec subclassing the default Codec and
pick the format they want.
Idea is similar to Lucene50StoredFieldsFormat which has two modes,
Mode.BEST_SPEED and Mode.BEST_COMPRESSION.
Here' related issues for adding benchmark covering BINARY doc values query-time
performance - [https://github.com/mikemccand/luceneutil/issues/61]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org
