[
https://issues.apache.org/jira/browse/LUCENE-7589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15754558#comment-15754558
]
Adrien Grand commented on LUCENE-7589:
--------------------------------------
Like Mike predicted, this helped the NYC taxi bench a bit, Disk usage for the
dropoff datetime field went from 194MB to 166MB:
http://people.apache.org/~mikemccand/lucenebench/sparseResults.html#index_size_by_field
> Prevent outliers from raising the number of bits of everyone with numeric doc
> values
> ------------------------------------------------------------------------------------
>
> Key: LUCENE-7589
> URL: https://issues.apache.org/jira/browse/LUCENE-7589
> Project: Lucene - Core
> Issue Type: Improvement
> Reporter: Adrien Grand
> Assignee: Adrien Grand
> Priority: Minor
> Fix For: master (7.0)
>
> Attachments: LUCENE-7589.patch
>
>
> Today we encode entire segments with a single number of bits per value. It
> was done this way because it was faster, but it also means a single outlier
> can significantly increase the space requirements. I think we should have
> protection against that.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
