[
https://issues.apache.org/jira/browse/LUCENE-6183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14278470#comment-14278470
]
Robert Muir commented on LUCENE-6183:
-------------------------------------
Here is the deflate-6 proposed here. I think for BEST_COMPRESSION its now a
good tradeoff.
{noformat}
timeIndexing=401208
timeForceMerging=17187
SM 0 [2015-01-15 04:17:53.489; main]: 10939 msec to merge stored fields
[6881288 docs]
-rw-rw-r-- 1 rmuir rmuir 2322463087 Jan 15 04:17 _84a.fdt
-rw-rw-r-- 1 rmuir rmuir 733578 Jan 15 04:17 _84a.fdx
{noformat}
> Avoid re-compression on stored fields merge
> -------------------------------------------
>
> Key: LUCENE-6183
> URL: https://issues.apache.org/jira/browse/LUCENE-6183
> Project: Lucene - Core
> Issue Type: Improvement
> Reporter: Robert Muir
> Fix For: Trunk, 5.1
>
> Attachments: LUCENE-6183.patch
>
>
> We removed this optimization before, it didnt really work right because it
> required things to be "aligned".
> But I think we can do it simpler and safer. This recompression is a big cpu
> hog in merge, and limits our options compression-wise (especially ones like
> LZ4-HC that are only slower at write-time).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
