[
https://issues.apache.org/jira/browse/LUCENE-8739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17470624#comment-17470624
]
Robert Muir commented on LUCENE-8739:
-------------------------------------
> +1 ZSTD is quite great. I wouldn't use it in the Lucene default codec yet,
> because lucene-core shouldn't have dependencies and we don't want to use JNI
> in the lucere-core build. Maybe we can reconsider when Project Panama lands
> and it gets easier to interact with native libraries.
IMO this applies to native libraries too though. I'd disagree with lucene not
working correctly depending upon existence or version of libzstd.so on the
machine.
The performance/space tradeoffs are not particularly compelling to me to be
worth the native-library hassle right now. Level 4 is the only one slightly
interesting, as it would give compression similar to BEST_COMPRESSION with
indexing time similar to BEST_SPEED, but still the retrieval is slow. And the
differences compared to cloudflare zlib aren't that big.
> ZSTD Compressor support in Lucene
> ---------------------------------
>
> Key: LUCENE-8739
> URL: https://issues.apache.org/jira/browse/LUCENE-8739
> Project: Lucene - Core
> Issue Type: New Feature
> Components: core/codecs
> Reporter: Sean Torres
> Priority: Minor
> Labels: features
> Time Spent: 2.5h
> Remaining Estimate: 0h
>
> ZStandard has a great speed and compression ratio tradeoff.
> ZStandard is open source compression from Facebook.
> More about ZSTD
> [https://github.com/facebook/zstd]
> [https://code.facebook.com/posts/1658392934479273/smaller-and-faster-data-compression-with-zstandard/]
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org
