[
https://issues.apache.org/jira/browse/AVRO-2195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16530911#comment-16530911
]
Benson Qiu commented on AVRO-2195:
----------------------------------
Thanks [~nielsbasjes] and [~nkollar] for the comments.
{quote}
An important feature of Avro is being crossplatform/crosslanguage so I am very
curious regarding the portability of this compressor across languages.
Simply put: does it exist outside the Java world?
{quote}
Repeating what I mentioned on the dev mailing list: There are quite a few
language bindings for zstandard compression documented
[here|https://facebook.github.io/zstd/#other-languages]. Please let me know if
that sufficiently addresses your question.
I have uploaded v2 of the patch. It contains the following changes:
* Added unit tests in `TestDataFile` and `TestAvroKeyOutputFormat`.
* Added a dependency on `zstd-jni`.
* Fixed typo in the comment: /** zstandard codec */
> Add Zstandard Codec
> -------------------
>
> Key: AVRO-2195
> URL: https://issues.apache.org/jira/browse/AVRO-2195
> Project: Avro
> Issue Type: New Feature
> Components: java
> Affects Versions: 1.9.0
> Reporter: Benson Qiu
> Priority: Major
> Labels: patch
> Attachments: AVRO-2195.patch, AVRO-2195.patch.v2
>
>
> Inspired by AVRO-1373. The Zstandard algorithm is available in the
> commons-library, which Avro projects already depend on.
> In a quick test that I did, Zstandard had a better compression ratio than
> deflate (compression level 9).
> [https://code.fb.com/core-data/smaller-and-faster-data-compression-with-zstandard/]
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
