[
https://issues.apache.org/jira/browse/HADOOP-16244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16816995#comment-16816995
]
Wei-Chiu Chuang edited comment on HADOOP-16244 at 4/13/19 4:07 PM:
-------------------------------------------------------------------
Thanks for bring it up. I am not aware of ISA-L compress/decompress library. As
for high performance compression library, ZStandard seems quite promising these
days.
was (Author: jojochuang):
Thanks for bring it up. I am not aware of ISA-L compress/decompress library. As
for high performance compression library, ZSTD seems quite promising these
days.
> Hadoop Support ISA-L Compress/Decompress
> ----------------------------------------
>
> Key: HADOOP-16244
> URL: https://issues.apache.org/jira/browse/HADOOP-16244
> Project: Hadoop Common
> Issue Type: New Feature
> Components: build, common, fs, native
> Reporter: zhong yingqun
> Priority: Major
>
> In hadoop 3.0.0+ , for default RS codec, there is also a native
> implementation which leverages Intel ISA-L library to improve the performance
> of codec. as we know, ISA-L has set of highly optimized functions include
> compression/decompression base on gzip. can ISA-L compatible with hadoop to
> provide highly performance of un/compress? however, hadoop comunity seem not
> support isa-l compression & decompression up to now. Has some problem in
> ISA-L compress-support?
> Can someone share the experience in this area? thanks a lot!
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
