Joe McDonnell created IMPALA-11603:
--------------------------------------
Summary: Investigate using cloudflare's zlib library
Key: IMPALA-11603
URL: https://issues.apache.org/jira/browse/IMPALA-11603
Project: IMPALA
Issue Type: Improvement
Components: Backend
Affects Versions: Impala 4.2.0
Reporter: Joe McDonnell
Amazon recommends the use of cloudflare's zlib implementation at
[https://github.com/cloudflare/zlib]
In a blog post, they claim pretty large performance boosts over the regular
zlib implementation:
[https://aws.amazon.com/blogs/opensource/improving-zlib-cloudflare-and-comparing-performance-with-other-zlib-forks/]
{noformat}
On Arm:
Compression performance: ~90 percent faster than zlib-madler (original zlib).
Decompression performance: ~52 percent faster than zlib-madler.
On x86:
Compression performance: ~113 percent faster than zlib-madler.
Decompression performance: ~44 percent faster than zlib-madler.{noformat}
The blog post is a year and a half old, so things may have changed since then,
but it seems interesting. Amazon's guidebooks still recommend it.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
