iamhumanbeing created ORC-175:
---------------------------------
Summary: Using compression code of Intel® ISA-L to improve ZLIB
performance
Key: ORC-175
URL: https://issues.apache.org/jira/browse/ORC-175
Project: ORC
Issue Type: Improvement
Components: Java
Reporter: iamhumanbeing
The Intel® Intelligent Storage Acceleration Library (Intel® ISA-L) is a
collection of optimized low-level functions used primarily in storage
applications, but given the flexibility inherent to low-level implementations,
ISA-L has ramifications for software well beyond the storage domain. The open
source versions contain multiple units that include functions to implement fast
erasure codes, data protection & integrity, compression, hashing and
encryption.
We used ZLIB code of ISA-L to get 200% compression improvement and 50%
decompression improvement for ORC FILE.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)