[ 
https://issues.apache.org/jira/browse/ORC-175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16146185#comment-16146185
 ] 

Gopal V commented on ORC-175:
-----------------------------

The fact that the underlying codec is compatible means that we should be able 
to extend the decompression speedups to all users who already use Zlib for 
their storage - which is a big advantage if it can be pulled off.

If Hadoop's ZlibCodec could be built to work against ISA-L, then all of the 
projects would get ISA-L support at the same time.

That might be much easier than trying to build it into ORC alone, since 
hadoop-common already has a partial dependency on ISA-L and JNI code which 
depends on it.

https://github.com/apache/hadoop/blob/trunk/hadoop-common-project/hadoop-common/src/CMakeLists.txt#L126

{code}
find_library(ISAL_LIBRARY
    NAMES isal
     PATHS ${CUSTOM_ISAL_PREFIX} ${CUSTOM_ISAL_PREFIX}/lib
              ${CUSTOM_ISAL_PREFIX}/lib64 ${CUSTOM_ISAL_LIB} /usr/lib)
{code}

> ZLIB performance
> ----------------
>
>                 Key: ORC-175
>                 URL: https://issues.apache.org/jira/browse/ORC-175
>             Project: ORC
>          Issue Type: Improvement
>          Components: Java
>            Reporter: iamhumanbeing
>            Assignee: iamhumanbeing
>              Labels: performance
>   Original Estimate: 336h
>  Remaining Estimate: 336h
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Reply via email to