[
https://issues.apache.org/jira/browse/ORC-175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16146185#comment-16146185
]
Gopal V commented on ORC-175:
-----------------------------
The fact that the underlying codec is compatible means that we should be able
to extend the decompression speedups to all users who already use Zlib for
their storage - which is a big advantage if it can be pulled off.
If Hadoop's ZlibCodec could be built to work against ISA-L, then all of the
projects would get ISA-L support at the same time.
That might be much easier than trying to build it into ORC alone, since
hadoop-common already has a partial dependency on ISA-L and JNI code which
depends on it.
https://github.com/apache/hadoop/blob/trunk/hadoop-common-project/hadoop-common/src/CMakeLists.txt#L126
{code}
find_library(ISAL_LIBRARY
NAMES isal
PATHS ${CUSTOM_ISAL_PREFIX} ${CUSTOM_ISAL_PREFIX}/lib
${CUSTOM_ISAL_PREFIX}/lib64 ${CUSTOM_ISAL_LIB} /usr/lib)
{code}
> ZLIB performance
> ----------------
>
> Key: ORC-175
> URL: https://issues.apache.org/jira/browse/ORC-175
> Project: ORC
> Issue Type: Improvement
> Components: Java
> Reporter: iamhumanbeing
> Assignee: iamhumanbeing
> Labels: performance
> Original Estimate: 336h
> Remaining Estimate: 336h
>
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)