[
https://issues.apache.org/jira/browse/HBASE-11927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14132492#comment-14132492
]
Todd Lipcon commented on HBASE-11927:
-------------------------------------
Using the native verification as it stands today is a little bit difficult --
we don't expose the normal Checksum interface for the native checksum-- only
the "chunked sums" format which is used by HDFS. HADOOP-10859 is probably what
you need here.
BTW, when I tried to use the zlib crc in Java7 I found it wasn't any faster
than Java6. Code inspection also showed that the implementation was the same,
at least in OpenJDK. So I'm not sure this is beneficial in most environments.
> If java7, use zip crc
> ---------------------
>
> Key: HBASE-11927
> URL: https://issues.apache.org/jira/browse/HBASE-11927
> Project: HBase
> Issue Type: Bug
> Reporter: stack
> Assignee: stack
> Fix For: 0.99.1
>
> Attachments: c2021.crc2.svg, c2021.write.2.svg, c2021.zip.svg,
> crc32ct.svg
>
>
> Up in hadoop they have this change. Let me publish some graphs to show that
> it makes a difference (CRC is a massive amount of our CPU usage in my
> profiling of an upload because of compacting, flushing, etc.). We should
> also make use of native CRCings -- especially the 2.6 HDFS-6865 and ilk -- in
> hbase but that is another issue for now.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
