[
https://issues.apache.org/jira/browse/HDFS-3528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14114622#comment-14114622
]
James Thomas commented on HDFS-3528:
------------------------------------
Yep, think so -- for both ByteBuffers and byte arrays we both compute and
verify checksums natively if possible. That's HADOOP-10838, HADOOP-10975, and
HDFS-6865.
> Use native CRC32 in DFS write path
> ----------------------------------
>
> Key: HDFS-3528
> URL: https://issues.apache.org/jira/browse/HDFS-3528
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: datanode, hdfs-client, performance
> Affects Versions: 2.0.0-alpha
> Reporter: Todd Lipcon
> Assignee: James Thomas
>
> HDFS-2080 improved the CPU efficiency of the read path by using native
> SSE-enabled code for CRC verification. Benchmarks of the write path show that
> it's often CPU bound by checksums as well, so we should make the same
> improvement there.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
