[
https://issues.apache.org/jira/browse/HDFS-3528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
James Thomas updated HDFS-3528:
-------------------------------
Attachment: HDFS-3528.patch
Preliminary work, no performance testing done yet. We avoid rewriting code to
use ByteBuffers by using the GetPrimitiveArrayCritical method to access byte
arrays without copying if possible.
> Use native CRC32 in DFS write path
> ----------------------------------
>
> Key: HDFS-3528
> URL: https://issues.apache.org/jira/browse/HDFS-3528
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: datanode, hdfs-client, performance
> Affects Versions: 2.0.0-alpha
> Reporter: Todd Lipcon
> Assignee: Todd Lipcon
> Attachments: HDFS-3528.patch
>
>
> HDFS-2080 improved the CPU efficiency of the read path by using native
> SSE-enabled code for CRC verification. Benchmarks of the write path show that
> it's often CPU bound by checksums as well, so we should make the same
> improvement there.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
