[ 
https://issues.apache.org/jira/browse/HADOOP-7443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Todd Lipcon updated HADOOP-7443:
--------------------------------

    Attachment: hadoop-7443.txt

Fairly simple patch which adds the new CRC algorithm. The tables are taken from 
some Intel sample code under the BSD license, as attributed in the LICENSE file 
in this diff.

> Add CRC32C as another DataChecksum implementation
> -------------------------------------------------
>
>                 Key: HADOOP-7443
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7443
>             Project: Hadoop Common
>          Issue Type: New Feature
>          Components: io, util
>            Reporter: Todd Lipcon
>            Assignee: Todd Lipcon
>         Attachments: hadoop-7443.txt
>
>
> CRC32C is another checksum very similar to our existing CRC32, but with a 
> different polynomial. The chief advantage of this other polynomial is that 
> SSE4.2 includes hardware support for its calculation. HDFS-2080 is the 
> umbrella JIRA which proposes using this new polynomial to save substantial 
> amounts of CPU.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to