[
https://issues.apache.org/jira/browse/HADOOP-15033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16249865#comment-16249865
]
Ravi Prakash commented on HADOOP-15033:
---------------------------------------
Hi Dmitry! Thank you for running the tests. I'm sorry I'm not too familiar with
this area. Do you know if the results for the checksum were the same? I
remember there were some inconsistencies between Hadoop's implementation of
CRC32C and the system libraries. If that were to happen, on an upgrade
perfectly good blocks may be marked as corrupt. Have you taken a look at
https://issues.apache.org/jira/browse/HDFS-3528 ?
> Use java.util.zip.CRC32C for Java 9 and above
> ---------------------------------------------
>
> Key: HADOOP-15033
> URL: https://issues.apache.org/jira/browse/HADOOP-15033
> Project: Hadoop Common
> Issue Type: Improvement
> Components: performance, util
> Affects Versions: 3.0.0
> Reporter: Dmitry Chuyko
>
> java.util.zip.CRC32C implementation is available since Java 9.
> https://docs.oracle.com/javase/9/docs/api/java/util/zip/CRC32C.html
> Platform specific assembler intrinsics make it more effective than any pure
> Java implementation.
> Hadoop is compiled against Java 8 but class constructor may be accessible
> with method handle on 9 to instances implementing Checksum in runtime.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
