[
https://issues.apache.org/jira/browse/HDDS-11969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Krishna Kumar Asawa reassigned HDDS-11969:
------------------------------------------
Assignee: Sadanand Shenoy
> getFilechecksum() API fails if checksum type is NONE
> ----------------------------------------------------
>
> Key: HDDS-11969
> URL: https://issues.apache.org/jira/browse/HDDS-11969
> Project: Apache Ozone
> Issue Type: Bug
> Reporter: Wei-Chiu Chuang
> Assignee: Sadanand Shenoy
> Priority: Major
>
> Running distcp command fails:
> hadoop distcp ofs://ozone1731442115/vol1/bucket1/ hdfs://ns1/tmp/
> because getFilechecksum() API fails if checksum type is NONE.
> Expected result: getFilechecksum() should return null so that applications
> can skip the checksum check.
> {noformat}
> Caused by: java.lang.IllegalArgumentException: unsupported checksum type: NONE
> at
> org.apache.hadoop.ozone.client.checksum.ReplicatedBlockChecksumComputer.computeCompositeCrc(ReplicatedBlockChecksumComputer.java:110)
> at
> org.apache.hadoop.ozone.client.checksum.ReplicatedBlockChecksumComputer.compute(ReplicatedBlockChecksumComputer.java:64)
> at
> org.apache.hadoop.ozone.client.checksum.ReplicatedFileChecksumHelper.getBlockChecksumFromChunkChecksums(ReplicatedFileChecksumHelper.java:174)
> at
> org.apache.hadoop.ozone.client.checksum.ReplicatedFileChecksumHelper.checksumBlock(ReplicatedFileChecksumHelper.java:113)
> at
> org.apache.hadoop.ozone.client.checksum.ReplicatedFileChecksumHelper.checksumBlocks(ReplicatedFileChecksumHelper.java:77)
> at
> org.apache.hadoop.ozone.client.checksum.BaseFileChecksumHelper.compute(BaseFileChecksumHelper.java:217)
> at
> org.apache.hadoop.fs.ozone.OzoneClientUtils.getFileChecksumWithCombineMode(OzoneClientUtils.java:240)
> at
> org.apache.hadoop.fs.ozone.BasicRootedOzoneClientAdapterImpl.getFileChecksum(BasicRootedOzoneClientAdapterImpl.java:1258)
> at
> org.apache.hadoop.fs.ozone.BasicRootedOzoneFileSystem.lambda$getFileChecksum$12(BasicRootedOzoneFileSystem.java:1134)
> at
> org.apache.hadoop.hdds.tracing.TracingUtil.executeInSpan(TracingUtil.java:169)
> at
> org.apache.hadoop.hdds.tracing.TracingUtil.executeInNewSpan(TracingUtil.java:159)
> at
> org.apache.hadoop.fs.ozone.BasicRootedOzoneFileSystem.getFileChecksum(BasicRootedOzoneFileSystem.java:1133)
> at
> org.apache.hadoop.tools.util.DistCpUtils.checksumsAreEqual(DistCpUtils.java:583)
> at
> org.apache.hadoop.tools.util.DistCpUtils.compareFileLengthsAndChecksums(DistCpUtils.java:627)
> at
> org.apache.hadoop.tools.mapred.RetriableFileCopyCommand.doCopy(RetriableFileCopyCommand.java:151)
> at
> org.apache.hadoop.tools.mapred.RetriableFileCopyCommand.doExecute(RetriableFileCopyCommand.java:119)
> at
> org.apache.hadoop.tools.util.RetriableCommand.execute(RetriableCommand.java:87)
> {noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
