[
https://issues.apache.org/jira/browse/HDFS-2777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13190116#comment-13190116
]
Jonathan Eagles commented on HDFS-2777:
---------------------------------------
Seems like the temp file use for the target is created using the
CheckSumFileSystem(via RawLocalFileSystem) which unconditionally creates a crc
file at the destination.
CommandWithDestination.java (copyStreamToTarget)
FSDataOutputStream out = target.fs.getLocal().create(tempFile.path, true);
Not sure if this is a systemic problem of the RawLocalFileSystem or not.
> When copying a file out of HDFS, modifying it, and uploading it back into
> HDFS, the put fails due to a CRC mismatch
> -------------------------------------------------------------------------------------------------------------------
>
> Key: HDFS-2777
> URL: https://issues.apache.org/jira/browse/HDFS-2777
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: hdfs client
> Affects Versions: 0.23.1
> Environment: KR at Yahoo
> Reporter: Kevin J. Price
> Priority: Critical
> Fix For: 0.23.1
>
>
> Performing an hdfs -get on a file, modifying the file, and using hdfs -put to
> place the file back into HDFS results in a checksum error. It seems that the
> problem is a .crc file being generated locally from the -get command even
> though the -crc option was NOT specified.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira