[
https://issues.apache.org/jira/browse/HADOOP-1086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12479434
]
Hairong Kuang commented on HADOOP-1086:
---------------------------------------
I checked the source code and I feel that dfs handles the file/dir rename
correctly.
What was the command that caused the error? Did the command get issued more
than once?
> spurious data corruption detected because bad crc file
> ------------------------------------------------------
>
> Key: HADOOP-1086
> URL: https://issues.apache.org/jira/browse/HADOOP-1086
> Project: Hadoop
> Issue Type: Bug
> Components: dfs
> Affects Versions: 0.10.1
> Reporter: dhruba borthakur
> Assigned To: dhruba borthakur
>
> A bunch of files were moved from one directory to another but their crc
> files did not get moved appropriately. Following this move, an application
> tries to access these files but gets a crc error. Here is a snippet from the
> namenode logs:
> unprotectedRenameTo: failed to rename /user/xxx/foo-fix/.254.crc to
> /user/xxx/foo/.254.crc because destination exists
> unprotectedRenameTo: failed to rename /user/xxx/foo-fix/.255.crc to
> /user/xxx/foo/.255.crc because destination exists
> unprotectedRenameTo: failed to rename /user/xxx/foo-fix/.256.crc to
> /user/xxx/foo/.256.crc because destination exists
> unprotectedRenameTo: failed to rename /user/xxx/foo-fix/.257.crc to
> /user/xxx/foo/.257.crc because destination exists
> unprotectedRenameTo: failed to rename /user/xxx/foo-fix/.262.crc to
> /user/xxx/foo/.262.crc because destination exists
> unprotectedRenameTo: failed to rename /user/xxx/foo-fix/.265.crc to
> /user/xxx/foo/.265.crc because destination exists
> unprotectedRenameTo: failed to rename /user/xxx/foo-fix/.268.crc to
> /user/xxx/foo/.268.crc because destination exists
> unprotectedRenameTo: failed to rename /user/xxx/foo-fix/.270.crc to
> /user/xxx/foo/.270.crc because destination exists
> unprotectedRenameTo: failed to rename /user/xxx/foo-fix/.271.crc to
> /user/xxx/foo/.271.crc because destination exists
> unprotectedRenameTo: failed to rename /user/xxx/foo-fix/.274.crc to
> /user/xxx/foo/.274.crc because destination exists
> unprotectedRenameTo: failed to rename /user/xxx/foo-fix/275 to
> /user/xxx/foo/275 because destination exists
> unprotectedRenameTo: failed to rename /user/xxx/foo-fix/276 to
> /user/xxx/foo/276 because destination exists
> unprotectedRenameTo: failed to rename /user/xxx/foo-fix/277 to
> /user/xxx/foo/277 because destination exists
> unprotectedRenameTo: failed to rename /user/xxx/foo-fix/278 to
> /user/xxx/foo/278 because destination exists
> unprotectedRenameTo: failed to rename /user/xxx/foo-fix/279 to
> /user/xxx/foo/279 because destination exists
> unprotectedRenameTo: failed to rename /user/xxx/foo-fix/280 to
> /user/xxx/foo/280 because destination exists
> unprotectedRenameTo: failed to rename /user/xxx/foo-fix/281 to
> /user/xxx/foo/281 because destination exists
> unprotectedRenameTo: failed to rename /user/xxx/foo-fix/282 to
> /user/xxx/foo/282 because destination exists
> unprotectedRenameTo: failed to rename /user/xxx/foo-fix/283 to
> /user/xxx/foo/283 because destination exists
> unprotectedRenameTo: failed to rename /user/xxx/foo-fix/284 to
> /user/xxx/foo/284 because destination exists
> unprotectedRenameTo: failed to rename /user/xxx/foo-fix/285 to
> /user/xxx/foo/285 because destination exists
> unprotectedRenameTo: failed to rename /user/xxx/foo-fix/286 to
> /user/xxx/foo/286 because destination exists
> unprotectedRenameTo: failed to rename /user/xxx/foo-fix/287 to
> /user/xxx/foo/287 because destination exists
> unprotectedDelete: failed to remove /hadoop/mapred/kry2/system/.job_2745.crc
> because it does not exist
> unprotectedDelete: failed to remove /hadoop/mapred/kry2/system/job_2745
> because it does not exist
> unprotectedRenameTo: failed to rename /user/xxx/foo-fix/288 to
> /user/xxx/foo/288 because destination exists
> unprotectedRenameTo: failed to rename /user/xxx/foo-fix/289 to
> /user/xxx/foo/289 because destination exists
> unprotectedRenameTo: failed to rename /user/xxx/foo-fix/290 to
> /user/xxx/foo/290 because destination exists
> unprotectedRenameTo: failed to rename /user/xxx/foo-fix/291 to
> /user/xxx/foo/291 because destination exists
> unprotectedRenameTo: failed to rename /user/xxx/foo-fix/292 to
> /user/xxx/foo/292 because destination exists
> unprotectedRenameTo: failed to rename /user/xxx/foo-fix/293 to
> /user/xxx/foo/293 because destination exists
> unprotectedRenameTo: failed to rename /user/xxx/foo-fix/294 to
> /user/xxx/foo/294 because destination exists
> unprotectedRenameTo: failed to rename /user/xxx/foo-fix/295 to
> /user/xxx/foo/295 because destination exists
> unprotectedRenameTo: failed to rename /user/xxx/foo-fix/296 to
> /user/xxx/foo/296 because destination exists
> unprotectedRenameTo: failed to rename /user/xxx/foo-fix/297 to
> /user/xxx/foo/297 because destination exists
> unprotectedRenameTo: failed to rename /user/xxx/foo-fix/298 to
> /user/xxx/foo/298 because destination exists
> unprotectedRenameTo: failed to rename /user/xxx/foo-fix/299 to
> /user/xxx/foo/299 because destination exists
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
