[
https://issues.apache.org/jira/browse/HADOOP-1491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12689228#action_12689228
]
Hudson commented on HADOOP-1491:
--------------------------------
Integrated in Hadoop-trunk #790 (See
[http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/790/])
. In contrib/index, better control memory usage. Contributed by Ning Li.
> After successful distcp, couple of checksum error files
> -------------------------------------------------------
>
> Key: HADOOP-1491
> URL: https://issues.apache.org/jira/browse/HADOOP-1491
> Project: Hadoop Core
> Issue Type: Bug
> Components: util
> Affects Versions: 0.12.3
> Reporter: Koji Noguchi
> Assignee: dhruba borthakur
> Attachments: mapper1.txt, mapper2.txt
>
>
> Tried copying 700,000 files with distcp. 8 mappers per node. Single
> dfs.client.buffer.dir.
> Distcp ran on 25 nodes mapreduce.
> Couple of tasks failed, but job was successful.
> When checked, 12 files were corrupted. (Checksum error)
> This is repeatable.
> I'll add more information as we find.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
