[
https://issues.apache.org/jira/browse/HADOOP-680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Owen O'Malley resolved HADOOP-680.
----------------------------------
Resolution: Cannot Reproduce
The crc code is now inlined in the map outputs.
> checksum errors reading map output
> ----------------------------------
>
> Key: HADOOP-680
> URL: https://issues.apache.org/jira/browse/HADOOP-680
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Reporter: Yoram Arnon
> Assignee: Owen O'Malley
>
> we get many exceptions complaining about crc errors reading map output by
> reducers:
> org.apache.hadoop.fs.ChecksumException: Checksum error:
> /hadoop/mapred/local/task_0189_r_000448_3/map_9683.out at 978944
> at
> org.apache.hadoop.fs.FSDataInputStream$Checker.verifySum(FSDataInputStream.java:136)
> at
> org.apache.hadoop.fs.FSDataInputStream$Checker.read(FSDataInputStream.java:112)
> at
> org.apache.hadoop.fs.FSDataInputStream$PositionCache.read(FSDataInputStream.java:187)
> at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
> at java.io.BufferedInputStream.read1(BufferedInputStream.java:256)
> at java.io.BufferedInputStream.read(BufferedInputStream.java:313)
> at java.io.DataInputStream.readFully(DataInputStream.java:176)
> at java.io.DataInputStream.readFully(DataInputStream.java:152)
> at
> org.apache.hadoop.io.SequenceFile$UncompressedBytes.reset(SequenceFile.java:274)
> at
> org.apache.hadoop.io.SequenceFile$UncompressedBytes.access$700(SequenceFile.java:261)
> at
> org.apache.hadoop.io.SequenceFile$Reader.nextRaw(SequenceFile.java:1338)
> at
> org.apache.hadoop.io.SequenceFile$Sorter$SortPass.run(SequenceFile.java:1600)
> at
> org.apache.hadoop.io.SequenceFile$Sorter.sortPass(SequenceFile.java:1538)
> at org.apache.hadoop.io.SequenceFile$Sorter.sort(SequenceFile.java:1511)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:245)
> at
> org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1210)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
