[ http://issues.apache.org/jira/browse/HADOOP-552?page=all ]
Owen O'Malley updated HADOOP-552:
---------------------------------
Status: Patch Available (was: Open)
> getMapOutput doesn't reliably detect errors and throw to the caller
> -------------------------------------------------------------------
>
> Key: HADOOP-552
> URL: http://issues.apache.org/jira/browse/HADOOP-552
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.6.2
> Reporter: Owen O'Malley
> Assigned To: Owen O'Malley
> Fix For: 0.7.0
>
> Attachments: size-check.patch
>
>
> getMapOutput does not reliabily detect errors in transmission, which usually
> ends up with an EOFException in the reduce's sort:
> java.io.EOFException
> at java.io.DataInputStream.readFully(DataInputStream.java:178)
> at java.io.DataInputStream.readFully(DataInputStream.java:152)
> at org.apache.hadoop.io.SequenceFile$Reader.init(SequenceFile.java:952)
> at org.apache.hadoop.io.SequenceFile$Reader.(SequenceFile.java:937)
> at org.apache.hadoop.io.SequenceFile$Reader.(SequenceFile.java:928)
> at
> org.apache.hadoop.io.SequenceFile$Sorter$SortPass.run(SequenceFile.java:1594)
> at
> org.apache.hadoop.io.SequenceFile$Sorter.sortPass(SequenceFile.java:1523)
> at org.apache.hadoop.io.SequenceFile$Sorter.sort(SequenceFile.java:1496)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:240)
> at
> org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1173)
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
