[ https://issues.apache.org/jira/browse/MAPREDUCE-5?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387686#comment-14387686 ]
Jipeng Tan commented on MAPREDUCE-5: ------------------------------------ Can you let me know which parameter control reducer memory cache limit? > Shuffle's getMapOutput() fails with EofException, followed by > IllegalStateException > ----------------------------------------------------------------------------------- > > Key: MAPREDUCE-5 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-5 > Project: Hadoop Map/Reduce > Issue Type: Bug > Affects Versions: 0.20.2, 1.1.1 > Environment: Sun Java 1.6.0_13, OpenSolaris, running on a SunFire > 4150 (x64) 10 node cluster > Reporter: George Porter > Attachments: temp.rar > > > During the shuffle phase, I'm seeing a large sequence of the following > actions: > 1) WARN org.apache.hadoop.mapred.TaskTracker: > getMapOutput(attempt_200905181452_0002_m_000010_0,0) failed : > org.mortbay.jetty.EofException > 2) WARN org.mortbay.log: Committed before 410 > getMapOutput(attempt_200905181452_0002_m_000010_0,0) failed : > org.mortbay.jetty.EofException > 3) ERROR org.mortbay.log: /mapOutput java.lang.IllegalStateException: > Committed > The map phase completes with 100%, and then the reduce phase crawls along > with the above errors in each of the TaskTracker logs. None of the > tasktrackers get lost. When I run non-data jobs like the 'pi' test from the > example jar, everything works fine. -- This message was sent by Atlassian JIRA (v6.3.4#6332)