[ https://issues.apache.org/jira/browse/HADOOP-4305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amareshwari Sriramadasu updated HADOOP-4305: -------------------------------------------- Attachment: patch-4305-4.txt Added junit testcase to test the blacklisting strategy. test-patch result: {noformat} [exec] +1 overall. [exec] [exec] +1 @author. The patch does not contain any @author tags. [exec] [exec] +1 tests included. The patch appears to include 7 new or modified tests. [exec] [exec] +1 javadoc. The javadoc tool did not generate any warning messages. [exec] [exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings. [exec] [exec] +1 findbugs. The patch does not introduce any new Findbugs warnings. [exec] [exec] +1 Eclipse classpath. The patch retains Eclipse classpath integrity. {noformat} > repeatedly blacklisted tasktrackers should get declared dead > ------------------------------------------------------------ > > Key: HADOOP-4305 > URL: https://issues.apache.org/jira/browse/HADOOP-4305 > Project: Hadoop Core > Issue Type: Improvement > Components: mapred > Reporter: Christian Kunz > Assignee: Amareshwari Sriramadasu > Fix For: 0.20.0 > > Attachments: patch-4305-0.18.txt, patch-4305-1.txt, patch-4305-2.txt, > patch-4305-3.txt, patch-4305-4.txt > > > When running a batch of jobs it often happens that the same tasktrackers are > blacklisted again and again. This can slow job execution considerably, in > particular, when tasks fail because of timeout. > It would make sense to no longer assign any tasks to such tasktrackers and to > declare them dead. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.