Force the task tracker to exit when the task is complete, prevents nodes from
dying due to resource starvation from impropertly written map/reduce tasks
--------------------------------------------------------------------------------------------------------------------------------------------------------
Key: HADOOP-2708
URL: https://issues.apache.org/jira/browse/HADOOP-2708
Project: Hadoop Core
Issue Type: Improvement
Components: mapred
Affects Versions: 0.15.2
Reporter: Jason
Priority: Minor
Fix For: 0.15.3
We have map/reduce jobs that sometimes run additional threads that are not at
daemon priority, and these threads prevent the Task from properly exiting. When
enough of these accumulate, the node falls over.
The included patch forces the Tasks to exit when completed.
Index: src/java/org/apache/hadoop/mapred/TaskTracker.java
===================================================================
--- src/java/org/apache/hadoop/mapred/TaskTracker.java (revision 608611)
+++ src/java/org/apache/hadoop/mapred/TaskTracker.java (working copy)
@@ -1801,6 +1801,8 @@
// This assumes that on return from Task.run()
// there is no more logging done.
LogManager.shutdown();
+
+ System.exit(0);
}
}
}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
