[
https://issues.apache.org/jira/browse/MAPREDUCE-257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12730549#action_12730549
]
dhruba borthakur commented on MAPREDUCE-257:
--------------------------------------------
This can also be a problem when the map task itself forks off some external
script. The external script might consume lots of memory and might not get
killed even if the TaskTrackerChild is killed. I wish there was the concept of
process-groups in Java so that when u kill the leader, all the process in the
process group is killed by the OS.
> Preventing node from swapping
> -----------------------------
>
> Key: MAPREDUCE-257
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-257
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Reporter: Hong Tang
>
> When a node swaps, it slows everything: maps running on that node, reducers
> fetching output from the node, and DFS clients reading from the DN. We should
> just treat it the same way as if OS exhausts memory and kill some tasks to
> free up memory.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
