Set mapred.child.ulimit automatically to the value of the RAM limits for a job,
if they are set
-----------------------------------------------------------------------------------------------
Key: HADOOP-6033
URL: https://issues.apache.org/jira/browse/HADOOP-6033
Project: Hadoop Core
Issue Type: Bug
Components: mapred
Affects Versions: 0.20.1
Reporter: Hemanth Yamijala
Memory based monitoring and scheduling allow users to set memory limits for the
tasks of their jobs. This parameter is the total memory taken by the task, and
any children it may launch (for e.g. in the case of streaming). A related
parameter is mapred.child.ulimit which is a hard limit on the memory used by a
single process of the entire task tree. For user convenience, it would be
sensible for the system to set the ulimit to atleast the memory required by the
task, if the user has specified the latter.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
