Anubhav Dhoot created YARN-4030: ----------------------------------- Summary: Make Nodemanager cgroup usage for container easier to use when its running inside a cgroup Key: YARN-4030 URL: https://issues.apache.org/jira/browse/YARN-4030 Project: Hadoop YARN Issue Type: Improvement Components: nodemanager Reporter: Anubhav Dhoot Assignee: Anubhav Dhoot
Today nodemanager uses the cgroup prefix pointed by yarn.nodemanager.linux-container-executor.cgroups.hierarchy (default value /hadoop-yarn) directly at the path of the controller say /sys/fs/cgroup/cpu/hadoop-yarn. If there are nodemanagers running inside docker containers on a host, each would typically be separated by a cgroup under the controller path say /sys/fs/cgroup/cpu/docker/<dockerid1>/nmcgroup for NM1 and /sys/fs/cgroup/cpu/docker/<dockerid2>/nmcgroup for NM2. In this case the correct behavior should be to use the docker cgroup paths as /sys/fs/cgroup/cpu/docker/<dockerid1>/hadoop-yarn for NM1 /sys/fs/cgroup/cpu/docker/<dockerid2>/hadoop-yarn for NM2. But the default behavior would make both NMs try to use /sys/fs/cgroup/cpu/hadoop-yarn which is incorrect and would usually fail based on the permissions setup. -- This message was sent by Atlassian JIRA (v6.3.4#6332)