hi, all I am trying to configuring Cgroup and Docker runtime on Hadoop-3.0.0-alpha2. Based on the documentation, LinuxContainerExecutor is required. However, I do not want to set up a secure cluster. So, Is any way to bypass this?
I also noticed that Cgroup doesn't need a secured cluster. However, after configuring * <property>* * <name>yarn.nodemanager.container-executor.class</name>* * <value>org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor</value>* * </property>* * <property>* * <name>yarn.nodemanager.linux-container-executor.resources-handler.class</name>* * <value>org.apache.hadoop.yarn.server.nodemanager.util.DefaultLCEResourcesHandler</value>* * </property>* I would have this errors: *2017-05-16 19:23:01,856 FATAL org.apache.hadoop.yarn.server.nodemanager.NodeManager: Error starting NodeManager* *org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to initialize container executor* * at org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceInit(NodeManager.java:316)* * at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)* * at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:735)* * at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:796)* *Caused by: java.io.IOException: Linux container executor not configured properly (error=24)* * at org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor.init(LinuxContainerExecutor.java:244)* * at org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceInit(NodeManager.java:314)* * ... 3 more* *Caused by: org.apache.hadoop.yarn.server.nodemanager.containermanager.linux.privileged.PrivilegedOperationException: ExitCodeException exitCode=24: File /home/cwei/project/hadoop-3.0.0-alpha2/etc/hadoop/container-executor.cfg must be owned by root, but is owned by 1001* * at org.apache.hadoop.yarn.server.nodemanager.containermanager.linux.privileged.PrivilegedOperationExecutor.executePrivilegedOperation(PrivilegedOperationExecutor.java:179)* * at org.apache.hadoop.yarn.server.nodemanager.containermanager.linux.privileged.PrivilegedOperationExecutor.executePrivilegedOperation(PrivilegedOperationExecutor.java:205)* * at org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor.init(LinuxContainerExecutor.java:237)* * ... 4 more* *Caused by: ExitCodeException exitCode=24: File /home/cwei/project/hadoop-3.0.0-alpha2/etc/hadoop/container-executor.cfg must be owned by root, but is owned by 1001* * at org.apache.hadoop.util.Shell.runCommand(Shell.java:981)* * at org.apache.hadoop.util.Shell.run(Shell.java:884)* * at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1180)* * at org.apache.hadoop.yarn.server.nodemanager.containermanager.linux.privileged.PrivilegedOperationExecutor.executePrivilegedOperation(PrivilegedOperationExecutor.java:151)* * ... 6 more* Anyone could help me solve this? PS. After checking the source code, I found the Nodemanager will call *privilegedOperationExecutor.executePrivilegedOperation(checkSetupOp,* * false)* and finally call* contaienr-executor* under HADOOP_HOME/bin folder. So I directly execute ./bin/contaienr-executor will also report this error, which does not make much sense for me. Best, appreciate any help. Wei
