When I run the agent like this:
./slider create cl1 --image
hdfs://yourNameNodeHost:8020/user/yarn/agent/slider-agent.tar.gz
--template appConfig.json --resources resources.json
The application is accepted by YARN but failed. Anyone know it??
The error info in the YARN RM UI is :
Application application_1410335027910_0001 failed 2 times due to AM
Container for appattempt_1410335027910_0001_000002 exited with exitCode: 32
due to: Exception from container-launch: ExitCodeException exitCode=32:
ExitCodeException exitCode=32:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
at org.apache.hadoop.util.Shell.run(Shell.java:455)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:702)
at
org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:300)
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:81)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
Container exited with a non-zero exit code 32
.Failing this attempt.. Failing the application.
Then I go inside the container and get the error info as below:
14/09/11 19:15:45 INFO service.AbstractService: Service python failed in
state STARTED; cause: org.apache.slider.core.main.ServiceLaunchException:
python failed with code 2
org.apache.slider.core.main.ServiceLaunchException: python failed with code
2
at
org.apache.slider.server.services.workflow.ForkedProcessService.reportFailure(ForkedProcessService.java:202)
at
org.apache.slider.server.services.workflow.ForkedProcessService.onProcessExited(ForkedProcessService.java:192)
at
org.apache.slider.server.services.workflow.LongLivedProcess.run(LongLivedProcess.java:345)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
at
java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
14/09/11 19:15:45 WARN tools.SliderUtils: Expected exit code={0}, actual
exit code={2}
14/09/11 19:15:45 INFO tools.SliderUtils: [ERR]
14/09/11 19:15:45 INFO tools.SliderUtils: [ERR] Unknown option: --
14/09/11 19:15:45 INFO tools.SliderUtils: [ERR] usage: python [option] ...
[-c cmd | -m mod | file | -] [arg] ...
14/09/11 19:15:45 INFO tools.SliderUtils: [ERR] Try `python -h' for more
information.
14/09/11 19:15:45 INFO tools.SliderUtils: [OUT]
14/09/11 19:15:45 INFO service.AbstractService: Service SliderAppMaster
failed in state INITED; cause:
org.apache.slider.core.exceptions.SliderException: Process python failed:
Expected exit code={0}, actual exit code={2}
org.apache.slider.core.exceptions.SliderException: Process python failed:
Expected exit code={0}, actual exit code={2}
at
org.apache.slider.common.tools.SliderUtils.execCommand(SliderUtils.java:1744)
at
org.apache.slider.common.tools.SliderUtils.validateSliderServerEnvironment(SliderUtils.java:1777)
at
org.apache.slider.server.appmaster.SliderAppMaster.serviceInit(SliderAppMaster.java:405)
at
org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at
org.apache.slider.core.main.ServiceLauncher.launchService(ServiceLauncher.java:180)
at
org.apache.slider.core.main.ServiceLauncher.launchServiceRobustly(ServiceLauncher.java:471)
at
org.apache.slider.core.main.ServiceLauncher.launchServiceAndExit(ServiceLauncher.java:401)
at
org.apache.slider.core.main.ServiceLauncher.serviceMain(ServiceLauncher.java:626)
at
org.apache.slider.server.appmaster.SliderAppMaster.main(SliderAppMaster.java:1897)
Exception: org.apache.slider.core.exceptions.SliderException: Process
python failed: Expected exit code={0}, actual exit code={2}
14/09/11 19:15:45 ERROR main.ServiceLauncher: Exception:
org.apache.slider.core.exceptions.SliderException: Process python failed:
Expected exit code={0}, actual exit code={2}
org.apache.hadoop.service.ServiceStateException:
org.apache.slider.core.exceptions.SliderException: Process python failed:
Expected exit code={0}, actual exit code={2}
at
org.apache.hadoop.service.ServiceStateException.convert(ServiceStateException.java:59)
at
org.apache.hadoop.service.AbstractService.init(AbstractService.java:172)
at
org.apache.slider.core.main.ServiceLauncher.launchService(ServiceLauncher.java:180)
at
org.apache.slider.core.main.ServiceLauncher.launchServiceRobustly(ServiceLauncher.java:471)
at
org.apache.slider.core.main.ServiceLauncher.launchServiceAndExit(ServiceLauncher.java:401)
at
org.apache.slider.core.main.ServiceLauncher.serviceMain(ServiceLauncher.java:626)
at
org.apache.slider.server.appmaster.SliderAppMaster.main(SliderAppMaster.java:1897)
Caused by: org.apache.slider.core.exceptions.SliderException: Process
python failed: Expected exit code={0}, actual exit code={2}
at
org.apache.slider.common.tools.SliderUtils.execCommand(SliderUtils.java:1744)
at
org.apache.slider.common.tools.SliderUtils.validateSliderServerEnvironment(SliderUtils.java:1777)
at
org.apache.slider.server.appmaster.SliderAppMaster.serviceInit(SliderAppMaster.java:405)
at
org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
... 5 more
14/09/11 19:15:45 INFO util.ExitUtil: Exiting with status 32
--
*Regards,*
*Zhaojie*
