[
https://issues.apache.org/jira/browse/MYRIAD-176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhongyue Luo updated MYRIAD-176:
--------------------------------
Description:
Below is the stdout log from one of my node managers.
sudo tar -zxpf hadoop-2.5.0-cdh5.3.1.tar.gz && sudo chown yarn . && cp conf
hadoop-2.5.0-cdh5.3.1/etc/hadoop/yarn-site.xml; export
YARN_HOME=hadoop-2.5.0-cdh5.3.1; sudo -E -u yarn -H env
JAVA_HOME=/usr/java/default YARN_HOME=hadoop-2.5.0-cdh5.3.1
YARN_NODEMANAGER_OPTS=-Dyarn.nodemanager.container-executor.class=org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor
-Dnodemanager.resource.cpu-vcores=4 -Dnodemanager.resource.memory-mb=4096
-Dmyriad.yarn.nodemanager.address=0.0.0.0:31873
-Dmyriad.yarn.nodemanager.localizer.address=0.0.0.0:31142
-Dmyriad.yarn.nodemanager.webapp.address=0.0.0.0:31765
-Dmyriad.mapreduce.shuffle.port=31515 /bin/yarn nodemanager
at the end of the line, you can see that it is "31515 /bin/yarn nodemanager"
where there are two spaces between '31515' and '/bin'.
This seems to happen due to the java code not recognizing the $YARN_HOME value
in
https://github.com/apache/incubator-myriad/blob/master/myriad-scheduler/src/main/java/org/apache/myriad/scheduler/NMExecutorCLGenImpl.java#L65
causing an additional blank space in front of '/bin'. However all nodemanagers
seem to run just fine despite the attempt to execute yarn on /bin. I've tested
this with vanilla hadoop 2.5.0 and 2.7.0 and CDH 5.3.1 all cases showing same
symptoms.
was:
Below is the stdout log from one of my node managers.
sudo tar -zxpf hadoop-2.5.0-cdh5.3.1.tar.gz && sudo chown yarn . && cp conf
hadoop-2.5.0-cdh5.3.1/etc/hadoop/yarn-site.xml; export
YARN_HOME=hadoop-2.5.0-cdh5.3.1; sudo -E -u yarn -H env
JAVA_HOME=/usr/java/default YARN_HOME=hadoop-2.5.0-cdh5.3.1
YARN_NODEMANAGER_OPTS=-Dyarn.nodemanager.container-executor.class=org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor
-Dnodemanager.resource.cpu-vcores=4 -Dnodemanager.resource.memory-mb=4096
-Dmyriad.yarn.nodemanager.address=0.0.0.0:31873
-Dmyriad.yarn.nodemanager.localizer.address=0.0.0.0:31142
-Dmyriad.yarn.nodemanager.webapp.address=0.0.0.0:31765
-Dmyriad.mapreduce.shuffle.port=31515 /bin/yarn nodemanager
at the end of the line, you can see that it is "31515 /bin/yarn nodemanager"
where there are two spaces between '31515' and '/bin'.
This seems to happen due to the java code not recognizing the $YARN_HOME value
in
https://github.com/apache/incubator-myriad/blob/master/myriad-scheduler/src/main/java/org/apache/myriad/scheduler/NMExecutorCLGenImpl.java#L65
causing an additional blank space in front of '/bin'. However all nodemanagers
despite to run just fine. I've tested this with vanilla hadoop 2.5.0 and 2.7.0
and CDH 5.3.1 all cases showing same symptoms.
> YARN_HOME value ignored in " $YARN_HOME/bin/yarn nodemanager"
> -------------------------------------------------------------
>
> Key: MYRIAD-176
> URL: https://issues.apache.org/jira/browse/MYRIAD-176
> Project: Myriad
> Issue Type: Bug
> Components: Scheduler
> Reporter: Zhongyue Luo
>
> Below is the stdout log from one of my node managers.
> sudo tar -zxpf hadoop-2.5.0-cdh5.3.1.tar.gz && sudo chown yarn . && cp conf
> hadoop-2.5.0-cdh5.3.1/etc/hadoop/yarn-site.xml; export
> YARN_HOME=hadoop-2.5.0-cdh5.3.1; sudo -E -u yarn -H env
> JAVA_HOME=/usr/java/default YARN_HOME=hadoop-2.5.0-cdh5.3.1
> YARN_NODEMANAGER_OPTS=-Dyarn.nodemanager.container-executor.class=org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor
> -Dnodemanager.resource.cpu-vcores=4 -Dnodemanager.resource.memory-mb=4096
> -Dmyriad.yarn.nodemanager.address=0.0.0.0:31873
> -Dmyriad.yarn.nodemanager.localizer.address=0.0.0.0:31142
> -Dmyriad.yarn.nodemanager.webapp.address=0.0.0.0:31765
> -Dmyriad.mapreduce.shuffle.port=31515 /bin/yarn nodemanager
> at the end of the line, you can see that it is "31515 /bin/yarn nodemanager"
> where there are two spaces between '31515' and '/bin'.
> This seems to happen due to the java code not recognizing the $YARN_HOME
> value in
> https://github.com/apache/incubator-myriad/blob/master/myriad-scheduler/src/main/java/org/apache/myriad/scheduler/NMExecutorCLGenImpl.java#L65
> causing an additional blank space in front of '/bin'. However all
> nodemanagers seem to run just fine despite the attempt to execute yarn on
> /bin. I've tested this with vanilla hadoop 2.5.0 and 2.7.0 and CDH 5.3.1 all
> cases showing same symptoms.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
