----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27348/#review59055 -----------------------------------------------------------
Ship it! Ship It! - Sumit Mohanty On Oct. 29, 2014, 9:50 p.m., Alejandro Fernandez wrote: > > ----------------------------------------------------------- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/27348/ > ----------------------------------------------------------- > > (Updated Oct. 29, 2014, 9:50 p.m.) > > > Review request for Ambari, Dmytro Sen, Mahadev Konar, Nate Cole, Sumit > Mohanty, Srimanth Gunturi, Sid Wagle, and Vinod Kumar Vavilapalli. > > > Bugs: AMBARI-8028 > https://issues.apache.org/jira/browse/AMBARI-8028 > > > Repository: ambari > > > Description > ------- > > After adding hdp.version in yarn-site.xml Distributed Shell is failing > ``` > /usr/hdp/current/hadoop-yarn-client/bin/yarn > org.apache.hadoop.yarn.applications.distributedshell.Client -jar > /usr/hdp/current/hadoop-yarn-client/hadoop-yarn-applications-distributedshell.jar > -shell_command pwd > ``` > > Failing with classpath issue: > ``` > Diagnostics: Exception from container-launch. > Container id: container_1414595622703_0039_02_000001 > Exit code: 1 > Exception message: > /grid/1/yarn/local/usercache/hrt_qa/appcache/application_1414595622703_0039/container_1414595622703_0039_02_000001/launch_container.sh: > line 9: > $CLASSPATH:./*:$HADOOP_CONF_DIR:/usr/hdp/${hdp.version}/hadoop-client/*:/usr/hdp/${hdp.version}/hadoop-client/lib/*:/usr/hdp/${hdp.version}/hadoop-hdfs-client/*:/usr/hdp/${hdp.version}/hadoop-hdfs-client/lib/*:/usr/hdp/${hdp.version}/hadoop-yarn-client/*:/usr/hdp/${hdp.version}/hadoop-yarn-client/lib/*:./log4j.properties: > bad substitution > > Stack trace: ExitCodeException exitCode=1: > /grid/1/yarn/local/usercache/hrt_qa/appcache/application_1414595622703_0039/container_1414595622703_0039_02_000001/launch_container.sh: > line 9: > $CLASSPATH:./*:$HADOOP_CONF_DIR:/usr/hdp/${hdp.version}/hadoop-client/*:/usr/hdp/${hdp.version}/hadoop-client/lib/*:/usr/hdp/${hdp.version}/hadoop-hdfs-client/*:/usr/hdp/${hdp.version}/hadoop-hdfs-client/lib/*:/usr/hdp/${hdp.version}/hadoop-yarn-client/*:/usr/hdp/${hdp.version}/hadoop-yarn-client/lib/*:./log4j.properties: > bad substitution > > at org.apache.hadoop.util.Shell.runCommand(Shell.java:538) > at org.apache.hadoop.util.Shell.run(Shell.java:455) > at > org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715) > at > org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:206) > at > org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:301) > at > org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:81) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:745) > > > Container exited with a non-zero exit code 1 > > ``` > Though in secure this not reported as front-end error, AM logs show > classpath issue there also > ``` > Container: container_1414601160300_0005_01_000001 on > karam-tez-sec-exp1-3.cs1cloud.internal_45454 > =================================================================================================== > LogType: AppMaster.stderr > LogUploadTime: 29-Oct-2014 16:51:42 > LogLength: 996 > Log Contents: > Exception in thread "main" java.lang.NoClassDefFoundError: > org/apache/hadoop/yarn/exceptions/YarnException > at java.lang.Class.getDeclaredMethods0(Native Method) > at java.lang.Class.privateGetDeclaredMethods(Class.java:2570) > at java.lang.Class.getMethod0(Class.java:2813) > at java.lang.Class.getMethod(Class.java:1663) > at sun.launcher.LauncherHelper.getMainMethod(LauncherHelper.java:494) > at > sun.launcher.LauncherHelper.checkAndLoadMain(LauncherHelper.java:486) > Caused by: java.lang.ClassNotFoundException: > org.apache.hadoop.yarn.exceptions.YarnException > at java.net.URLClassLoader$1.run(URLClassLoader.java:366) > at java.net.URLClassLoader$1.run(URLClassLoader.java:355) > ``` > > > Diffs > ----- > > > ambari-server/src/main/resources/stacks/HDP/2.2/services/YARN/configuration/yarn-site.xml > defdbb5 > > Diff: https://reviews.apache.org/r/27348/diff/ > > > Testing > ------- > > Made the property change on an HDP 2.2 cluster (single node), restarted YARN, > MR, HIVE, OOZIE, ZOOKEEPER, and then ran a service check for the same items, > all of which passed. > > mvn clean test > [INFO] BUILD SUCCESS > [INFO] > ------------------------------------------------------------------------ > [INFO] Total time: 24:41.350s > [INFO] Finished at: Wed Oct 29 14:09:52 PDT 2014 > [INFO] Final Memory: 65M/1041M > [INFO] > ------------------------------------------------------------------------ > > > Thanks, > > Alejandro Fernandez > >
