The following site has a resolution, thanks. http://raseshmori.wordpress.com/2012/09/23/install-hadoop-2-0-1-yarn-nextgen/ Sitaraman
On Fri, Dec 27, 2013 at 2:46 PM, Sitaraman Vilayannur < [email protected]> wrote: > Hi when i try to start nodemanager with > > ./yarn-daemon.sh start nodemanager > i am getting the following error appended below in the logs and nodemanger > is not starting. This is in version 2.2 > Any help is appreciated on how to resolve this error. Thanks in > anticipation. > Sitaraman > > > ./yarn-daemon.sh start nodemanager > starting nodemanager, logging to > /logs/yarn-sitaraman-nodemanager-localhost.out > Java HotSpot(TM) 64-Bit Server VM warning: You have loaded library > /usr/local/Software/hadoop-2.2.0/lib/native/libhadoop.so.1.0.0 which might > have disabled stack guard. The VM will try to fix the stack guard now. > It's highly recommended that you fix the library with 'execstack -c > <libfile>', or link it with '-z noexecstack'. > [sitaraman@localhost sbin]$ jps > 23598 Jps > 22418 DataNode > 22261 NameNode > 23286 ResourceManager > 22522 SecondaryNameNode > > > -12-27 14:26:52,837 INFO > org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: > per directory file limit = 8192 > 2013-12-27 14:26:52,878 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: > Registering class > org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType > for class > org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker > 2013-12-27 14:26:52,880 FATAL > org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: > Failed to initialize mapreduce.shuffle > java.lang.IllegalArgumentException: The ServiceName: mapreduce.shuffle set > in yarn.nodemanager.aux-services is invalid.The valid service name should > only contain a-zA-Z0-9_ and can not start with numbers > at > com.google.common.base.Preconditions.checkArgument(Preconditions.java:88) > at > org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices.serviceInit(AuxServices.java:98) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) > at > org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:108) > at > org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.serviceInit(ContainerManagerImpl.java:218) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) > at > org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:108) > at > org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceInit(NodeManager.java:188) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) > at > org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:338) > at > org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:386) > 2013-12-27 14:26:52,883 INFO org.apache.hadoop.service.AbstractService: > Service > org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices > failed in state INITED; cause: java.lang.IllegalArgumentException: The > ServiceName: mapreduce.shuffle set in yarn.nodemanager.aux-services is > invalid.The valid service name should only contain a-zA-Z0-9_ and can not > start with numbers > java.lang.IllegalArgumentException: The ServiceName: mapreduce.shuffle set > in yarn.nodemanager.aux-services is invalid.The valid service name should > only contain a-zA-Z0-9_ and can not start with numbers > at > com.google.common.base.Preconditions.checkArgument(Preconditions.java:88) > at > org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices.serviceInit(AuxServices.java:98) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) > at > org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:108) > at > org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.serviceInit(ContainerManagerImpl.java:218) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) > at > org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:108) > at > org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceInit(NodeManager.java:188) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) > at > org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:338) > at > org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:386) > 2013-12-27 14:26:52,885 INFO org.apache.hadoop.service.AbstractService: > Service > org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl > failed in state INITED; cause: java.lang.IllegalArgumentException: The > ServiceName: mapreduce.shuffle set in yarn.nodemanager.aux-services is > invalid.The valid service name should only contain a-zA-Z0-9_ and can not > start with numbers > java.lang.IllegalArgumentException: The ServiceName: mapreduce.shuffle set > in yarn.nodemanager.aux-services is invalid.The valid service name should > only contain a-zA-Z0-9_ and can not start with numbers > at > com.google.common.base.Preconditions.checkArgument(Preconditions.java:88) > at > org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices.serviceInit(AuxServices.java:98) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) > at > org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:108) > at > org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.serviceInit(ContainerManagerImpl.java:218) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) > at > org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:108) > at > org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceInit(NodeManager.java:188) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) > at > org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:338) > at > org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:386) > 2013-12-27 14:26:52,886 INFO org.apache.hadoop.service.AbstractService: > Service NodeManager failed in state INITED; cause: > java.lang.IllegalArgumentException: The ServiceName: mapreduce.shuffle set > in yarn.nodemanager.aux-services is invalid.The valid service name should > only contain a-zA-Z0-9_ and can not start with numbers > java.lang.IllegalArgumentException: The ServiceName: mapreduce.shuffle set > in yarn.nodemanager.aux-services is invalid.The valid service name should > only contain a-zA-Z0-9_ and can not start with numbers > at > com.google.common.base.Preconditions.checkArgument(Preconditions.java:88) > at > org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices.serviceInit(AuxServices.java:98) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) > at > org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:108) > at > org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.serviceInit(ContainerManagerImpl.java:218) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) > at > org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:108) > at > org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceInit(NodeManager.java:188) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) > at > org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:338) > at > org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:386) > 2013-12-27 14:26:52,887 INFO > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping NodeManager > metrics system... > 2013-12-27 14:26:52,888 INFO > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NodeManager metrics > system stopped. > 2013-12-27 14:26:52,888 INFO > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NodeManager metrics > system shutdown complete. > 2013-12-27 14:26:52,888 FATAL > org.apache.hadoop.yarn.server.nodemanager.NodeManager: Error starting > NodeManager > java.lang.IllegalArgumentException: The ServiceName: mapreduce.shuffle set > in yarn.nodemanager.aux-services is invalid.The valid service name should > only contain a-zA-Z0-9_ and can not start with numbers > at > com.google.common.base.Preconditions.checkArgument(Preconditions.java:88) > at > org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices.serviceInit(AuxServices.java:98) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) > at > org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:108) > at > org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.serviceInit(ContainerManagerImpl.java:218) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) > at > org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:108) > at > org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceInit(NodeManager.java:188) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) > at > org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:338) > at > org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:386) > 2013-12-27 14:26:52,891 INFO > org.apache.hadoop.yarn.server.nodemanager.NodeManager: SHUTDOWN_MSG: > /************************************************************ > SHUTDOWN_MSG: Shutting down NodeManager at localhost/127.0.0.1 > ************************************************************/ >
