HI, I tried to run init-hdfs.sh, it failed with the following message:
Call From zeus.lan/192.168.10.107 to zeus.lan:17020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused The link doesn't provide any useful info From: Sean Mackrory [mailto:[email protected]] Sent: Wednesday, October 15, 2014 8:40 PM To: [email protected] Subject: Re: Filure to start NodeManager YARN requires certain directories to exist in the filesystem it runs on (HDFS by default in Bigtop). You can create these directories by running /usr/lib/hadoop/init-hdfs.sh. On Wed, Oct 15, 2014 at 6:14 PM, Victor <[email protected]> wrote: Caused by: org.apache.hadoop.yarn.YarnException: Failed to check for existence of remoteLogDir [/var/log/hadoop-yarn/apps] Can someone explain what that directory is? Thanks, org.apache.hadoop.yarn.YarnException: Failed to Start org.apache.hadoop.yarn.server.nodemanager.NodeManager at org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java: 78) at org.apache.hadoop.yarn.server.nodemanager.NodeManager.start(NodeManager.java :199) at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManage r(NodeManager.java:322) at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java: 359) Caused by: org.apache.hadoop.yarn.YarnException: Failed to Start org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerI mpl at org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java: 78) at org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerI mpl.start(ContainerManagerImpl.java:248) at org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java: 68) ... 3 more Caused by: org.apache.hadoop.yarn.YarnException: Failed to check for existence of remoteLogDir [/var/log/hadoop-yarn/apps] at org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.Lo gAggregationService.verifyAndCreateRemoteLogDir(LogAggregationService.java:1 79) at org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.Lo gAggregationService.start(LogAggregationService.java:132) at org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java: 68) ... 5 more 2014-10-15 16:57:10,469 INFO org.apache.hadoop.ipc.Server: Stopping server on 60263 2014-10-15 16:57:10,470 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.Lo gAggregationService: org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.Lo gAggregationService waiting for pending aggregation during exit 2014-10-15 16:57:10,470 INFO org.apache.hadoop.ipc.Server: Stopping server on 8040 2014-10-15 16:57:10,470 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping NodeManager metrics system... 2014-10-15 16:57:10,472 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NodeManager metrics system stopped. 2014-10-15 16:57:10,472 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NodeManager metrics system shutdown complete. 2014-10-15 16:57:10,477 INFO org.apache.hadoop.yarn.server.nodemanager.NodeManager: SHUTDOWN_MSG:
