YARN requires certain directories to exist in the filesystem it runs on (HDFS by default in Bigtop). You can create these directories by running /usr/lib/hadoop/init-hdfs.sh.
On Wed, Oct 15, 2014 at 6:14 PM, Victor <[email protected]> wrote: > Caused by: org.apache.hadoop.yarn.YarnException: Failed to check for > existence of remoteLogDir [/var/log/hadoop-yarn/apps] > > Can someone explain what that directory is? > > Thanks, > > > > org.apache.hadoop.yarn.YarnException: Failed to Start > org.apache.hadoop.yarn.server.nodemanager.NodeManager > at > org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:78) > at > org.apache.hadoop.yarn.server.nodemanager.NodeManager.start(NodeManager.java:199) > at > org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:322) > at > org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:359) > Caused by: org.apache.hadoop.yarn.YarnException: Failed to Start > org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl > at > org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:78) > at > org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.start(ContainerManagerImpl.java:248) > at > org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:68) > ... 3 more > Caused by: org.apache.hadoop.yarn.YarnException: Failed to check for > existence of remoteLogDir [/var/log/hadoop-yarn/apps] > at > org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.LogAggregationService.verifyAndCreateRemoteLogDir(LogAggregationService.java:179) > at > org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.LogAggregationService.start(LogAggregationService.java:132) > at > org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:68) > ... 5 more > 2014-10-15 16:57:10,469 INFO org.apache.hadoop.ipc.Server: Stopping server > on 60263 > 2014-10-15 16:57:10,470 INFO > org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.LogAggregationService: > org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.LogAggregationService > waiting for pending aggregation during exit > 2014-10-15 16:57:10,470 INFO org.apache.hadoop.ipc.Server: Stopping server > on 8040 > 2014-10-15 16:57:10,470 INFO > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping NodeManager > metrics system... > 2014-10-15 16:57:10,472 INFO > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NodeManager metrics > system stopped. > 2014-10-15 16:57:10,472 INFO > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NodeManager metrics > system shutdown complete. > 2014-10-15 16:57:10,477 INFO > org.apache.hadoop.yarn.server.nodemanager.NodeManager: SHUTDOWN_MSG: >
