[jira] [Commented] (YARN-3120) YarnException on windows + org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to setup local dirnm-local-dir, which was marked as good.

2019-12-28 Thread Wei Zhang (Jira) 


[ 
https://issues.apache.org/jira/browse/YARN-3120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17004425#comment-17004425
 ] 

Wei Zhang commented on YARN-3120:
-

I resolved it. I use admin  account  to open the PowerShell  in windows, then i 
start yarn. It  works and the nodemanager has no  warn logs.   

> YarnException on windows + 
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to setup local 
> dirnm-local-dir, which was marked as good.
> ---
>
> Key: YARN-3120
> URL: https://issues.apache.org/jira/browse/YARN-3120
> Project: Hadoop YARN
>  Issue Type: Bug
>Affects Versions: 2.6.0
> Environment: Windows 8 , Hadoop 2.6.0
>Reporter: vaidhyanathan
>Priority: Major
>
> Hi,
> I tried to follow the instructiosn in 
> http://wiki.apache.org/hadoop/Hadoop2OnWindows and have setup 
> hadoop-2.6.0.jar in my windows system.
> I was able to start everything properly but when i try to run the job 
> wordcount as given in the above URL , the job fails with the below exception .
> 15/01/30 12:56:09 INFO localizer.ResourceLocalizationService: Localizer failed
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to setup local 
> di
> r /tmp/hadoop-haremangala/nm-local-dir, which was marked as good.
> at 
> org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.
> ResourceLocalizationService.getInitializedLocalDirs(ResourceLocalizationService.
> java:1372)
> at 
> org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.
> ResourceLocalizationService.access$900(ResourceLocalizationService.java:137)
> at 
> org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.
> ResourceLocalizationService$LocalizerRunner.run(ResourceLocalizationService.java
> :1085)



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org

[jira] [Commented] (YARN-3120) YarnException on windows + org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to setup local dirnm-local-dir, which was marked as good.

2019-12-28 Thread Wei Zhang (Jira) 


[ 
https://issues.apache.org/jira/browse/YARN-3120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17004422#comment-17004422
 ] 

Wei Zhang commented on YARN-3120:
-

I  face the same issue  when i start-yarn in Windows10 today. The hadoop 
version is 2.8.3.

The logs in nodemanager as below:
{code:java}
19/12/28 15:49:09 WARN localizer.ResourceLocalizationService: Permissions 
incorrectly set for dir /tmp/hadoop-xxx/nm-local-dir/usercache, should be 
rwxr-xr-x, actual value = rwxrwxr-x
19/12/28 15:49:09 INFO localizer.ResourceLocalizationService: Attempting to 
initialize /tmp/hadoop-xxx/nm-local-dir
19/12/28 15:49:09 WARN localizer.ResourceLocalizationService: Permissions 
incorrectly set for dir /tmp/hadoop-xxx/nm-local-dir/usercache, should be 
rwxr-xr-x, actual value = rwxrwxr-x
19/12/28 15:49:09 WARN localizer.ResourceLocalizationService: Failed to setup 
local dir /tmp/hadoop-xxx/nm-local-dir, which was marked as good.
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Permissions incorrectly 
set for dir /tmp/hadoop-xxx/nm-local-dir/usercache, should be rwxr-xr-x, actual 
value = rwxrwxr-x
at 
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.checkLocalDir(ResourceLocalizationService.java:1562)
at 
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.checkAndInitializeLocalDirs(ResourceLocalizationService.java:1530)
at 
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$1.onDirsChanged(ResourceLocalizationService.java:271)
at 
org.apache.hadoop.yarn.server.nodemanager.DirectoryCollection.registerDirsChangeListener(DirectoryCollection.java:197)
at 
org.apache.hadoop.yarn.server.nodemanager.LocalDirsHandlerService.registerLocalDirsChangeListener(LocalDirsHandlerService.java:242)
at 
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.serviceStart(ResourceLocalizationService.java:372)
at 
org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
at 
org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120)
at 
org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.serviceStart(ContainerManagerImpl.java:502)
at 
org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
at 
org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120)
at 
org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStart(NodeManager.java:369)
at 
org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
at 
org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:637)
at 
org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:684)
19/12/28 15:49:09 INFO service.AbstractService: Service 
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService
 failed in state STARTED; cause: 
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to setup local 
dir /tmp/hadoop-xxx/nm-local-dir, which was marked as good.
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to setup local 
dir /tmp/hadoop-xxx/nm-local-dir, which was marked as good.
at 
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.checkAndInitializeLocalDirs(ResourceLocalizationService.java:1535)
at 
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$1.onDirsChanged(ResourceLocalizationService.java:271)
at 
org.apache.hadoop.yarn.server.nodemanager.DirectoryCollection.registerDirsChangeListener(DirectoryCollection.java:197)
at 
org.apache.hadoop.yarn.server.nodemanager.LocalDirsHandlerService.registerLocalDirsChangeListener(LocalDirsHandlerService.java:242)
at 
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.serviceStart(ResourceLocalizationService.java:372)
at 
org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
at 
org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120)
at 
org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.serviceStart(ContainerManagerImpl.java:502)
at 
org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
at 
org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120)
at 
org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStart(NodeManager.java:369)
at 
org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
at