[jira] [Commented] (YARN-3120) YarnException on windows + org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to setup local dirnm-local-dir, which was marked as good.
[ https://issues.apache.org/jira/browse/YARN-3120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17004425#comment-17004425 ] Wei Zhang commented on YARN-3120: - I resolved it. I use admin account to open the PowerShell in windows, then i start yarn. It works and the nodemanager has no warn logs. > YarnException on windows + > org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to setup local > dirnm-local-dir, which was marked as good. > --- > > Key: YARN-3120 > URL: https://issues.apache.org/jira/browse/YARN-3120 > Project: Hadoop YARN > Issue Type: Bug >Affects Versions: 2.6.0 > Environment: Windows 8 , Hadoop 2.6.0 >Reporter: vaidhyanathan >Priority: Major > > Hi, > I tried to follow the instructiosn in > http://wiki.apache.org/hadoop/Hadoop2OnWindows and have setup > hadoop-2.6.0.jar in my windows system. > I was able to start everything properly but when i try to run the job > wordcount as given in the above URL , the job fails with the below exception . > 15/01/30 12:56:09 INFO localizer.ResourceLocalizationService: Localizer failed > org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to setup local > di > r /tmp/hadoop-haremangala/nm-local-dir, which was marked as good. > at > org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer. > ResourceLocalizationService.getInitializedLocalDirs(ResourceLocalizationService. > java:1372) > at > org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer. > ResourceLocalizationService.access$900(ResourceLocalizationService.java:137) > at > org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer. > ResourceLocalizationService$LocalizerRunner.run(ResourceLocalizationService.java > :1085) -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-3120) YarnException on windows + org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to setup local dirnm-local-dir, which was marked as good.
[
https://issues.apache.org/jira/browse/YARN-3120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17004422#comment-17004422
]
Wei Zhang commented on YARN-3120:
-
I face the same issue when i start-yarn in Windows10 today. The hadoop
version is 2.8.3.
The logs in nodemanager as below:
{code:java}
19/12/28 15:49:09 WARN localizer.ResourceLocalizationService: Permissions
incorrectly set for dir /tmp/hadoop-xxx/nm-local-dir/usercache, should be
rwxr-xr-x, actual value = rwxrwxr-x
19/12/28 15:49:09 INFO localizer.ResourceLocalizationService: Attempting to
initialize /tmp/hadoop-xxx/nm-local-dir
19/12/28 15:49:09 WARN localizer.ResourceLocalizationService: Permissions
incorrectly set for dir /tmp/hadoop-xxx/nm-local-dir/usercache, should be
rwxr-xr-x, actual value = rwxrwxr-x
19/12/28 15:49:09 WARN localizer.ResourceLocalizationService: Failed to setup
local dir /tmp/hadoop-xxx/nm-local-dir, which was marked as good.
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Permissions incorrectly
set for dir /tmp/hadoop-xxx/nm-local-dir/usercache, should be rwxr-xr-x, actual
value = rwxrwxr-x
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.checkLocalDir(ResourceLocalizationService.java:1562)
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.checkAndInitializeLocalDirs(ResourceLocalizationService.java:1530)
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$1.onDirsChanged(ResourceLocalizationService.java:271)
at
org.apache.hadoop.yarn.server.nodemanager.DirectoryCollection.registerDirsChangeListener(DirectoryCollection.java:197)
at
org.apache.hadoop.yarn.server.nodemanager.LocalDirsHandlerService.registerLocalDirsChangeListener(LocalDirsHandlerService.java:242)
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.serviceStart(ResourceLocalizationService.java:372)
at
org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
at
org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120)
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.serviceStart(ContainerManagerImpl.java:502)
at
org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
at
org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120)
at
org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStart(NodeManager.java:369)
at
org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
at
org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:637)
at
org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:684)
19/12/28 15:49:09 INFO service.AbstractService: Service
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService
failed in state STARTED; cause:
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to setup local
dir /tmp/hadoop-xxx/nm-local-dir, which was marked as good.
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to setup local
dir /tmp/hadoop-xxx/nm-local-dir, which was marked as good.
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.checkAndInitializeLocalDirs(ResourceLocalizationService.java:1535)
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$1.onDirsChanged(ResourceLocalizationService.java:271)
at
org.apache.hadoop.yarn.server.nodemanager.DirectoryCollection.registerDirsChangeListener(DirectoryCollection.java:197)
at
org.apache.hadoop.yarn.server.nodemanager.LocalDirsHandlerService.registerLocalDirsChangeListener(LocalDirsHandlerService.java:242)
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.serviceStart(ResourceLocalizationService.java:372)
at
org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
at
org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120)
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.serviceStart(ContainerManagerImpl.java:502)
at
org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
at
org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120)
at
org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStart(NodeManager.java:369)
at
org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
at
[jira] [Commented] (YARN-3120) YarnException on windows + org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to setup local dirnm-local-dir, which was marked as good.
[ https://issues.apache.org/jira/browse/YARN-3120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16038679#comment-16038679 ] Animesh Sonkar commented on YARN-3120: -- Hi, I had setup hadoop 2.8.0 an using the steps mentioned in hadoop2onwindows wiki, was trying to setup the same. I am facing the same issue. I do not have the source and cant make changes as done by kumar ranganathan. I just want to get the setup working to learn hadoop. Was this fixed in 2.8.0? Id there any workaround available other than changing the source? I tried changing permissions of the dir for domain users and Administrators in windows, but it did not work. Thanks, Animesh Kumar Sonkar > YarnException on windows + > org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to setup local > dirnm-local-dir, which was marked as good. > --- > > Key: YARN-3120 > URL: https://issues.apache.org/jira/browse/YARN-3120 > Project: Hadoop YARN > Issue Type: Bug >Affects Versions: 2.6.0 > Environment: Windows 8 , Hadoop 2.6.0 >Reporter: vaidhyanathan > > Hi, > I tried to follow the instructiosn in > http://wiki.apache.org/hadoop/Hadoop2OnWindows and have setup > hadoop-2.6.0.jar in my windows system. > I was able to start everything properly but when i try to run the job > wordcount as given in the above URL , the job fails with the below exception . > 15/01/30 12:56:09 INFO localizer.ResourceLocalizationService: Localizer failed > org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to setup local > di > r /tmp/hadoop-haremangala/nm-local-dir, which was marked as good. > at > org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer. > ResourceLocalizationService.getInitializedLocalDirs(ResourceLocalizationService. > java:1372) > at > org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer. > ResourceLocalizationService.access$900(ResourceLocalizationService.java:137) > at > org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer. > ResourceLocalizationService$LocalizerRunner.run(ResourceLocalizationService.java > :1085) -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-3120) YarnException on windows + org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to setup local dirnm-local-dir, which was marked as good.
[
https://issues.apache.org/jira/browse/YARN-3120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15128253#comment-15128253
]
kumar ranganathan commented on YARN-3120:
-
Hi,
I have facing the same problem in Hadoop-2.7.2 in Windows. I have found the
logs in nodemanager as below and it should be the actual root cause
{panel}
WARN localizer.ResourceLocalizationService: Failed to setup local dir
/tmp/hadoop-SYSTEM/nm-local-dir, which was marked as good.
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Permissions incorrectly
set for dir /tmp/hadoop-SYSTEM/nm-local-dir/usercache, should be rwxr-xr-x,
actual value = rwxrwxr-x
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.checkLocalDir(ResourceLocalizationService.java:1443)
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.getInitializedLocalDirs(ResourceLocalizationService.java:1410)
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.access$800(ResourceLocalizationService.java:140)
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerRunner.run(ResourceLocalizationService.java:1110)
16/02/02 18:50:45 INFO localizer.ResourceLocalizationService: Localizer failed
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to setup local
dir /tmp/hadoop-SYSTEM/nm-local-dir, which was marked as good.
{panel}
I found another jira task related to this issue
[https://issues.apache.org/jira/browse/YARN-3962]
Even though i applied patch, the problem isn't resolved. So i have changed the
code manually by commenting the condition check as below,
{code:title=ResourceLocalizationService.java|borderStyle=solid}
private boolean checkLocalDir(String localDir) {
Map pathPermissionMap =
getLocalDirsPathPermissionsMap(localDir);
for (Map.Entry entry : pathPermissionMap.entrySet()) {
FileStatus status;
try {
status = lfs.getFileStatus(entry.getKey());
} catch (Exception e) {
String msg =
"Could not carry out resource dir checks for " + localDir
+ ", which was marked as good";
LOG.warn(msg, e);
throw new YarnRuntimeException(msg, e);
}
// if (!status.getPermission().equals(entry.getValue())) {
//String msg =
//"Permissions incorrectly set for dir " + entry.getKey()
//+ ", should be " + entry.getValue() + ", actual value = "
//+ status.getPermission();
//LOG.warn(msg);
//throw new YarnRuntimeException(msg);
// }
}
return true;
}
{code}
Now it works fine without any issue. It seems we can ignore this condition for
virtual account in windows.
> YarnException on windows +
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to setup local
> dirnm-local-dir, which was marked as good.
> ---
>
> Key: YARN-3120
> URL: https://issues.apache.org/jira/browse/YARN-3120
> Project: Hadoop YARN
> Issue Type: Bug
>Affects Versions: 2.6.0
> Environment: Windows 8 , Hadoop 2.6.0
>Reporter: vaidhyanathan
>
> Hi,
> I tried to follow the instructiosn in
> http://wiki.apache.org/hadoop/Hadoop2OnWindows and have setup
> hadoop-2.6.0.jar in my windows system.
> I was able to start everything properly but when i try to run the job
> wordcount as given in the above URL , the job fails with the below exception .
> 15/01/30 12:56:09 INFO localizer.ResourceLocalizationService: Localizer failed
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to setup local
> di
> r /tmp/hadoop-haremangala/nm-local-dir, which was marked as good.
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.
> ResourceLocalizationService.getInitializedLocalDirs(ResourceLocalizationService.
> java:1372)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.
> ResourceLocalizationService.access$900(ResourceLocalizationService.java:137)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.
> ResourceLocalizationService$LocalizerRunner.run(ResourceLocalizationService.java
> :1085)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (YARN-3120) YarnException on windows + org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to setup local dirnm-local-dir, which was marked as good.
[ https://issues.apache.org/jira/browse/YARN-3120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14309867#comment-14309867 ] vaidhyanathan commented on YARN-3120: - Hi Varun, Thanks for responding. I started running the yarn cmd files by running as administrator and it worked . Also i opened the command prompt and ran it in the administrator mode. The word count example worked fine for the first time but now im facing a different issue , When i run it now with the earlier setup , job doesnt proceed after this step '15/02/06 15:38:26 INFO mapreduce.Job: Running job: job_1423255041751_0001' and when i check the consolde the status is 'Accepted' and the final status is 'Undefined' YarnException on windows + org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to setup local dirnm-local-dir, which was marked as good. --- Key: YARN-3120 URL: https://issues.apache.org/jira/browse/YARN-3120 Project: Hadoop YARN Issue Type: Bug Affects Versions: 2.6.0 Environment: Windows 8 , Hadoop 2.6.0 Reporter: vaidhyanathan Hi, I tried to follow the instructiosn in http://wiki.apache.org/hadoop/Hadoop2OnWindows and have setup hadoop-2.6.0.jar in my windows system. I was able to start everything properly but when i try to run the job wordcount as given in the above URL , the job fails with the below exception . 15/01/30 12:56:09 INFO localizer.ResourceLocalizationService: Localizer failed org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to setup local di r /tmp/hadoop-haremangala/nm-local-dir, which was marked as good. at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer. ResourceLocalizationService.getInitializedLocalDirs(ResourceLocalizationService. java:1372) at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer. ResourceLocalizationService.access$900(ResourceLocalizationService.java:137) at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer. ResourceLocalizationService$LocalizerRunner.run(ResourceLocalizationService.java :1085) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-3120) YarnException on windows + org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to setup local dirnm-local-dir, which was marked as good.
[ https://issues.apache.org/jira/browse/YARN-3120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299111#comment-14299111 ] vaidhyanathan commented on YARN-3120: - I tried to change the folder permission for nmprivate manually by using chmod 700 as its expecting but the issue doesnt see to be resolved. YarnException on windows + org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to setup local dirnm-local-dir, which was marked as good. --- Key: YARN-3120 URL: https://issues.apache.org/jira/browse/YARN-3120 Project: Hadoop YARN Issue Type: Bug Affects Versions: 2.6.0 Environment: Windows 8 , Hadoop 2.6.0 Reporter: vaidhyanathan Hi, I tried to follow the instructiosn in http://wiki.apache.org/hadoop/Hadoop2OnWindows and have setup hadoop-2.6.0.jar in my windows system. I was able to start everything properly but when i try to run the job wordcount as given in the above URL , the job fails with the below exception . 15/01/30 12:56:09 INFO localizer.ResourceLocalizationService: Localizer failed org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to setup local di r /tmp/hadoop-haremangala/nm-local-dir, which was marked as good. at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer. ResourceLocalizationService.getInitializedLocalDirs(ResourceLocalizationService. java:1372) at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer. ResourceLocalizationService.access$900(ResourceLocalizationService.java:137) at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer. ResourceLocalizationService$LocalizerRunner.run(ResourceLocalizationService.java :1085) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-3120) YarnException on windows + org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to setup local dirnm-local-dir, which was marked as good.
[ https://issues.apache.org/jira/browse/YARN-3120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299677#comment-14299677 ] Varun Vasudev commented on YARN-3120: - Are you running everything on your install drive(C:)? Windows has special security permissions on the install drive. Try creating another partition and set the local dirs on that partition. YarnException on windows + org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to setup local dirnm-local-dir, which was marked as good. --- Key: YARN-3120 URL: https://issues.apache.org/jira/browse/YARN-3120 Project: Hadoop YARN Issue Type: Bug Affects Versions: 2.6.0 Environment: Windows 8 , Hadoop 2.6.0 Reporter: vaidhyanathan Hi, I tried to follow the instructiosn in http://wiki.apache.org/hadoop/Hadoop2OnWindows and have setup hadoop-2.6.0.jar in my windows system. I was able to start everything properly but when i try to run the job wordcount as given in the above URL , the job fails with the below exception . 15/01/30 12:56:09 INFO localizer.ResourceLocalizationService: Localizer failed org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to setup local di r /tmp/hadoop-haremangala/nm-local-dir, which was marked as good. at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer. ResourceLocalizationService.getInitializedLocalDirs(ResourceLocalizationService. java:1372) at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer. ResourceLocalizationService.access$900(ResourceLocalizationService.java:137) at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer. ResourceLocalizationService$LocalizerRunner.run(ResourceLocalizationService.java :1085) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
