[ 
https://issues.apache.org/jira/browse/YARN-2803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14199459#comment-14199459
 ] 

Craig Welch commented on YARN-2803:
-----------------------------------

Enumerating the entries for job.jar indicates the issue, on the working 
revision there are two, one of which can then be used to get to the 
job.jar/lib/lib1.jar, on the broken revision that entry does not exist, which I 
think suggests that the classpath entry for the directory which contains that 
directory has gone missing.
working:
{code}
JURL 
/C:/Users/cwelch/AppData/Local/Temp/1415233136660/org.apache.hadoop.mapreduce.v2.TestMRJobs-localDir-nm-2_3/usercache/cwelch/appcache/application_1415233156844_0001/container_1415233156844_0001_01_000002/job.jar/^M
2014-11-05 16:19:48,074 INFO [main] org.apache.hadoop.mapreduce.v2.TestMRJobs: 
JJURL 
/C:/Users/cwelch/AppData/Local/Temp/1415233136660/org.apache.hadoop.mapreduce.v2.TestMRJobs-localDir-nm-2_0/usercache/cwelch/appcache/application_1415233156844_0001/container_1415233156844_0001_01_000001/job.jar/^M
2014-11-05 16:19:48,074 INFO [main] org.apache.hadoop.mapreduce.v2.TestMRJobs: 
JJURL 
/C:/Users/cwelch/AppData/Local/Temp/1415233136660/org.apache.hadoop.mapreduce.v2.TestMRJobs-localDir-nm-2_0/usercache/cwelch/appcache/application_1415233156844_0001/container_1415233156844_0001_01_000001/job.jar/job.jar/^M
2014-11-05 16:19:48,074 INFO [main] org.apache.hadoop.mapreduce.v2.TestMRJobs: 
JJURL 
/C:/Users/cwelch/AppData/Local/Temp/1415233136660/org.apache.hadoop.mapreduce.v2.TestMRJobs-localDir-nm-2_3/usercache/cwelch/appcache/application_1415233156844_0001/container_1415233156844_0001_01_000002/job.jar/job.jar/^M
{code}

not working
{code}
2014-11-05 16:05:37,813 INFO [main] org.apache.hadoop.mapreduce.v2.TestMRJobs: 
JJURL 
/C:/Users/cwelch/AppData/Local/Temp/1415232295468/org.apache.hadoop.mapreduce.v2.TestMRJobs-localDir-nm-0_2/usercache/cwelch/appcache/application_1415232314590_0001/container_1415232314590_0001_01_000001/job.jar/job.jar/^M
2014-11-05 16:05:37,813 INFO [main] org.apache.hadoop.mapreduce.v2.TestMRJobs: 
JJURL 
/C:/Users/cwelch/AppData/Local/Temp/1415232295468/org.apache.hadoop.mapreduce.v2.TestMRJobs-localDir-nm-1_1/usercache/cwelch/appcache/application_1415232314590_0001/container_1415232314590_0001_01_000002/job.jar/job.jar/^M
{code}

looking into differences wrt the container... entry on the classpath
{code}

> MR distributed cache not working correctly on Windows after NodeManager 
> privileged account changes.
> ---------------------------------------------------------------------------------------------------
>
>                 Key: YARN-2803
>                 URL: https://issues.apache.org/jira/browse/YARN-2803
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: nodemanager
>            Reporter: Chris Nauroth
>            Priority: Critical
>
> This problem is visible by running {{TestMRJobs#testDistributedCache}} or 
> {{TestUberAM#testDistributedCache}} on Windows.  Both tests fail.  Running 
> git bisect, I traced it to the YARN-2198 patch to remove the need to run 
> NodeManager as a privileged account.  The tests started failing when that 
> patch was committed.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to