[
https://issues.apache.org/jira/browse/YARN-2803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14199459#comment-14199459
]
Craig Welch commented on YARN-2803:
-----------------------------------
Enumerating the entries for job.jar indicates the issue, on the working
revision there are two, one of which can then be used to get to the
job.jar/lib/lib1.jar, on the broken revision that entry does not exist, which I
think suggests that the classpath entry for the directory which contains that
directory has gone missing.
working:
{code}
JURL
/C:/Users/cwelch/AppData/Local/Temp/1415233136660/org.apache.hadoop.mapreduce.v2.TestMRJobs-localDir-nm-2_3/usercache/cwelch/appcache/application_1415233156844_0001/container_1415233156844_0001_01_000002/job.jar/^M
2014-11-05 16:19:48,074 INFO [main] org.apache.hadoop.mapreduce.v2.TestMRJobs:
JJURL
/C:/Users/cwelch/AppData/Local/Temp/1415233136660/org.apache.hadoop.mapreduce.v2.TestMRJobs-localDir-nm-2_0/usercache/cwelch/appcache/application_1415233156844_0001/container_1415233156844_0001_01_000001/job.jar/^M
2014-11-05 16:19:48,074 INFO [main] org.apache.hadoop.mapreduce.v2.TestMRJobs:
JJURL
/C:/Users/cwelch/AppData/Local/Temp/1415233136660/org.apache.hadoop.mapreduce.v2.TestMRJobs-localDir-nm-2_0/usercache/cwelch/appcache/application_1415233156844_0001/container_1415233156844_0001_01_000001/job.jar/job.jar/^M
2014-11-05 16:19:48,074 INFO [main] org.apache.hadoop.mapreduce.v2.TestMRJobs:
JJURL
/C:/Users/cwelch/AppData/Local/Temp/1415233136660/org.apache.hadoop.mapreduce.v2.TestMRJobs-localDir-nm-2_3/usercache/cwelch/appcache/application_1415233156844_0001/container_1415233156844_0001_01_000002/job.jar/job.jar/^M
{code}
not working
{code}
2014-11-05 16:05:37,813 INFO [main] org.apache.hadoop.mapreduce.v2.TestMRJobs:
JJURL
/C:/Users/cwelch/AppData/Local/Temp/1415232295468/org.apache.hadoop.mapreduce.v2.TestMRJobs-localDir-nm-0_2/usercache/cwelch/appcache/application_1415232314590_0001/container_1415232314590_0001_01_000001/job.jar/job.jar/^M
2014-11-05 16:05:37,813 INFO [main] org.apache.hadoop.mapreduce.v2.TestMRJobs:
JJURL
/C:/Users/cwelch/AppData/Local/Temp/1415232295468/org.apache.hadoop.mapreduce.v2.TestMRJobs-localDir-nm-1_1/usercache/cwelch/appcache/application_1415232314590_0001/container_1415232314590_0001_01_000002/job.jar/job.jar/^M
{code}
looking into differences wrt the container... entry on the classpath
{code}
> MR distributed cache not working correctly on Windows after NodeManager
> privileged account changes.
> ---------------------------------------------------------------------------------------------------
>
> Key: YARN-2803
> URL: https://issues.apache.org/jira/browse/YARN-2803
> Project: Hadoop YARN
> Issue Type: Bug
> Components: nodemanager
> Reporter: Chris Nauroth
> Priority: Critical
>
> This problem is visible by running {{TestMRJobs#testDistributedCache}} or
> {{TestUberAM#testDistributedCache}} on Windows. Both tests fail. Running
> git bisect, I traced it to the YARN-2198 patch to remove the need to run
> NodeManager as a privileged account. The tests started failing when that
> patch was committed.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
