[ 
https://issues.apache.org/jira/browse/MAPREDUCE-5813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13954687#comment-13954687
 ] 

Hudson commented on MAPREDUCE-5813:
-----------------------------------

FAILURE: Integrated in Hadoop-Hdfs-trunk #1716 (See 
[https://builds.apache.org/job/Hadoop-Hdfs-trunk/1716/])
MAPREDUCE-5813. Fix YarnChild to explicitly load job.xml from the 
local-filesystem, rather than rely on the classpath. Contributed by Gera 
Shegalov. (acmurthy: 
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1583050)
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* 
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapred/YarnChild.java
* 
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestMRJobs.java


> YarnChild does not load job.xml with mapreduce.job.classloader=true 
> --------------------------------------------------------------------
>
>                 Key: MAPREDUCE-5813
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5813
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2, task
>    Affects Versions: 2.3.0
>            Reporter: Gera Shegalov
>            Assignee: Gera Shegalov
>            Priority: Blocker
>             Fix For: 2.4.0
>
>         Attachments: MAPREDUCE-5813.v01.patch, MAPREDUCE-5813.v02.patch
>
>
> {{YarnChild.main}} uses {{JobConf.addResource(String)}} to load {{job.xml}} 
> that relies on class loading. When {{mapreduce.job.classloader=true}} the 
> job-speicific part of the class path is separated from {{CLASSPATH}} into 
> {{APP_CLASSPATH}}. Therefore {{job.xml}} is inaccessible for the default 
> class loader. Later {{writeLocalJobFile}} overwrites the correct localized 
> {{job.xml}} on disk as well.
> This problem is easily avoided by using  {{JobConf.addResource(Path)}} to 
> read the localized {{job.xml}} without relying on class loading.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to