[ 
https://issues.apache.org/jira/browse/MAPREDUCE-6454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707305#comment-14707305
 ] 

Vinod Kumar Vavilapalli commented on MAPREDUCE-6454:
----------------------------------------------------

bq. Just so it's on record so when someone hits this problem: this is fragile 
and subject to breakage, regardless of the version of hadoop in play. It all 
depends upon how users have HADOOP_CLASSPATH configured in hadoop-env.sh and 
yarn-env.sh.
It is a bit fragile, for sure, but it doesn't by default depend on what is 
configured in *-env.sh like you said. This is because HADOOP_CLASSPATH is not 
part of the default white-listed environment that goes from YARN to the apps.

> MapReduce doesn't set the HADOOP_CLASSPATH for jar lib in distributed cache.
> ----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-6454
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6454
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>            Reporter: Junping Du
>            Assignee: Junping Du
>            Priority: Critical
>             Fix For: 2.7.2, 2.6.2
>
>         Attachments: MAPREDUCE-6454-v2.1.patch, MAPREDUCE-6454-v2.patch, 
> MAPREDUCE-6454-v3.1.patch, MAPREDUCE-6454-v3.patch, MAPREDUCE-6454.patch
>
>
> We already set lib jars on distributed-cache to CLASSPATH. However, in some 
> corner cases (like: MR local mode, Hive Map side local join, etc.), we need 
> these jars on HADOOP_CLASSPATH so hadoop scripts can take it in launching 
> runjar process.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to