[
https://issues.apache.org/jira/browse/MAPREDUCE-6454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707390#comment-14707390
]
Allen Wittenauer commented on MAPREDUCE-6454:
---------------------------------------------
bq. This is because HADOOP_CLASSPATH is not part of the default white-listed
environment that goes from YARN to the apps.
If I have HADOOP_CLASSPATH="foo" in hadoop-env.sh, when I run a shell command
(say "hadoop version") as part of my app, that's going to overwrite whatever
Hadoop tries to set it to. The whitelist is completely irrelevant.
> MapReduce doesn't set the HADOOP_CLASSPATH for jar lib in distributed cache.
> ----------------------------------------------------------------------------
>
> Key: MAPREDUCE-6454
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-6454
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Reporter: Junping Du
> Assignee: Junping Du
> Priority: Critical
> Fix For: 2.7.2, 2.6.2
>
> Attachments: MAPREDUCE-6454-v2.1.patch, MAPREDUCE-6454-v2.patch,
> MAPREDUCE-6454-v3.1.patch, MAPREDUCE-6454-v3.patch, MAPREDUCE-6454.patch
>
>
> We already set lib jars on distributed-cache to CLASSPATH. However, in some
> corner cases (like: MR local mode, Hive Map side local join, etc.), we need
> these jars on HADOOP_CLASSPATH so hadoop scripts can take it in launching
> runjar process.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
