Peter Bacsko created MAPREDUCE-7152:
---------------------------------------
Summary: LD_LIBRARY_PATH is always passed from MR AM to tasks
Key: MAPREDUCE-7152
URL: https://issues.apache.org/jira/browse/MAPREDUCE-7152
Project: Hadoop Map/Reduce
Issue Type: Improvement
Reporter: Peter Bacsko
Assignee: Peter Bacsko
{{LD_LIBRARY_PATH}} is set to {{$HADOOP_COMMON_HOME/lib/native}} by default in
Hadoop (as part of {{mapreduce.admin.user.env}} and
{{yarn.app.mapreduce.am.user.env}}), and passed as an environment variable from
AM container to task containers in the container launch context.
In cases where {{HADOOP_COMMON_HOME}} is different in AM node and task node,
tasks will fail to load native library. A reliable way to fix this is to add
{{LD_LIBRARY_PATH}} in {{yarn.nodemanager.admin-env}} instead.
Another approach is to perform a lazy evaluation of {{LD_LIBRARY_PATH}} on the
NM side.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
