Junping Du reassigned YARN-2464:

    Assignee: Junping Du

> Provide Hadoop as a local resource (on HDFS) which can be used by other 
> projcets
> --------------------------------------------------------------------------------
>                 Key: YARN-2464
>                 URL: https://issues.apache.org/jira/browse/YARN-2464
>             Project: Hadoop YARN
>          Issue Type: Improvement
>            Reporter: Siddharth Seth
>            Assignee: Junping Du
> DEFAULT_YARN_APPLICATION_CLASSPATH are used by YARN projects to setup their 
> AM / task classpaths if they have a dependency on Hadoop libraries.
> It'll be useful to provide similar access to a Hadoop tarball (Hadoop libs, 
> native libraries) etc, which could be used instead - for applications which 
> do not want to rely upon Hadoop versions from a cluster node. This would also 
> require functionality to update the classpath/env for the apps based on the 
> structure of the tar.
> As an example, MR has support for a full tar (for rolling upgrades). 
> Similarly, Tez ships hadoop libraries along with it's build. I'm not sure 
> about the Spark / Storm / HBase model for this - but using a common copy 
> instead of everyone localizing Hadoop libraries would be useful.

This message was sent by Atlassian JIRA

Reply via email to