[ https://issues.apache.org/jira/browse/MAPREDUCE-4421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13410449#comment-13410449 ]
Robert Joseph Evans commented on MAPREDUCE-4421: ------------------------------------------------ I would say too that we want to have these jars be something that can be configured to already be in HDFS. When I looked at our distributed cache recently more then 50% of the files in the cache were all copies of the same pig jar. If we start shipping MR jars we really should have it so that they are cache friendly. > Remove dependency on deployed MR jars > ------------------------------------- > > Key: MAPREDUCE-4421 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-4421 > Project: Hadoop Map/Reduce > Issue Type: Improvement > Affects Versions: 2.0.0-alpha > Reporter: Arun C Murthy > Assignee: Arun C Murthy > > Currently MR AM depends on MR jars being deployed on all nodes via implicit > dependency on YARN_APPLICATION_CLASSPATH. > We should stop adding mapreduce jars to YARN_APPLICATION_CLASSPATH and, > probably, just rely on adding a shaded MR jar along with job.jar to the > dist-cache. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira