[ 
https://issues.apache.org/jira/browse/MAPREDUCE-4365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13403191#comment-13403191
 ] 

Robert Joseph Evans commented on MAPREDUCE-4365:
------------------------------------------------

@Jie on 1.0 that may work, but I don't know if we are exploding the job.jar for 
2.0.  I think we need to have a JIRA for creating the symlinks before launching 
at least in 2.0.
                
> Shipping Profiler Libraries by DistributedCache
> -----------------------------------------------
>
>                 Key: MAPREDUCE-4365
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4365
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>    Affects Versions: 1.0.3
>            Reporter: Jie Li
>
> Hadoop profiling is great for performance tuning and debugging, but currently 
> we can only use Java built-in profilers such as HProf, and for other 
> profilers we need to install them on all slave nodes first, which is 
> inconvenient for large clusters and sometimes impossible for production 
> clusters. 
> Supporting shipping profiler libraries using DistributedCache will solve this 
> problem. For example, in mapred.task.profile.params, we specify a profiler 
> library from the DistributedCache using special place holders such as 
> <foo.jar>, and Hadoop can look at the DistributedCache to replace <foo.jar> 
> with the localized path before launching the child jvm.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to