Stan, What Arun says would surely work.
For instance, read this command: hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.0.0.jar pi -files "share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.0.0.jar#foo.jar" -Dmapred.child.java.opts="-javaagent:./foo.jar" 1 1 What this would do is merely take your passed -files jar (client-common) and symlink it into the JVM's working directory (the task's working directory) _before_ the JVM is begun, as "foo.jar". So if I pass additionally, JVM opts that refer to this foo.jar under ./, then it would work as you expect it to, as the JVM is begun from that directory (its CWD). Do let us know if this solves it and also makes sense? On Fri, Aug 3, 2012 at 10:02 PM, Stan Rosenberg <stan.rosenb...@gmail.com>wrote: > Arun, > > I don't believe the symlink is of help. The symlink is created in the > task's current working directory (cwd), but I don't know what cwd is > when I launch with 'hadoop jar ...'. > > Thanks, > > stan > > On Fri, Aug 3, 2012 at 2:39 AM, Arun C Murthy <a...@hortonworks.com> wrote: > > Stan, > > > > You can ask TT to create a symlink to your jar shipped via DistCache: > > > > > http://hadoop.apache.org/common/docs/r1.0.3/mapred_tutorial.html#DistributedCache > > > > That should give you what you want. > > > > hth, > > Arun > > > > On Jul 30, 2012, at 3:23 PM, Stan Rosenberg wrote: > > > > Hi, > > > > I am seeking a way to leverage hadoop's distributed cache in order to > > ship jars that are required to bootstrap a task's jvm, i.e., before a > > map/reduce task is launched. > > As a concrete example, let's say that I need to launch with > > '-javaagent:/path/profiler.jar'. In theory, the task tracker is > > responsible for downloading cached files onto its local filesystem. > > However, the absolute path to a given cached file is not known a > > priori; however, we need the path in order to configure '-javaagent'. > > > > Is this currently possible with the distributed cache? If not, is the > > use case appealing enough to open a jira ticket? > > > > Thanks, > > > > stan > > > > > > -- > > Arun C. Murthy > > Hortonworks Inc. > > http://hortonworks.com/ > > > > > -- Harsh J
