Re: setLocalResources() on ContainerLaunchContext

2013-08-07 Thread Krishna Kishore Bonagiri
); >>> >>>>> >>> >>>>> ctx.setLocalResources(localResources); >>> >>>>> >>> >>>>> >>> >>>>> Please let me know if you need anything else. >>> >

Re: setLocalResources() on ContainerLaunchContext

2013-08-07 Thread Omkar Joshi
also the relevant >> >>>>>> snippets of code. >> >>>>>> >> >>>>>> On Mon, Aug 5, 2013 at 6:36 PM, Krishna Kishore Bonagiri >> >>>>>> wrote: >> >>>>>>> Hi Harsh, >> >>>>&g

Re: setLocalResources() on ContainerLaunchContext

2013-08-06 Thread Krishna Kishore Bonagiri
> >>>>>>> not > >>>>>>> exist: hdfs://isredeng/kishore/kk.ksh > >>>>>>> > >>>>>>> > >>>>>>> This file is there on the machine with name "isredeng", I could do > ls

Re: setLocalResources() on ContainerLaunchContext

2013-08-06 Thread Harsh J
;>> This file is there on the machine with name "isredeng", I could do ls >>>>>>> for >>>>>>> that file as below: >>>>>>> >>>>>>> -bash-4.1$ hadoop fs -ls kishore/kk.ksh >>>>>>> 13/08/

Re: setLocalResources() on ContainerLaunchContext

2013-08-06 Thread Hitesh Shah
t; >>>>>> >>>>>> >>>>>> On Mon, Aug 5, 2013 at 3:00 PM, Harsh J wrote: >>>>>>> >>>>>>> The string for each LocalResource in the map can be anything that >>>>>>> serves as a commo

Re: setLocalResources() on ContainerLaunchContext

2013-08-06 Thread Harsh J
t;> >> For an example, checkout the DistributedShell app sources. >> >> >> >> >> >> Over [1], you can see we take a user provided file path to a shell >> >> >> script. This can be named anything as it is user-supplied. >> >> >> O

Re: setLocalResources() on ContainerLaunchContext

2013-08-06 Thread Hitesh Shah
so thats what we choose to execute. > >> >> > >> >> [1] - > >> >> > >> >> https://github.com/apache/hadoop-common/blob/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/main/ja

Re: setLocalResources() on ContainerLaunchContext

2013-08-06 Thread Omkar Joshi
uster >>>> >> > >>>> >> > Thanks, >>>> >> > Kishore >>>> >> > >>>> >> > >>>> >> > >>>> >> > >>>> >> > On Mon, Aug 5, 2013 at 3:00 PM, Harsh J >>

Re: setLocalResources() on ContainerLaunchContext

2013-08-06 Thread Krishna Kishore Bonagiri
ication code need not track special >>> >> >> names. The behavior is very similar to how you can, in MR, define a >>> >> >> symlink name for a DistributedCache entry (e.g. foo.jar#bar.jar). >>> >> >> >>> >>

Re: setLocalResources() on ContainerLaunchContext

2013-08-06 Thread Harsh J
; >> Onto [2], we define this as a local resource [2.1] and embed it >> with a >> >> >> different name (the string you ask about) [2.2], as defined at [3] >> as >> >> >> an application reference-able constant. >> >> >> Note that in [4], we a

Re: setLocalResources() on ContainerLaunchContext

2013-08-06 Thread Krishna Kishore Bonagiri
. The resource is placed on the container with this name > >> >> instead, so thats what we choose to execute. > >> >> > >> >> [1] - > >> >> > >> >> > https://github.com/apache/hadoop-common/blob/trunk/hadoop-yarn-project/hado

Re: setLocalResources() on ContainerLaunchContext

2013-08-06 Thread Harsh J
distributedshell/ApplicationMaster.java#L764 >> >> and [2.2] >> >> >> >> https://github.com/apache/hadoop-common/blob/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/main/java/org/apache/hadoop/yarn/applicati

Re: setLocalResources() on ContainerLaunchContext

2013-08-05 Thread Krishna Kishore Bonagiri
Master.java#L780 > >> > >> [3] - > >> > https://github.com/apache/hadoop-common/blob/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/main/java/org/apache/hadoop/yarn/applications/distributedshell/ApplicationMaster

Re: setLocalResources() on ContainerLaunchContext

2013-08-05 Thread Harsh J
lob/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/main/java/org/apache/hadoop/yarn/applications/distributedshell/ApplicationMaster.java#L791 >> >> On Mon, Aug 5, 2013 at 2:44 PM, Krishna Kishore Bonagiri >&

Re: setLocalResources() on ContainerLaunchContext

2013-08-05 Thread Krishna Kishore Bonagiri
aster.java#L791 > > On Mon, Aug 5, 2013 at 2:44 PM, Krishna Kishore Bonagiri > wrote: > > Hi, > > > > Can someone please tell me what is the use of calling > setLocalResources() > > on ContainerLaunchContext? > > > > And, also an example of how t

Re: setLocalResources() on ContainerLaunchContext

2013-08-05 Thread Harsh J
someone please tell me what is the use of calling setLocalResources() > on ContainerLaunchContext? > > And, also an example of how to use this will help... > > I couldn't guess what is the String in the map that is passed to > setLocalResources() like below: > >

setLocalResources() on ContainerLaunchContext

2013-08-05 Thread Krishna Kishore Bonagiri
Hi, Can someone please tell me what is the use of calling setLocalResources() on ContainerLaunchContext? And, also an example of how to use this will help... I couldn't guess what is the String in the map that is passed to setLocalResources() like below: // Set the local reso