Re: YARN: LocalResources and file distribution

2013-12-05 Thread Krishna Kishore Bonagiri
Hi Arun, I have copied a shell script to HDFS and trying to execute it on containers. How do I specify my shell script PATH in setCommands() call on ContainerLaunchContext? I am doing it this way String shellScriptPath = hdfs://isredeng:8020/user/kbonagir/KKDummy/list.ksh;

Re: YARN: LocalResources and file distribution

2013-12-05 Thread omkar joshi
add this file in the files to be localized. (LocalResourceRequest). and then refer it as ./list.ksh .. While adding this to LocalResource specify the path which you have mentioned. On Thu, Dec 5, 2013 at 10:40 PM, Krishna Kishore Bonagiri write2kish...@gmail.com wrote: Hi Arun, I have

Re: YARN: LocalResources and file distribution

2013-12-02 Thread Arun C Murthy
Robert, YARN, by default, will only download *resource* from a shared namespace (e.g. HDFS). If /home/hadoop/robert/large_jar.jar is available on each node then you can specify path as file:///home/hadoop/robert/large_jar.jar and it should work. Else, you'll need to copy