Write a file to local disks on all nodes of a YARN cluster.

2013-12-08 Thread Jay Vyas
I want to put a file on all nodes of my cluster, that is locally readable (not in HDFS). Assuming that i cant gaurantee a FUSE mount or NFS or anything of the SORT on my cluster, is there a poor man's way to do this in yarn? something like for each node n in cluster: n.copToLocal(a,/tmp/a);

Re: Write a file to local disks on all nodes of a YARN cluster.

2013-12-08 Thread Adam Kawa
I believe that you could do that through Puppet, or any tool that can remotely execute some command (e.g. pssh). 2013/12/8 Jay Vyas jayunit...@gmail.com I want to put a file on all nodes of my cluster, that is locally readable (not in HDFS). Assuming that i cant gaurantee a FUSE mount or