[no subject]

2014-09-26 Thread Naganarasimha G R (Naga)
Hi All, I have following doubts on pluggable FileSystem and YARN 1. If all the implementations should extend FileSystem then why there is a parallel class AbstractFileSystem. which ViewFS extends ? 2. Is YARN supposed to run on any of the pluggable org.apache.hadoop.fs.FileSystem like s3 ? if

No space when running a hadoop job

2014-09-26 Thread Abdul Navaz
Hi I am facing some space issue when I saving file into HDFS and/or running map reduce job. root@nn:~# df -h Filesystem Size Used Avail Use% Mounted on /dev/xvda2 5.9G 5.9G 0 100% / udev

Re: No space when running a hadoop job

2014-09-26 Thread Matt Narrell
You can add a comma separated list of paths to the “dfs.datanode.data.dir” property in your hdfs-site.xml mn On Sep 26, 2014, at 8:37 AM, Abdul Navaz navaz@gmail.com wrote: Hi I am facing some space issue when I saving file into HDFS and/or running map reduce job. root@nn:~# df -h

Re:

2014-09-26 Thread jay vyas
See https://wiki.apache.org/hadoop/HCFS/ YES Yarn is written to the FileSystem interface. It works on S3FileSystem and GlusterFileSystem and any other HCFS. We have run , and continue to run, the many tests in apache bigtop's test suite against our hadoop clusters running on alternative file

Re: YARN Newbie Question in ApplicationMaster

2014-09-26 Thread Akira AJISAKA
Hi Dhanasekaran, 1 . Again submitting mapreduce job, It's create new application master or It's bind with already running application master. Create new MapReduce application master. 2 . when job completed application master process killed by resource manager or it's still alive