Namenode going to safe mode on YARN

2013-05-06 Thread Krishna Kishore Bonagiri
Hi, I have been running application on my YARN cluster since around 20 days, about 5000 applications a day. I am getting the following error today. Please let me know how can I avoid this, is this happening because of a bug?

Re: Namenode going to safe mode on YARN

2013-05-06 Thread Nitin Pawar
What is your replication factor on hdfs? Did any of your datanode go down recently and is not back in rotation? Did you delete any hdfs blocks directly from datanodes? On May 6, 2013 2:28 PM, Krishna Kishore Bonagiri write2kish...@gmail.com wrote: Hi, I have been running application on my

Re: Namenode going to safe mode on YARN

2013-05-06 Thread Ted Xu
Hi Kishore, It should not be a bug. After restarting HDFS, namenode will enter safe mode until all needed data is collected. During safe mode, all update operations will fail. In some cases, as Nitin mentioned, namenode will never leave safe mode because it can't get enough data. In that case

Re: Namenode going to safe mode on YARN

2013-05-06 Thread Krishna Kishore Bonagiri
Hi Nithin Ted, Thanks for the replies. I don't know what my replication factor is, I don't seem to have set anything in my configuration files. I run on a single node cluster. My data node has gone down and came back, and also I didn't delete any of the hdfs blocks. I know that name node

Re: Namenode going to safe mode on YARN

2013-05-06 Thread Krishna Kishore Bonagiri
Hi Nithin Ted, Thanks for the replies. I don't know what my replication factor is, I don't seem to have set anything in my configuration files. I run on a single node cluster. My data node has gone down and came back, and also I didn't delete any of the hdfs blocks. I know that name node

Re: Namenode going to safe mode on YARN

2013-05-06 Thread Nitin Pawar
If you are running a single node and you have not changed the hdfs configuration for repliaction then he default is set to 3 and you will just have one available. As long as this is not a production environment you can force namenode to leave safe mode. Only issue in this will be in case any of