Hi Sameer, Is there a way for you to let me look at your Namenode and SecondaryNameNode logs? It might help me in analyzing the problem.
Thanks, dhruba -----Original Message----- From: Sameer Alsakran [mailto:[EMAIL PROTECTED] Sent: Saturday, September 08, 2007 5:05 PM To: [email protected] Subject: Problem with edits.new rolling over Hello - I have been running into problems with one or two reduce tasks stalling out. This was occuring regularly in 0.13, and remains an issue with 0.14.1 In both cases the fsimage file in the namenode's current image is empty, with the it, as well as the edits file not having been touched in either a day (with 0.14.1) or 3 weeks (in the case of the old 0.13 installation). The edits.new file is continuing to grow. Shutting down the namenode when this occurred resulted in a state where the namenode would not restart. In the namenode log, there are multiple exceptions of the form listed below. ******************** 2007-09-08 16:58:04,182 INFO org.apache.hadoop.fs.FSNamesystem: Roll Edit Log fr om 10.33.0.56 2007-09-08 16:58:04,182 INFO org.apache.hadoop.ipc.Server: IPC Server handler 34 on 50001, call rollEditLog() from 10.33.0.56:41291: error: java.io.IOException: Attempt to roll edit log but edits.new exists java.io.IOException: Attempt to roll edit log but edits.new exists at org.apache.hadoop.dfs.FSEditLog.rollEditLog(FSEditLog.java:582) at org.apache.hadoop.dfs.FSNamesystem.rollEditLog(FSNamesystem.java:3510 ) at org.apache.hadoop.dfs.NameNode.rollEditLog(NameNode.java:553) at sun.reflect.GeneratedMethodAccessor11.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces sorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:340) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:566) ************** Has anyone run into this? Thanks -Sameer
