I'm getting the below exception on my secondary namenode. As far as I can tell the edits isn't being reconciled as it should be (i.e. edits.NEW continues to grow) on the namenode.
I've searched around but haven't turned up any answers so far. Anyone have any ideas? Hadoop 0.20.2 NN host below is hadoop08 2NN is hadoop07 dfs.http.address is set to hadoop08:50070 2011-01-05 11:20:47,603 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Number of transactions: 0 Total time for transactions(ms): 0Number of transactions batched in Syncs: 0 Number of syncs: 0 SyncTimes(ms): 0 2011-01-05 11:20:47,605 INFO org.apache.hadoop.hdfs.server.common.Storage: Completing previous checkpoint for storage directory /tmp/hadoop-admin/dfs/namesecondary. 2011-01-05 11:20:47,741 INFO org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode: Downloaded file fsimage size 13174593 bytes. 2011-01-05 11:20:47,744 INFO org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode: Downloaded file edits size 86299 bytes. 2011-01-05 11:20:47,768 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: fsOwner=admin,users,admin 2011-01-05 11:20:47,768 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: supergroup=supergroup 2011-01-05 11:20:47,768 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: isPermissionEnabled=true 2011-01-05 11:20:47,853 INFO org.apache.hadoop.hdfs.server.common.Storage: Number of files = 98313 2011-01-05 11:20:48,534 INFO org.apache.hadoop.hdfs.server.common.Storage: Number of files under construction = 0 2011-01-05 11:20:48,550 INFO org.apache.hadoop.hdfs.server.common.Storage: Edits file /tmp/hadoop-admin/dfs/namesecondary/current/edits of size 86299 edits # 851 loaded in 0 seconds. 2011-01-05 11:20:48,718 INFO org.apache.hadoop.hdfs.server.common.Storage: Image file of size 13200553 saved in 0 seconds. 2011-01-05 11:20:48,720 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Number of transactions: 0 Total time for transactions(ms): 0Number of transactions batched in Syncs: 0 Number of syncs: 0 SyncTimes(ms): 0 2011-01-05 11:20:48,742 INFO org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode: Posted URL hadoop08:50070putimage=1&port=50090&machine=10.90.37.13&token=-18:130391589:0:1294242715000:1294242381014 2011-01-05 11:20:48,749 ERROR org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode: Exception in doCheckpoint: 2011-01-05 11:20:48,749 ERROR org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode: java.io.FileNotFoundException: http://hadoop08:50070/getimage?putimage=1&port=50090&machine=10.1.1.5&token=-18:130391589:0:1294242715000:1294242381014 at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1311) at org.apache.hadoop.hdfs.server.namenode.TransferFsImage.getFileClient(TransferFsImage.java:151) at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.putFSImage(SecondaryNameNode.java:280) at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:320) at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:225) at java.lang.Thread.run(Thread.java:619) --------------------------------------------------------------------- This transmission (including any attachments) may contain confidential information, privileged material (including material protected by the solicitor-client or other applicable privileges), or constitute non-public information. Any use of this information by anyone other than the intended recipient is prohibited. If you have received this transmission in error, please immediately reply to the sender and delete this information from your system. Use, dissemination, distribution, or reproduction of this transmission by unintended recipients is not authorized and may be unlawful.
