I'm using Hadoop 0.19.2. It seems HDFS has lost a block, but I'm not able to figure out which file is associated with it.
-- This is the error 2010-09-19 00:31:30,227 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: commitBlockSynchronization(lastblock=blk_2691602201169754299_6824341, newgenerationstamp=0, newlength=0, newtargets=[], closeFile=false, deleteBlock=true) 2010-09-19 00:31:30,227 INFO org.apache.hadoop.ipc.Server: IPC Server handler 7 on 54310, call commitBlockSynchronization(blk_2691602201169754299_6824341, 0, 0, false, true, [Lorg.apache.hadoop.hdfs.protocol.DatanodeID;@1c898b41) from 192.168.33.144:34955: error: java.io.IOException: Block (=blk_2691602201169754299_6824341) not found java.io.IOException: Block (=blk_2691602201169754299_6824341) not found at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.commitBlockSynchronization(FSNamesystem.java:1913) at org.apache.hadoop.hdfs.server.namenode.NameNode.commitBlockSynchronization(NameNode.java:410) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:481) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:894) -- This returns nothing bin/hadoop fsck / -files -blocks -locations | grep blk_2691602201169754299_6824341 How is it that fsck doesn't know about the missing block? How should this be addressed?
