[ 
https://issues.apache.org/jira/browse/HADOOP-1220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12491761
 ] 

Koji Noguchi commented on HADOOP-1220:
--------------------------------------

bq. This time the block in question does not appear in the dfs data directory.

We've seen both cases.

1) block exist on local dfs dir. 
     Error messages repeats every second.

2) block doesn't exist on local dfs dir.
     Error message only shows up once.


It happened when a large number of files were deleted on the cluster.


> block not found in blockMap
> ---------------------------
>
>                 Key: HADOOP-1220
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1220
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>            Reporter: Koji Noguchi
>
> From Hadoop-973  debug message, we had datanode constantly printing out the 
> following message.
> ...
> 2007-04-02 23:59:50,122 WARN org.apache.hadoop.dfs.DataNode: 
> java.io.IOException: Unexpected error trying to delete block 
> blk_-3400783150525166031. Block not found in blockMap.
>   at org.apache.hadoop.dfs.FSDataset.invalidate(FSDataset.java:596)
>   at org.apache.hadoop.dfs.DataNode.offerService(DataNode.java:460)
>   at org.apache.hadoop.dfs.DataNode.run(DataNode.java:1053)
>   at java.lang.Thread.run(Thread.java:619)
> 2007-04-02 23:59:50,433 INFO org.apache.hadoop.dfs.DataNode: Served block 
> blk_-8672111663356339464 to /72.30.127.164
> 2007-04-02 23:59:52,993 WARN org.apache.hadoop.dfs.DataNode: 
> java.io.IOException: Unexpected error trying to delete block 
> blk_-3400783150525166031. Block not found in blockMap.
>   at org.apache.hadoop.dfs.FSDataset.invalidate(FSDataset.java:596)
>   at org.apache.hadoop.dfs.DataNode.offerService(DataNode.java:460)
>   at org.apache.hadoop.dfs.DataNode.run(DataNode.java:1053)
>   at java.lang.Thread.run(Thread.java:619)
> ....
>  Ten minutes before these logs, there was 
> 2007-04-02 20:42:49,648 INFO org.apache.hadoop.dfs.DataNode: Deleting block 
> blk_-3400783150525166031
> There was a  file for that block in the directory.
> /../../hadoop/dfs/data/data/subdir17/blk_-3400783150525166031

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply via email to