[ http://issues.apache.org/jira/browse/HADOOP-324?page=comments#action_12418388 ]
Konstantin Shvachko commented on HADOOP-324: -------------------------------------------- The amount of working space to be left on each device is addressed by HADOOP-296 I think that if the disk is full we should just try again. In my experience it was the taskTracker who filled the disk to the capacity. There night be other programs that write temporary data into disk and then remove it. The data node should not shutdown itself anyway, it might be useful for something anyways. > "IOException: No space left on device" is handled incorrectly > ------------------------------------------------------------- > > Key: HADOOP-324 > URL: http://issues.apache.org/jira/browse/HADOOP-324 > Project: Hadoop > Type: Bug > Versions: 0.3.2 > Reporter: Konstantin Shvachko > > When a data node disk is almost full the name node still assigns blocks to > the data node. > By the time the data node actually tries to write that data to disk the disk > may become full. > Current implementation forces the data node to shutdown after that. > The expected behavior is to report the block write failure and continue. > The Exception looks as follows: > java.io.IOException: No space left on device > at java.io.FileOutputStream.writeBytes(Native Method) > at java.io.FileOutputStream.write(FileOutputStream.java:260) > at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:65) > at java.io.BufferedOutputStream.write(BufferedOutputStream.java:109) > at java.io.DataOutputStream.write(DataOutputStream.java:90) > at org.apache.hadoop.dfs.DataNode$DataXceiver.writeBlock(DataNode.java:623) > at org.apache.hadoop.dfs.DataNode$DataXceiver.run(DataNode.java:410) > at java.lang.Thread.run(Thread.java:595) > 2006-06-26 08:26:04,751 INFO org.apache.hadoop.dfs.DataNode: Finishing > DataNode in: /tmp/hadoop/dfs/data/data -- This message is automatically generated by JIRA. - If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa - For more information on JIRA, see: http://www.atlassian.com/software/jira
