All writes seem to go to a single Region. I set 'hbase.hregion.max.filesize'
to 64MB. Here is the log from the Region that failed:
3125568883
2009-05-23 20:38:26,370 WARN org.apache.hadoop.hbase.util.Sleeper: We slept
55828ms, ten times longer than scheduled: 3000
2009-05-23 20:38:37,551 WARN org.apache.hadoop.hdfs.DFSClient:
DFSOutputStream ResponseProcessor exception for block
blk_6077654540841025168_2014java.net.SocketTimeoutException: 66000 millis
timeout while waiting for channel to be ready for read. ch :
java.nio.channels.SocketChannel[connected local=/192.168.240.180:53831
remote=/192.168.240.180:50010]
at
org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:162)
at
org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:150)
at
org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:123)
at java.io.DataInputStream.readFully(DataInputStream.java:178)
at java.io.DataInputStream.readLong(DataInputStream.java:399)
at
org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$ResponseProcessor.run(DFSClient.java:2318)
2009-05-23 20:39:18,526 WARN org.apache.hadoop.hdfs.DFSClient: Error
Recovery for block blk_6077654540841025168_2014 bad datanode[0]
192.168.240.180:50010
2009-05-23 20:39:18,526 WARN org.apache.hadoop.hdfs.DFSClient: Error
Recovery for block blk_6077654540841025168_2014 in pipeline
192.168.240.180:50010, 192.168.240.179:50010: bad datanode
192.168.240.180:50010
2009-05-23 20:39:40,708 WARN org.apache.hadoop.hdfs.DFSClient: Error
Recovery for block blk_6077654540841025168_2014 failed because recovery
from primary datanode 192.168.240.179:50010 failed 1 times. Will retry...
2009-05-23 20:39:40,718 WARN org.apache.hadoop.hdfs.DFSClient: Error
Recovery for block blk_6077654540841025168_2014 bad datanode[0]
192.168.240.180:50010
2009-05-23 20:39:40,718 WARN org.apache.hadoop.hdfs.DFSClient: Error
Recovery for block blk_6077654540841025168_2014 in pipeline
192.168.240.180:50010, 192.168.240.179:50010: bad datanode
192.168.240.180:50010
--
View this message in context:
http://www.nabble.com/HBase-looses-regions.-tp23657983p23690429.html
Sent from the HBase User mailing list archive at Nabble.com.
