Hi all: We applied hadoop/hbase for NLP analysis and intermediate data storage, and encountered a string of problems when the data scale is up.
Attached is a region server log that shows how it crashed after running a mapreduce task with intensive read/writes. The FATAL error seems to occur at the following line: "2010-07-13 18:02:56,723 FATAL org.apache.hadoop.hbase.regionserver.MemcacheFlusher: Replay of hlog required. Forcing server shutdown" But before this, there are many warning or errors on reading/creating new blocks. We have been struggling on this for a while, but could not identify how to fix the problem. Wonder if anybody can help us take a look at the log and check out the problem? Thanks in advance. Best, Arber
