Jamie, Does your configuration meets the requirements? http://hbase.apache.org/docs/r0.20.5/api/overview-summary.html#requirements
ulimit and xcievers, if not set, are usually time bombs that blow off when the cluster is under load. J-D On Wed, Jul 7, 2010 at 9:11 AM, Jamie Cockrill <[email protected]>wrote: > Dear all, > > My current HBase/Hadoop architecture has HBase region servers on the > same physical boxes as the HDFS data-nodes. I'm getting an awful lot > of region server crashes. The last thing that happens appears to be a > DroppedSnapshot Exception, caused by an IOException: could not > complete write to file <file on HDFS>. I am running it under load, how > heavy that is I'm not sure how that is quantified, but I'm guessing it > is a load issue. > > Is it common practice to put region servers on data-nodes? Is it > common to see region server crashes when either the HDFS or region > server (or both) is under heavy load? I'm guessing that is the case as > I've seen a few similar posts. I've not got a great deal of capacity > to be separating region servers from HDFS data nodes, but it might be > an argument I could make. > > Thanks > > Jamie >
