On Mon, Nov 28, 2011 at 12:35 PM, Sujee Maniyam <[email protected]> wrote: > I see the TestTable is created with splits. But when I run 'randomWrite' > test (in MR mode) majority of the 'requests' are going to only one region > server.
One regionserver or one region only? Is your PE2 running as a mapreduce job? Its not running serially is it? (this can happen if it can't find the cluster). What happens if you pass the --nomapred (or whatever the arg is) so you instead run in multithreaded mode? Do you see same thing? St.Ack > Other region servers are busy as well, but catering to small > number of requests. > > See this screen shot: > http://www.sujee.net/tech/hbase-region-server-split2.png > only devperf-sn2 is getting most of the requests (~20k). Other RS are > only getting a few hundred requests. > > This is on : Hbase 0.90.4 cdh3u2 > > I'd like some feedback on why this is happening. > > The code is here: http://pastebin.com/N18jWV4Q > notable changes : > - line 471 : checktable > - line 509 : getSplits > > jar : http://www.sujee.net/tech/sujee.jar > > how to reproduce: > > 1) Have sujee.jar in HBASE_CLASSPATH. > One approach is to put 'sujee.jar' in hbase/lib dir and restarting Hbase. > > 2) run > hbase org.apache.hadoop.hbase.PerformanceEvaluation2 --presplit=10 > randomWrite 10 > > - I have made a a copy of 'Performance Evaluation' class for easy testing > - presplit option takes a number (splits) > > 3) watch the requests on HBase Master UI > > thanks very much > Sujee > http://sujee.net >
