Hey Stack, I tried the following command:
hadoop-0.20.0/bin/hadoop jar hbase-0.20.0/hbase-0.20.0-test.jar randomWrite
10
running a map/reduce job, it failed with the following exceptions in each
node:
org.apache.hadoop.hbase.client.RetriesExhaustedException: Trying to contact
region server Some server for region , row '0001753186', but failed after 11
attempts.
Exceptions:
org.apache.hadoop.hbase.client.RegionOfflineException: region offline:
TestTable,0001749889,1250092414985
org.apache.hadoop.hbase.client.RegionOfflineException: region offline:
TestTable,0001749889,1250092414985
org.apache.hadoop.hbase.client.RegionOfflineException: region offline:
TestTable,0001749889,1250092414985
org.apache.hadoop.hbase.client.RegionOfflineException: region offline:
TestTable,0001749889,1250092414985
org.apache.hadoop.hbase.client.RegionOfflineException: region offline:
TestTable,0001749889,1250092414985
org.apache.hadoop.hbase.client.RegionOfflineException: region offline:
TestTable,0001749889,1250092414985
org.apache.hadoop.hbase.client.RegionOfflineException: region offline:
TestTable,0001749889,1250092414985
org.apache.hadoop.hbase.client.RegionOfflineException: region offline:
TestTable,0001749889,1250092414985
org.apache.hadoop.hbase.client.RegionOfflineException: region offline:
TestTable,0001749889,1250092414985
org.apache.hadoop.hbase.client.RegionOfflineException: region offline:
TestTable,0001749889,1250092414985
at
org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getRegionLocationForRowWithRetries(HConnectionManager.java:995)
at
org.apache.hadoop.hbase.client.HConnectionManager$TableServers.processBatchOfRows(HConnectionManager.java:1025)
at org.apache.hadoop.hbase.client.HTable.flushCommits(HTable.java:584)
at org.apache.hadoop.hbase.client.HTable.put(HTable.java:450)
at
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest.testRow(PerformanceEvaluation.java:497)
at
org.apache.hadoop.hbase.PerformanceEvaluation$Test.test(PerformanceEvaluation.java:406)
at
org.apache.hadoop.hbase.PerformanceEvaluation.runOneClient(PerformanceEvaluation.java:627)
at
org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:194)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:356)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
================================================================
This appears to be this issue:
http://issues.apache.org/jira/browse/HBASE-1603
Has this been fixed in .20? Thanks.
stack-3 wrote:
>
> On Wed, Aug 12, 2009 at 8:58 AM, llpind <[email protected]> wrote:
>
>>
>> Playing with the HBase perfomanceEval Class, but it seems to take a long
>> time to run “sequentialWrite 2” (~20 minutes). If I simply emulate 1
>> clients in a simple program, I can do 1 Million Puts in about 3 minutes
>> (non
>> mapred). The sequential write is writing 2 million with 2 clients.
>> Please
>> help in understanding how to use the performanceEvaluation Class.
>>
>
> If the number of clients is > 1, unless you add the '--nomapred' (sp?)
> argument, PE launches a mapreduce program of N tasks. Each task puts up a
> client writing 1M rows (IIRC). Try N where N == number_of_map_slots and
> see
> what that does? N == 2 probably won't tell you much. You could also set
> an
> N > 1 and use the '--nomapred'. This will run PE clients in a distinct
> thread. For small numbers of N, this can put up heavier loading than MR
> with its setup and teardown cost.
>
> St.Ack
>
>
--
View this message in context:
http://www.nabble.com/HBase-in-a-real-world-application-tp24920888p24975031.html
Sent from the HBase User mailing list archive at Nabble.com.
