Looks like happybase has tuned down the retries. Is that possible? It says: Failed 1 action: IOException: 1 time. Can you up the retry count? Client probably needs to ride over a region split or some such.
St.Ack On Wed, Dec 23, 2015 at 9:47 AM, Kumiko Yada <[email protected]> wrote: > It's crashing in the lib. > > happybase.hbase.ttypes.IOError: > IOError(_message='org.apache.hadoop.hbase.client.RetriesExhaustedWithDetailsException: > Failed 1 action: IOException: 1 time, \n\tat > org.apache.hadoop.hbase.client.AsyncProcess$BatchErrors.makeException(AsyncProcess.java:227)\n\tat > org.apache.hadoop.hbase.client.AsyncProcess$BatchErrors.access$1700(AsyncProcess.java:207)\n\tat > org.apache.hadoop.hbase.client.AsyncProcess.waitForAllPreviousOpsAndReset(AsyncProcess.java:1658)\n\tat > org.apache.hadoop.hbase.client.BufferedMutatorImpl.backgroundFlushCommits(BufferedMutatorImpl.java:208)\n\tat > org.apache.hadoop.hbase.client.BufferedMutatorImpl.flush(BufferedMutatorImpl.java:183)\n\tat > org.apache.hadoop.hbase.client.HTable.flushCommits(HTable.java:1496)\n\tat > org.apache.hadoop.hbase.client.HTable.put(HTable.java:1119)\n\tat > org.apache.hadoop.hbase.thrift.ThriftServerRunner$HBaseHandler.mutateRowsTs(ThriftServerRunner.java:1324)\n\tat > org.apache.hadoop.hbase.thrift.ThriftServerRunner$HBaseHandler.mutateRows(ThriftServerRunner.java:1270)\n\tat > sun.reflect.GeneratedMethodAccessor1.invoke(Unknown Source)\n\tat > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n\tat > java.lang.reflect.Method.invoke(Method.java:606)\n\tat > org.apache.hadoop.hbase.thrift.HbaseHandlerMetricsProxy.invoke(HbaseHandlerMetricsProxy.java:67)\n\tat > com.sun.proxy.$Proxy13.mutateRows(Unknown Source)\n\tat > org.apache.hadoop.hbase.thrift.generated.Hbase$Processor$mutateRows.getResult(Hbase.java:4386)\n\tat > org.apache.hadoop.hbase.thrift.generated.Hbase$Processor$mutateRows.getResult(Hbase.java:4370)\n\tat > org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)\n\tat > org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)\n\tat > org.apache.hadoop.hbase.thrift.TBoundedThreadPoolServer$ClientConnnection.run(TBoundedThreadPoolServer.java:289)\n\tat > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)\n\tat > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)\n\tat > java.lang.Thread.run(Thread.java:745)\n') > > -----Original Message----- > From: [email protected] [mailto:[email protected]] On Behalf Of Stack > Sent: Tuesday, December 22, 2015 1:07 PM > To: Hbase-User <[email protected]> > Subject: Re: Put performance test > > Why the crash? Is it in the library or hbase? > Thanks, > St.Ack > > On Tue, Dec 22, 2015 at 11:00 AM, Kumiko Yada <[email protected]> > wrote: > > > Hello, > > > > I wrote the python script w/ happybase library to do the performance > > put test; however, this library is crashing when more than 900000 rows > > are put. I'd like to do 1/10/100 million rows put tests. Is there > > any tool that I can use for this? > > > > Thanks > > Kumiko > > >
