PerformanceEvaluation randomWrite and custom put test

2015-08-13 Thread Serega Sheypak
Hi. I used PerformanceEvaluation randomWrite for perf measurement. Here are my metrics: -- Timers -- .putTimer count = 3944591 mean rate = 12389.71 calls/second 1-minute rate = 8853.79

Re: Spikes when writing data to HBase

2015-08-13 Thread Serega Sheypak
Ok, so I have some problems with put. randomWrite test shows 28K/sec and 4ms response, 99th percentile Mine shows 30ms 99th percentile. I'm doing just htable.put, where Put object is less than 1KB 2015-08-12 9:37 GMT+02:00 Serega Sheypak serega.shey...@gmail.com: I agree. 99% = 112.09

Re: In Windows, cannot capture HBase prompt('hbase(main):001:0') from neither standard output nor standard error using process API

2015-08-13 Thread Ted Yu
I think Dinesh was referring to: http://docs.oracle.com/javase/7/docs/api/java/lang/Process.html Cheers On Thu, Aug 13, 2015 at 3:23 PM, Nick Dimiduk ndimi...@gmail.com wrote: dev to bcc Hi Dinesh, I'm not sure what you mean by process API. Are you launching the hbase shell as an external

Re: In Windows, cannot capture HBase prompt('hbase(main):001:0') from neither standard output nor standard error using process API

2015-08-13 Thread Nick Dimiduk
dev to bcc Hi Dinesh, I'm not sure what you mean by process API. Are you launching the hbase shell as an external process? Would be better to use an HBase client. We have a nice one in Java. We also have REST and Thrift gateways, which are launched as separate processes. There's also Apache

Re: PerformanceEvaluation randomWrite and custom put test

2015-08-13 Thread Vladimir Rodionov
--autoFlush=true is ignored in PE. Make sure you run your own tests with autoFlush= false in HTable. -Vlad On Thu, Aug 13, 2015 at 1:22 AM, Serega Sheypak serega.shey...@gmail.com wrote: Hi. I used PerformanceEvaluation randomWrite for perf measurement. Here are my metrics: -- Timers