[jira] [Updated] (HBASE-8966) Add YCSB-like summary statistics to LoadTestTool
[ https://issues.apache.org/jira/browse/HBASE-8966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Purtell updated HBASE-8966: -- Attachment: 8966-0.94.patch Here's an updated patch for 0.94 where the reader and writer thread pools keep separate reservoir samples using an array of AtomicLongs and then reply them into DescriptiveStatistics at the end for printing. Just messing around, don't take it too seriously. Add YCSB-like summary statistics to LoadTestTool Key: HBASE-8966 URL: https://issues.apache.org/jira/browse/HBASE-8966 Project: HBase Issue Type: Improvement Components: test Reporter: Andrew Purtell Priority: Trivial Attachments: 8966-0.94.patch, 8966-0.94.patch, 8966.patch LoadTestTool does not provide summary statistics after completion. Provide them. Make them similar to YCSB summary output for post parsing convenience. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-8966) Add YCSB-like summary statistics to LoadTestTool
[
https://issues.apache.org/jira/browse/HBASE-8966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Purtell updated HBASE-8966:
--
Attachment: 8966-0.94.patch
8966.patch
Learned about DescriptiveStatistics in commons-math thanks to
IntegrationTestMTTR, here's a trivial patch that uses it to provide YCSB-like
summary statistics after a LoadTestTool run. They look like:
{noformat}
[OVERALL], success, true
[OVERALL], runtime (ms), 51125
[OVERALL], throughput (ops/sec), 5752
[R], operations, 187787
[R], average latency (ms), 2.525920324622255
[R], min latency (ms), 0.0
[R], max latency (ms), 428.0
[R], 90% latency (ms), 4.0
[R], 95% latency (ms), 6.0
[R], 99% latency (ms), 16.0
[R], 99.9% latency (ms), 40.0
[W], operations, 105607
[W], average latency (ms), 4.751588436374124
[W], min latency (ms), 0.0
[W], max latency (ms), 468.0
[W], 90% latency (ms), 7.0
[W], 95% latency (ms), 12.0
[W], 99% latency (ms), 25.0
[W], 99.9% latency (ms), 48.0
{noformat}
Add YCSB-like summary statistics to LoadTestTool
Key: HBASE-8966
URL: https://issues.apache.org/jira/browse/HBASE-8966
Project: HBase
Issue Type: Improvement
Components: test
Affects Versions: 0.98.0, 0.95.2, 0.94.10
Reporter: Andrew Purtell
Assignee: Andrew Purtell
Priority: Trivial
Attachments: 8966-0.94.patch, 8966.patch
LoadTestTool does not provide summary statistics after completion. Provide
them. Make them similar to YCSB summary output for post parsing convenience.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-8966) Add YCSB-like summary statistics to LoadTestTool
[ https://issues.apache.org/jira/browse/HBASE-8966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Purtell updated HBASE-8966: -- Status: Patch Available (was: Open) Add YCSB-like summary statistics to LoadTestTool Key: HBASE-8966 URL: https://issues.apache.org/jira/browse/HBASE-8966 Project: HBase Issue Type: Improvement Components: test Affects Versions: 0.98.0, 0.95.2, 0.94.10 Reporter: Andrew Purtell Assignee: Andrew Purtell Priority: Trivial Attachments: 8966-0.94.patch, 8966.patch LoadTestTool does not provide summary statistics after completion. Provide them. Make them similar to YCSB summary output for post parsing convenience. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-8966) Add YCSB-like summary statistics to LoadTestTool
[ https://issues.apache.org/jira/browse/HBASE-8966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Purtell updated HBASE-8966: -- Affects Version/s: (was: 0.94.10) (was: 0.98.0) (was: 0.95.2) Assignee: (was: Andrew Purtell) bq. From the doc: Neither DescriptiveStatistics nor SummaryStatistics is thread-safe. Thanks, originally I had synchronized blocks around the updates but removed them. Seems the version of the patch I put up is missing that todo, sorry about that. bq. Last time, I checked DescriptiveStats, I remember being concerned about it's performance. Yeah, so then I'm going to remove the fix versions and just leave this hanging around, because I can see this is going to be more involved than I want to invest time in. Add YCSB-like summary statistics to LoadTestTool Key: HBASE-8966 URL: https://issues.apache.org/jira/browse/HBASE-8966 Project: HBase Issue Type: Improvement Components: test Reporter: Andrew Purtell Priority: Trivial Attachments: 8966-0.94.patch, 8966.patch LoadTestTool does not provide summary statistics after completion. Provide them. Make them similar to YCSB summary output for post parsing convenience. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-8966) Add YCSB-like summary statistics to LoadTestTool
[ https://issues.apache.org/jira/browse/HBASE-8966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Purtell updated HBASE-8966: -- Status: Open (was: Patch Available) Add YCSB-like summary statistics to LoadTestTool Key: HBASE-8966 URL: https://issues.apache.org/jira/browse/HBASE-8966 Project: HBase Issue Type: Improvement Components: test Reporter: Andrew Purtell Priority: Trivial Attachments: 8966-0.94.patch, 8966.patch LoadTestTool does not provide summary statistics after completion. Provide them. Make them similar to YCSB summary output for post parsing convenience. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
