[
https://issues.apache.org/jira/browse/HBASE-14869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046758#comment-15046758
]
Vikas Vishwakarma commented on HBASE-14869:
-------------------------------------------
I deployed it to a cluster and did a quick run using a loader, sample
distribution given below:
"ResponseSize_min" : 2,
"ResponseSize_max" : 8095877,
"ResponseSize_mean" : 160129.16119263918,
"ResponseSize_median" : 44676.0,
"ResponseSize_75th_percentile" : 44676.0,
"ResponseSize_90th_percentile" : 44676.0,
"ResponseSize_95th_percentile" : 44676.0,
"ResponseSize_99th_percentile" : 8083077.0,
"ResponseSize_SizeRangeCount_0-10" : 5,
"ResponseSize_SizeRangeCount_10-100" : 2,
"ResponseSize_SizeRangeCount_100-1000" : 205,
"ResponseSize_SizeRangeCount_10000-100000" : 4018,
"ResponseSize_SizeRangeCount_1000000-10000000" : 63,
----
"RequestSize_min" : 61,
"RequestSize_max" : 1785561,
"RequestSize_mean" : 1779622.1719077567,
"RequestSize_median" : 1785559.0,
"RequestSize_75th_percentile" : 1785559.0,
"RequestSize_90th_percentile" : 1785561.0,
"RequestSize_95th_percentile" : 1785561.0,
"RequestSize_99th_percentile" : 1785561.0,
"RequestSize_SizeRangeCount_10-100" : 3,
"RequestSize_SizeRangeCount_100-1000" : 4,
"RequestSize_SizeRangeCount_1000000-10000000" : 4286,
---
"AppendSize_min" : 301,
"AppendSize_max" : 1606400,
"AppendSize_mean" : 1600143.9756582216,
"AppendSize_median" : 1606400.0,
"AppendSize_75th_percentile" : 1606400.0,
"AppendSize_90th_percentile" : 1606400.0,
"AppendSize_95th_percentile" : 1606400.0,
"AppendSize_99th_percentile" : 1606400.0,
"AppendSize_SizeRangeCount_100-1000" : 8,
"AppendSize_SizeRangeCount_1000000-10000000" : 4018,
----
"ProcessCallTime_min" : 0,
"ProcessCallTime_max" : 2577,
"ProcessCallTime_mean" : 153.72955974842768,
"ProcessCallTime_median" : 74.5,
"ProcessCallTime_75th_percentile" : 110.0,
"ProcessCallTime_90th_percentile" : 251.49999999999977,
"ProcessCallTime_95th_percentile" : 534.6499999999999,
"ProcessCallTime_99th_percentile" : 1313.2399999999998,
"ProcessCallTime_TimeRangeCount_0-1" : 204,
"ProcessCallTime_TimeRangeCount_1-3" : 3,
"ProcessCallTime_TimeRangeCount_3-10" : 2,
"ProcessCallTime_TimeRangeCount_10-30" : 2,
"ProcessCallTime_TimeRangeCount_30-100" : 2914,
"ProcessCallTime_TimeRangeCount_100-300" : 715,
"ProcessCallTime_TimeRangeCount_300-1000" : 310,
"ProcessCallTime_TimeRangeCount_1000-3000" : 143,
------
"AppendTime_min" : 0,
"AppendTime_max" : 1,
"AppendTime_mean" : 0.00273224043715847,
"AppendTime_median" : 0.0,
"AppendTime_75th_percentile" : 0.0,
"AppendTime_90th_percentile" : 0.0,
"AppendTime_95th_percentile" : 0.0,
"AppendTime_99th_percentile" : 0.0,
"AppendTime_TimeRangeCount_0-1" : 4026
-----
"Mutate_min" : 32,
"Mutate_max" : 2575,
"Mutate_mean" : 160.91325655476598,
"Mutate_median" : 75.5,
"Mutate_75th_percentile" : 110.0,
"Mutate_90th_percentile" : 258.5999999999999,
"Mutate_95th_percentile" : 558.549999999999,
"Mutate_99th_percentile" : 1312.1799999999998,
"Mutate_TimeRangeCount_30-100" : 2926,
"Mutate_TimeRangeCount_100-300" : 703,
"Mutate_TimeRangeCount_300-1000" : 309,
"Mutate_TimeRangeCount_1000-3000" : 143,
----
"SplitTime_min" : 72,
"SplitTime_max" : 11320,
"SplitTime_mean" : 7276.5,
"SplitTime_median" : 8857.0,
"SplitTime_75th_percentile" : 10892.0,
"SplitTime_90th_percentile" : 11320.0,
"SplitTime_95th_percentile" : 11320.0,
"SplitTime_99th_percentile" : 11320.0,
"SplitTime_TimeRangeCount_30-100" : 1,
"SplitTime_TimeRangeCount_3000-10000" : 2,
"SplitTime_TimeRangeCount_10000-30000" : 1
----
> Better request latency histograms
> ---------------------------------
>
> Key: HBASE-14869
> URL: https://issues.apache.org/jira/browse/HBASE-14869
> Project: HBase
> Issue Type: Brainstorming
> Reporter: Lars Hofhansl
> Assignee: Vikas Vishwakarma
> Fix For: 2.0.0, 1.3.0, 0.98.17
>
> Attachments: 14869-test-0.98.txt, 14869-v1-0.98.txt,
> 14869-v1-2.0.txt, 14869-v2-0.98.txt, 14869-v2-2.0.txt, 14869-v3-0.98.txt,
> 14869-v4-0.98.txt, 14869-v5-0.98.txt, AppendSizeTime.png, Get.png
>
>
> I just discussed this with a colleague.
> The get, put, etc, histograms that each region server keeps are somewhat
> useless (depending on what you want to achieve of course), as they are
> aggregated and calculated by each region server.
> It would be better to record the number of requests in certainly latency
> bands in addition to what we do now.
> For example the number of gets that took 0-5ms, 6-10ms, 10-20ms, 20-50ms,
> 50-100ms, 100-1000ms, > 1000ms, etc. (just as an example, should be
> configurable).
> That way we can do further calculations after the fact, and answer questions
> like: How often did we miss our SLA? Percentage of requests that missed an
> SLA, etc.
> Comments?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
