[
https://issues.apache.org/jira/browse/HBASE-16890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15638206#comment-15638206
]
stack commented on HBASE-16890:
-------------------------------
{code}
-- Histograms ------------------------------------------------------------------
org.apache.hadoop.hbase.wal.WALPerformanceEvaluation.latencyHistogram.nanos
count = 2101170
min = 460988
max = 179884304
mean = 5793567.54
stddev = 19665482.79
median = 2129343.00
75% <= 2639978.00
95% <= 7591455.00
98% <= 106766212.00
99% <= 120363544.00
99.9% <= 179884304.00
org.apache.hadoop.hbase.wal.WALPerformanceEvaluation.syncCountHistogram.countPerSync
count = 283081
min = 0
max = 16
mean = 6.46
stddev = 4.28
median = 8.00
75% <= 10.00
95% <= 12.00
98% <= 13.00
99% <= 14.00
99.9% <= 16.00
org.apache.hadoop.hbase.wal.WALPerformanceEvaluation.syncHistogram.nanos-between-syncs
count = 283083
min = 747201
max = 179577999
mean = 5808497.64
stddev = 20550849.80
median = 1919769.00
75% <= 2594564.00
95% <= 6725774.00
98% <= 104668538.00
99% <= 126351306.00
99.9% <= 179577999.00
-- Meters ----------------------------------------------------------------------
org.apache.hadoop.hbase.wal.WALPerformanceEvaluation.appendMeter.bytes
count = 14690526510
mean rate = 69331875.36 events/second
1-minute rate = 40171021.67 events/second
5-minute rate = 73866875.49 events/second
15-minute rate = 83653584.79 events/second
org.apache.hadoop.hbase.wal.WALPerformanceEvaluation.syncMeter.syncs
count = 283104
mean rate = 1336.08 events/second
1-minute rate = 780.51 events/second
5-minute rate = 1324.92 events/second
15-minute rate = 1452.57 events/second
{code}
Looks like FSHLog is aggregating more syncs per actual sync.... 21 vs 6.5
> Analyze the performance of AsyncWAL and fix the same
> ----------------------------------------------------
>
> Key: HBASE-16890
> URL: https://issues.apache.org/jira/browse/HBASE-16890
> Project: HBase
> Issue Type: Sub-task
> Components: wal
> Affects Versions: 2.0.0
> Reporter: ramkrishna.s.vasudevan
> Assignee: ramkrishna.s.vasudevan
> Fix For: 2.0.0
>
> Attachments: AsyncWAL_disruptor.patch, AsyncWAL_disruptor_1
> (2).patch, AsyncWAL_disruptor_3.patch, AsyncWAL_disruptor_3.patch,
> AsyncWAL_disruptor_4.patch, AsyncWAL_disruptor_6.patch,
> HBASE-16890-rc-v2.patch, HBASE-16890-rc-v3.patch,
> HBASE-16890-remove-contention-v1.patch, HBASE-16890-remove-contention.patch,
> Screen Shot 2016-10-25 at 7.34.47 PM.png, Screen Shot 2016-10-25 at 7.39.07
> PM.png, Screen Shot 2016-10-25 at 7.39.48 PM.png, Screen Shot 2016-11-04 at
> 5.21.27 PM.png, Screen Shot 2016-11-04 at 5.30.18 PM.png, async.svg,
> classic.svg, contention.png, contention_defaultWAL.png
>
>
> Tests reveal that AsyncWAL under load in single node cluster performs slower
> than the Default WAL. This task is to analyze and see if we could fix it.
> See some discussions in the tail of JIRA HBASE-15536.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
