[
https://issues.apache.org/jira/browse/HBASE-15265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15184421#comment-15184421
]
Duo Zhang commented on HBASE-15265:
-----------------------------------
[~stack] I have run a WALPE on a 5 node cluster.
On master branch
{noformat}
-- Histograms ------------------------------------------------------------------
org.apache.hadoop.hbase.wal.WALPerformanceEvaluation.latencyHistogram.nanos
count = 993526
min = 424172
max = 1376267
mean = 491388.58
stddev = 54001.33
median = 483846.00
75% <= 496580.00
95% <= 545363.00
98% <= 588029.00
99% <= 645355.00
99.9% <= 1376267.00
org.apache.hadoop.hbase.wal.WALPerformanceEvaluation.syncCountHistogram.countPerSync
count = 993538
min = 1
max = 1
mean = 1.00
stddev = 0.00
median = 1.00
75% <= 1.00
95% <= 1.00
98% <= 1.00
99% <= 1.00
99.9% <= 1.00
org.apache.hadoop.hbase.wal.WALPerformanceEvaluation.syncHistogram.nanos-between-syncs
count = 993540
min = 390501
max = 1200319
mean = 466742.40
stddev = 41737.18
median = 460329.00
75% <= 473633.00
95% <= 516878.00
98% <= 556977.00
99% <= 610978.00
99.9% <= 821039.00
-- Meters ----------------------------------------------------------------------
org.apache.hadoop.hbase.wal.WALPerformanceEvaluation.appendMeter.bytes
count = 553402337
mean rate = 1045989.09 events/second
1-minute rate = 1087437.57 events/second
5-minute rate = 879784.11 events/second
15-minute rate = 465526.36 events/second
org.apache.hadoop.hbase.wal.WALPerformanceEvaluation.syncMeter.syncs
count = 993546
mean rate = 1877.89 events/second
1-minute rate = 1952.33 events/second
5-minute rate = 1579.51 events/second
15-minute rate = 835.77 events/second
2016-03-08 12:32:15,664 INFO [t0,r0] wal.WALPerformanceEvaluation: t0,r0 took
513.158s 1948.718ops/s
2016-03-08 12:32:15,664 INFO [main] wal.WALPerformanceEvaluation: Summary:
threads=1, iterations=1000000, syncInterval=0 took 513.158s 1948.718ops/s
{noformat}
With the v6 patch and set {{hbase.wal.provider}} to {{asyncfs}}
{noformat}
-- Histograms ------------------------------------------------------------------
org.apache.hadoop.hbase.wal.WALPerformanceEvaluation.latencyHistogram.nanos
count = 942227
min = 178089
max = 16710130
mean = 274607.68
stddev = 707975.65
median = 240741.00
75% <= 251231.00
95% <= 283781.00
98% <= 337094.00
99% <= 460342.00
99.9% <= 16710130.00
org.apache.hadoop.hbase.wal.WALPerformanceEvaluation.syncCountHistogram.countPerSync
count = 942235
min = 1
max = 1
mean = 1.00
stddev = 0.00
median = 1.00
75% <= 1.00
95% <= 1.00
98% <= 1.00
99% <= 1.00
99.9% <= 1.00
org.apache.hadoop.hbase.wal.WALPerformanceEvaluation.syncHistogram.nanos-between-syncs
count = 942241
min = 162382
max = 6048183
mean = 231193.13
stddev = 231598.71
median = 220296.00
75% <= 228857.00
95% <= 264478.00
98% <= 302176.00
99% <= 398986.00
99.9% <= 6048183.00
-- Meters ----------------------------------------------------------------------
org.apache.hadoop.hbase.wal.WALPerformanceEvaluation.appendMeter.bytes
count = 524833250
mean rate = 2011339.83 events/second
1-minute rate = 2168110.13 events/second
5-minute rate = 1203438.51 events/second
15-minute rate = 510366.96 events/second
org.apache.hadoop.hbase.wal.WALPerformanceEvaluation.syncMeter.syncs
count = 942251
mean rate = 3610.95 events/second
1-minute rate = 3892.46 events/second
5-minute rate = 2160.54 events/second
15-minute rate = 916.26 events/second
2016-03-08 12:22:14,850 INFO [t0,r0] wal.WALPerformanceEvaluation: t0,r0 took
254.562s 3928.316ops/s
2016-03-08 12:22:14,850 INFO [main] wal.WALPerformanceEvaluation: Summary:
threads=1, iterations=1000000, syncInterval=0 took 254.562s 3928.316ops/s
{noformat}
Almost the same with your previous test, about 2x faster for singie threaded
test.
3928.316ops/s vs. 1948.718ops/s
> Implement an asynchronous FSHLog
> --------------------------------
>
> Key: HBASE-15265
> URL: https://issues.apache.org/jira/browse/HBASE-15265
> Project: HBase
> Issue Type: Sub-task
> Components: wal
> Reporter: Duo Zhang
> Assignee: Duo Zhang
> Fix For: 2.0.0
>
> Attachments: HBASE-15265-v1.patch, HBASE-15265-v2.patch,
> HBASE-15265-v3.patch, HBASE-15265-v4.patch, HBASE-15265-v5.patch,
> HBASE-15265-v6.patch, HBASE-15265.patch
>
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
