[
https://issues.apache.org/jira/browse/HBASE-5782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13256043#comment-13256043
]
stack commented on HBASE-5782:
------------------------------
I made the hlog perf tool work on hdfs and ran some basic tests. Both Todd an
Lars' patches seem faster than what we have currently.
Running w/o a fix on hdfs w/ current trunk I have to disable verify because it
fails (verify happens after we print out test timings).
$ ./bin/hbase
org.apache.hadoop.hbase.regionserver.wal.HLogPerformanceEvaluation -conf
/home/stack/hadoop-conf/core-site.xml -path hdfs://sv4r11s38:7000/tmp -threads
100 -roll 10000
12/04/17 22:58:28 INFO wal.HLogPerformanceEvaluation: Summary: threads=100,
iterations=10000 took 100.630s 9937.395ops/s
12/04/17 23:00:33 INFO wal.HLogPerformanceEvaluation: Summary: threads=100,
iterations=10000 took 94.945s 10532.413ops/s
Todd patch on hdfs:
$ ./bin/hbase
org.apache.hadoop.hbase.regionserver.wal.HLogPerformanceEvaluation -conf
/home/stack/hadoop-conf/core-site.xml -path hdfs://sv4r11s38:7000/tmp -threads
100 -roll 10000 -verify
12/04/17 22:53:35 INFO wal.HLogPerformanceEvaluation: Summary: threads=100,
iterations=10000 took 81.202s 12314.967ops/s
Lars patch:
12/04/17 23:07:08 INFO wal.HLogPerformanceEvaluation: Summary: threads=100,
iterations=10000 took 76.800s 13020.833ops/s
For Todd and Lars, both pass verify which checks that seqids are ordered and
that we wrote as much as we think we did.
> Edits can be appended out of seqid order since HBASE-4487
> ---------------------------------------------------------
>
> Key: HBASE-5782
> URL: https://issues.apache.org/jira/browse/HBASE-5782
> Project: HBase
> Issue Type: Bug
> Components: wal
> Affects Versions: 0.94.0
> Reporter: Gopinathan A
> Assignee: ramkrishna.s.vasudevan
> Priority: Blocker
> Fix For: 0.94.0
>
> Attachments: 5782-lars-v2.txt, 5782-sketch.txt, 5782.txt,
> 5782.unfinished-stack.txt, HBASE-5782.patch, hbase-5782.txt
>
>
> Create a table with 1000 splits, after the region assignemnt, kill the
> regionserver wich contains META table.
> Here few regions are missing after the log splitting and region assigment.
> HBCK report shows multiple region holes are got created.
> Same scenario was verified mulitple times in 0.92.1, no issues.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
