[
https://issues.apache.org/jira/browse/HBASE-10888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13958503#comment-13958503
]
stack commented on HBASE-10888:
-------------------------------
Another test with more log files where I evened the count of regionservers has
the two log splitting systems at about the same with DLR coming in just
slightly faster:
{code}
2014-04-02 09:42:57,017 INFO [main-EventThread] zookeeper.RegionServerTracker:
RegionServer ephemeral node deleted, processing expiration
[c2024.halxg.cloudera.com,60020,1396454105817]
2014-04-02 09:43:08,559 INFO [MASTER_SERVER_OPERATIONS-c2020:60000-4]
master.SplitLogManager: finished splitting (more than or equal to) 4358519947
bytes in 34 log files in
[hdfs://c2020.halxg.cloudera.com:8020/hbase/WALs/c2024.halxg.cloudera.com,60020,1396454105817-splitting]
in 11513ms
2014-04-02 09:43:10,900 INFO [AM.ZK.Worker-pool2-t88] master.RegionStates:
Onlined a6b2b9160737269b9a745cd58e9c5112 on
c2023.halxg.cloudera.com,60020,1396454098240
{code}
End-to-end DLR
{code}
2014-04-02 21:02:24,015 INFO [main-EventThread] zookeeper.RegionServerTracker:
RegionServer ephemeral node deleted, processing expiration
[c2023.halxg.cloudera.com,16020,1396482188465]
2014-04-02 21:02:37,499 INFO [M_LOG_REPLAY_OPS-c2020:16020-1]
master.SplitLogManager: finished splitting (more than or equal to) 4180462510
bytes in 33 log files in
[hdfs://c2020.halxg.cloudera.com:8020/hbase/WALs/c2023.halxg.cloudera.com,16020,1396482188465-splitting]
in 12645ms
2014-04-02 21:02:37,499 INFO [M_LOG_REPLAY_OPS-c2020:16020-1]
master.DeadServer: Finished processing
c2023.halxg.cloudera.com,16020,1396482188465
{code}
13.5 vs 13.9seconds.
Its only 7 regions. Is that why we don't see much difference in the timings
[~jeffreyz]? DLR does less work and facilitates further improvement in MTTR so
should go in.
Need a +1.
> Enable distributed log replay as default
> ----------------------------------------
>
> Key: HBASE-10888
> URL: https://issues.apache.org/jira/browse/HBASE-10888
> Project: HBase
> Issue Type: Sub-task
> Reporter: stack
> Assignee: stack
> Attachments: 10888.txt, 10888v2.txt, 10888v2.txt, 10888v2.txt,
> 10888v3.txt
>
>
> Enable 'distributed log replay' by default. Depends on hfilev3 being enabled.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
