[
https://issues.apache.org/jira/browse/HBASE-21806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sergey Shelukhin updated HBASE-21806:
-------------------------------------
Release Note: HBase RS will now roll the WAL file upon a slow sync call.
hbase.regionserver.hlog.roll.on.sync.ms config has been added to HBase, with
the default value of 10000 (10 seconds); if a sync of the WAL takes longer than
that the file will be replaced under the assumption that we will get a faster
datanode pipeline for a new file. This setting works with an existing timeout
setting that will still kick in on very long syncs (5 minutes by default) and
fail the operation.
> add an option to roll WAL on very slow syncs
> --------------------------------------------
>
> Key: HBASE-21806
> URL: https://issues.apache.org/jira/browse/HBASE-21806
> Project: HBase
> Issue Type: Improvement
> Reporter: Sergey Shelukhin
> Assignee: Sergey Shelukhin
> Priority: Major
> Fix For: 3.0.0
>
> Attachments: HBASE-21806.patch
>
>
> In large heterogeneous clusters sometimes a slow datanode can cause WAL syncs
> to be very slow. In this case, before the bad datanode recovers, or is
> discovered and repaired, it would be helpful to roll WAL on a very slow sync
> to get a new pipeline.
> Otherwise the slow WAL will impact write latency for a long time (slow writes
> result in less writes result in the WAL not being rolled for longer)
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)