[
https://issues.apache.org/jira/browse/HBASE-26874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17751649#comment-17751649
]
Bryan Beaudreault commented on HBASE-26874:
-------------------------------------------
Accidentally committed without the Jira ID. Pushed a revert and re-commit with
that fixed, in both branches.
> VerifyReplication recompare async
> ---------------------------------
>
> Key: HBASE-26874
> URL: https://issues.apache.org/jira/browse/HBASE-26874
> Project: HBase
> Issue Type: Improvement
> Reporter: Bryan Beaudreault
> Assignee: Hernan Gelaf-Romer
> Priority: Major
> Fix For: 2.6.0, 3.0.0-beta-1
>
>
> VerifyReplication includes an option "sleepMsBeforeReCompare". This is useful
> for helping work around replication lag. However, adding a sleep in a hadoop
> job can drastically slow that job down if there is anything more than a small
> number of invalid results.
> We can mitigate this by doing the recompare in a separate thread. We can
> limit the thread pool and fallback to doing the recompare in the main thread
> if the thread pool is full. This way we offload some of the slowness but
> still retain the same validation guarantees. A configuration can be added to
> control how many threads per mapper.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
