[
https://issues.apache.org/jira/browse/HBASE-9676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13782215#comment-13782215
]
Nicolas Liochon commented on HBASE-9676:
----------------------------------------
bq. Why did you remove the 'force' option?
Actually, this method was always called with force as true. There are two
methods: one w/o force, once w/ force.
bq. Nit: the new value for START_LOG_ERRORS_CNT is 4, not 3. Was this
intentional?
I may have a bug here: I want to log the retries > 3 and log the sucess > 4.
This way if I log an error I will also log the result of the next attempt.
bq. I see nbRegion never crossed your mind
For sure :-)
bq. Is the test failure related?
I don't thinks so. I will retry locally.
bq. I suppose per-server limit makes sense. 5 outstanding requests seems low
though. 10?
I will double check the code, but the intent is to have by default:
- we contact at most 100 servers
- we don't send more then 1 request per region
- we don't send more than different 5 requests to the same region servers (but
a single request can be about 20 different regions). So with 5 we're already
taking 5 handlers out of the 30.
As well, if we reach the limit per region or per region server, we still send
the puts to the other region servers, until we reach the global limit of 100.
So we will be able to customize a lot the behavior of the client (for example a
map reduce client could be limited to one request per region server).
I will double check all this and commit tomorrow morning my time if it's
trivial. Thanks for the reviews, Nick and Stack.
> AsyncProcess can create more tasks than hbase.client.max.total.tasks
> --------------------------------------------------------------------
>
> Key: HBASE-9676
> URL: https://issues.apache.org/jira/browse/HBASE-9676
> Project: HBase
> Issue Type: Bug
> Components: Client
> Affects Versions: 0.98.0, 0.96.0
> Reporter: Nicolas Liochon
> Assignee: Nicolas Liochon
> Priority: Critical
> Fix For: 0.98.0, 0.96.1
>
> Attachments: 9676.v2.patch
>
>
> hbase.client.max.total.tasks allows to control the number of tasks in
> progress. But when adding tasks, we take only into account the number of
> tasks currently running, not the one we're creating.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
