[
https://issues.apache.org/jira/browse/HBASE-13460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14493557#comment-14493557
]
Enis Soztutar commented on HBASE-13460:
---------------------------------------
Do we know how come we ended up with a queue of 300? Is it coming from the
client threads or is is 3 * 256 from htable pool threads. We may still want to
bound the max threads to some sane default rather than int max I think. 128
should be fine I think, half of the regular lookup pool. Other than that +1.
> Revise the MetaLookupPool executor-related defaults (introduced in
> HBASE-13036)
> -------------------------------------------------------------------------------
>
> Key: HBASE-13460
> URL: https://issues.apache.org/jira/browse/HBASE-13460
> Project: HBase
> Issue Type: Bug
> Reporter: Devaraj Das
> Assignee: Devaraj Das
> Fix For: 1.1.0
>
> Attachments: 13460-master-1.txt, 13460-master-2.txt
>
>
> The value of the max threads, max tasks, etc. can be improved to not
> unnecessarily reject tasks. In one of our internal tests, we saw tasks
> getting rejected (with the defaults that is currently there in the unpatched
> code):
> {noformat}
> 2015-04-09
> 12:36:34,111|beaver.machine|INFO|15134|140028818736896|MainThread|Caused by:
> java.lang.RuntimeException: java.util.concurrent.RejectedExecutionException:
> Task
> org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture@6658c97b
> rejected from
> java.util.concurrent.ThreadPoolExecutor@5a06eeee[Running, pool size = 3,
> active threads = 3, queued tasks = 300, completed tasks = 0]
> 2015-04-09
> 12:36:34,111|beaver.machine|INFO|15134|140028818736896|MainThread|at
> org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:208)
> 2015-04-09
> 12:36:34,112|beaver.machine|INFO|15134|140028818736896|MainThread|at
> org.apache.hadoop.hbase.client.ClientSmallReversedScanner.next(ClientSmallReversedScanner.java:145)
> 2015-04-09
> 12:36:34,112|beaver.machine|INFO|15134|140028818736896|MainThread|at
> org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegionInMeta(ConnectionManager.java:1246)
> 2015-04-09
> 12:36:34,112|beaver.machine|INFO|15134|140028818736896|MainThread|at
> org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegion(ConnectionManager.java:1152)
> 2015-04-09
> 12:36:34,113|beaver.machine|INFO|15134|140028818736896|MainThread|at
> org.apache.hadoop.hbase.client.AsyncProcess.submit(AsyncProcess.java:370)
> 2015-04-09
> 12:36:34,113|beaver.machine|INFO|15134|140028818736896|MainThread|at
> org.apache.hadoop.hbase.client.AsyncProcess.submit(AsyncProcess.java:321)
> 2015-04-09
> 12:36:34,113|beaver.machine|INFO|15134|140028818736896|MainThread|at
> org.apache.hadoop.hbase.client.BufferedMutatorImpl.backgroundFlushCommits(BufferedMutatorImpl.java:206)
> 2015-04-09
> 12:36:34,113|beaver.machine|INFO|15134|140028818736896|MainThread|at
> org.apache.hadoop.hbase.client.BufferedMutatorImpl.flush(BufferedMutatorImpl.java:183)
> 2015-04-09
> 12:36:34,114|beaver.machine|INFO|15134|140028818736896|MainThread|at
> org.apache.hadoop.hbase.client.HTable.flushCommits(HTable.java:1414)
> 2015-04-09
> 12:36:34,114|beaver.machine|INFO|15134|140028818736896|MainThread|at
> org.apache.hadoop.hbase.client.HTable.put(HTable.java:1010)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
