[
https://issues.apache.org/jira/browse/HBASE-20786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16523143#comment-16523143
]
Andrew Purtell commented on HBASE-20786:
----------------------------------------
There are a lot of fixed size executor pools in the master for various tasks.
Can they be serviced by one common pool, maybe with a relatively small core
pool but with a large upper bound? Same thought applies to RSes to a lesser
extent. It's annoying to have to adjust them up or down due to environment
particulars, although I suppose that is not common. (I needed to do it for
deploy of new test tables on slow FS (S3)) Will help here aside from other
improvements.
> Table create with thousands of regions takes too long
> -----------------------------------------------------
>
> Key: HBASE-20786
> URL: https://issues.apache.org/jira/browse/HBASE-20786
> Project: HBase
> Issue Type: Umbrella
> Components: Performance
> Reporter: stack
> Priority: Major
>
> Internal testing has create of a table with 33k regions taking 18 minutes.
> Let me provide more info below. We have an executor with default ten threads
> handling the creation of the regions in HDFS which helps distribute out the
> load but its not enough. This cluster had >600 servers. Let me add detail.
> Need to spend some time on speeding up create/assigns. Made this an umbrella
> issue so can pick off pieces of the problem as subtasks.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
