[
https://issues.apache.org/jira/browse/HBASE-20786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16524120#comment-16524120
]
Mike Drob commented on HBASE-20786:
-----------------------------------
bq. * The next six minutes are spent assigning the 33k regions... rpc'ing,
updating master, etc. This cluster was at INFO level so I can't see how much
batching we are doing in our RPCs.... Could be room for improvement here.
This is ~100 regions per second, which seems reasonable to me. Accumulo once
benchmarked at ~50 regions per second, so I think we're in a reasonable bound
here.
> Table create with thousands of regions takes too long
> -----------------------------------------------------
>
> Key: HBASE-20786
> URL: https://issues.apache.org/jira/browse/HBASE-20786
> Project: HBase
> Issue Type: Umbrella
> Components: Performance
> Reporter: stack
> Priority: Major
>
> Internal testing has create of a table with 33k regions taking 18 minutes.
> Let me provide more info below. We have an executor with default ten threads
> handling the creation of the regions in HDFS which helps distribute out the
> load but its not enough. This cluster had >600 servers. Let me add detail.
> Need to spend some time on speeding up create/assigns. Made this an umbrella
> issue so can pick off pieces of the problem as subtasks.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
