[
https://issues.apache.org/jira/browse/HBASE-5033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13173746#comment-13173746
]
Phabricator commented on HBASE-5033:
------------------------------------
Liyin has commented on the revision "[jira][HBASE-5033][[89-fb]]Opening/Closing
store in parallel to reduce region open/close time".
Just discussed with Kannan offline, he found out that it wouldn't achieve the
maximum parallelization across the regions from different tables, considering
each table may has different number of stores.
One proposal is to just bound the total number of threads for this
parallelization process for each region.
And the following formula stands:
the max number of threads for opening stores * the max number of threads for
opening stores files = the total number of threads we have configured.
So If one region has less stores, this region will have more threads to run
to open/close the store files in parallel and vice versa.
REVISION DETAIL
https://reviews.facebook.net/D933
> Opening/Closing store in parallel to reduce region open/close time
> ------------------------------------------------------------------
>
> Key: HBASE-5033
> URL: https://issues.apache.org/jira/browse/HBASE-5033
> Project: HBase
> Issue Type: Improvement
> Reporter: Liyin Tang
> Assignee: Liyin Tang
> Attachments: D933.1.patch, D933.2.patch, D933.3.patch
>
>
> Region servers are opening/closing each store and each store file for every
> store in sequential fashion, which may cause inefficiency to open/close
> regions.
> So this diff is to open/close each store in parallel in order to reduce
> region open/close time. Also it would help to reduce the cluster restart time.
> 1) Opening each store in parallel
> 2) Loading each store file for every store in parallel
> 3) Closing each store in parallel
> 4) Closing each store file for every store in parallel.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
