[
https://issues.apache.org/jira/browse/HBASE-5033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Phabricator updated HBASE-5033:
-------------------------------
Attachment: D933.2.patch
Liyin updated the revision "[jira][HBASE-5033][[89-fb]]Opening/Closing store in
parallel to reduce region open/close time".
Reviewers: Kannan, mbautin, Karthik, JIRA
Address Mikhail's comments.
1) When any exceptions caught during the store/store file open or close time,
it would be safer to shut down the thread pool.
If not shut down the thread pool for opening, then block cache may have the
data related to the failed opened region.
If not shut down the thread pool for closing, then the region server may
concurrently close the same store since the closeRegion operation could be
retried in the region server.
2) Use different thread pool for store/store file opening and closing time.
So we can shut down the thread pool separately and no need to worried about the
dependency between open and close.
REVISION DETAIL
https://reviews.facebook.net/D933
AFFECTED FILES
src/main/java/org/apache/hadoop/hbase/master/HMaster.java
src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
src/main/java/org/apache/hadoop/hbase/regionserver/Store.java
src/main/java/org/apache/hadoop/hbase/util/Threads.java
> Opening/Closing store in parallel to reduce region open/close time
> ------------------------------------------------------------------
>
> Key: HBASE-5033
> URL: https://issues.apache.org/jira/browse/HBASE-5033
> Project: HBase
> Issue Type: Improvement
> Reporter: Liyin Tang
> Assignee: Liyin Tang
> Attachments: D933.1.patch, D933.2.patch
>
>
> Region servers are opening/closing each store and each store file for every
> store in sequential fashion, which may cause inefficiency to open/close
> regions.
> So this diff is to open/close each store in parallel in order to reduce
> region open/close time. Also it would help to reduce the cluster restart time.
> 1) Opening each store in parallel
> 2) Loading each store file for every store in parallel
> 3) Closing each store in parallel
> 4) Closing each store file for every store in parallel.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
