[
https://issues.apache.org/jira/browse/HBASE-8803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13707504#comment-13707504
]
Nick Dimiduk commented on HBASE-8803:
-------------------------------------
Watching the client logs generated, no matter how many threads are specified in
--maxthreads, it looks like it's operating in batches of 8 threads at a time.
This is based on the timestamps of log messages. Do you see this behavior too?
{noformat}
13/07/12 22:55:22 INFO region_mover: Moving 333 region(s) from
hor18n37.gq1.ygridcore.net,60020,1373665969266with 10 threads during this cycle
13/07/12 22:55:22 INFO region_mover: Moving region
412f4a174005c1002c09b67caf7ca0c1 (1 of 333) to
server=hor18n35.gq1.ygridcore.net,60020,1373665969233
13/07/12 22:55:22 INFO region_mover: Moving region
189b6a8b5081efbbcba869f1d078a757 (2 of 333) to
server=hor18n39.gq1.ygridcore.net,60020,1373665969204
13/07/12 22:55:22 INFO region_mover: Moving region
6fe402d9bd16b596cd47454e9a628bea (3 of 333) to
server=hor18n38.gq1.ygridcore.net,60020,1373665969217
13/07/12 22:55:22 INFO region_mover: Moving region
a98083e87e6c41f89e5ad56607cd3418 (4 of 333) to
server=hor17n39.gq1.ygridcore.net,60020,1373665969276
13/07/12 22:55:22 INFO region_mover: Moving region
29eb3d1f13ec65866fd786a1e1257999 (5 of 333) to
server=hor18n36.gq1.ygridcore.net,60020,1373665969232
13/07/12 22:55:22 INFO region_mover: Moving region
aa43bc2422886d8121c9875d34d520ea (6 of 333) to
server=hor17n34.gq1.ygridcore.net,60020,1373665969195
13/07/12 22:55:22 INFO region_mover: Moving region
7dc1554b6c4d983b3252528549bb83fa (7 of 333) to
server=hor17n36.gq1.ygridcore.net,60020,1373665969198
13/07/12 22:55:22 INFO region_mover: Moving region
2e7703c6986455f90aaf8e7106d9a657 (8 of 333) to
server=hor17n37.gq1.ygridcore.net,60020,1373665969202
13/07/12 22:56:18 INFO region_mover: Moving region
353a09c07053144a598be04a53afa82e (9 of 333) to
server=hor18n35.gq1.ygridcore.net,60020,1373665969233
13/07/12 22:56:18 INFO region_mover: Moving region
52ace70b213075d9ed2186bce0438838 (10 of 333) to
server=hor18n39.gq1.ygridcore.net,60020,1373665969204
13/07/12 22:56:18 INFO region_mover: Moving region
234265b7ec4e535cecafcdd83f09dab7 (11 of 333) to
server=hor18n38.gq1.ygridcore.net,60020,1373665969217
13/07/12 22:56:18 INFO region_mover: Moving region
9f54ff65021922f7c13f4372dbcb8f98 (12 of 333) to
server=hor17n39.gq1.ygridcore.net,60020,1373665969276
13/07/12 22:56:18 INFO region_mover: Moving region
49944df5c94ce4b5d3e216588ae3e294 (13 of 333) to
server=hor18n36.gq1.ygridcore.net,60020,1373665969232
13/07/12 22:56:18 INFO region_mover: Moving region
a41c8422ab47823730b1392d01b2d6f6 (14 of 333) to
server=hor17n34.gq1.ygridcore.net,60020,1373665969195
13/07/12 22:56:18 INFO region_mover: Moving region
99d0de33f4c2e87a3aff62bb8b8c81f9 (15 of 333) to
server=hor17n36.gq1.ygridcore.net,60020,1373665969198
13/07/12 22:56:18 INFO region_mover: Moving region
2ecb4b37b2be9414396c02ba09920126 (16 of 333) to
server=hor17n37.gq1.ygridcore.net,60020,1373665969202
13/07/12 22:56:44 INFO region_mover: Moving region
53f253f820f3dc646fd5ede04280f6dd (17 of 333) to
server=hor18n35.gq1.ygridcore.net,60020,1373665969233
13/07/12 22:56:44 INFO region_mover: Moving region
bd2bc1dfd5c29188b95a284da9e692e5 (18 of 333) to
server=hor18n39.gq1.ygridcore.net,60020,1373665969204
13/07/12 22:56:44 INFO region_mover: Moving region
09163ba03de8e97090247f6c0670faab (19 of 333) to
server=hor18n38.gq1.ygridcore.net,60020,1373665969217
13/07/12 22:56:44 INFO region_mover: Moving region
3202636c17aca56fcfd94da3f428d7c1 (20 of 333) to
server=hor17n39.gq1.ygridcore.net,60020,1373665969276
13/07/12 22:56:44 INFO region_mover: Moving region
1864cae5e65688bcd6ddf6ae9b16d4e1 (21 of 333) to
server=hor18n36.gq1.ygridcore.net,60020,1373665969232
13/07/12 22:56:44 INFO region_mover: Moving region
acdff3c0752a93b7d22e878105bc84ff (22 of 333) to
server=hor17n34.gq1.ygridcore.net,60020,1373665969195
13/07/12 22:56:44 INFO region_mover: Moving region
ff364a6ef2154b28614b5afe12b342d6 (23 of 333) to
server=hor17n36.gq1.ygridcore.net,60020,1373665969198
13/07/12 22:56:44 INFO region_mover: Moving region
a27b0a6429ccc9907d8b688912920219 (24 of 333) to
server=hor17n37.gq1.ygridcore.net,60020,1373665969202
13/07/12 22:57:08 INFO region_mover: Moving region
eadcddfac520bae8dbf094c161314791 (25 of 333) to
server=hor18n35.gq1.ygridcore.net,60020,1373665969233
{noformat}
> region_mover.rb should move multiple regions at a time
> ------------------------------------------------------
>
> Key: HBASE-8803
> URL: https://issues.apache.org/jira/browse/HBASE-8803
> Project: HBase
> Issue Type: Bug
> Components: Usability
> Affects Versions: 0.98.0, 0.94.8, 0.95.1
> Reporter: Jean-Marc Spaggiari
> Assignee: Jean-Marc Spaggiari
> Fix For: 0.98.0, 0.95.2, 0.94.10
>
> Attachments: HBASE-8803-v0-trunk.patch, HBASE-8803-v1-0.94.patch,
> HBASE-8803-v1-trunk.patch, HBASE-8803-v2-0.94.patch, HBASE-8803-v2-0.94.patch
>
> Original Estimate: 48h
> Remaining Estimate: 48h
>
> When there is many regions in a cluster, rolling_restart can take hours
> because region_mover is moving the regions one by one.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
