[
https://issues.apache.org/jira/browse/HBASE-5970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13286380#comment-13286380
]
ramkrishna.s.vasudevan commented on HBASE-5970:
-----------------------------------------------
@Chunhui
What i meant is overall the updatetimers itself affects the TM. The problem is
updatetimer just updates all the RITs time with the current time.
Suppose the TM saw the RIT at time x. Now if the timeout monitor is 5 mins.
Exactly after x+5 we expect the TM to reassign. But the updatetimer will
update all the regions in RIT. So even this region who should be assinged
after x+5 will also get updated to the current time.
So now the TM will be able to take action only after x+5+Delta. Currently as
it is 30 mins we wont be much affected as no one will be waiting for 30 mins.
> Improve the AssignmentManager#updateTimer and speed up handling opened event
> ----------------------------------------------------------------------------
>
> Key: HBASE-5970
> URL: https://issues.apache.org/jira/browse/HBASE-5970
> Project: HBase
> Issue Type: Improvement
> Components: master
> Reporter: chunhui shen
> Assignee: chunhui shen
> Priority: Critical
> Fix For: 0.96.0
>
> Attachments: 5970v3.patch, HBASE-5970.patch, HBASE-5970v2.patch,
> HBASE-5970v3.patch, HBASE-5970v4.patch, HBASE-5970v4.patch
>
>
> We found handing opened event very slow in the environment with lots of
> regions.
> The problem is the slow AssignmentManager#updateTimer.
> We do the test for bulk assigning 10w (i.e. 100k) regions, the whole process
> of bulk assigning took 1 hours.
> 2012-05-06 20:31:49,201 INFO
> org.apache.hadoop.hbase.master.AssignmentManager: Bulk assigning 100000
> region(s) round-robin across 5 server(s)
> 2012-05-06 21:26:32,103 INFO
> org.apache.hadoop.hbase.master.AssignmentManager: Bulk assigning done
> I think we could do the improvement for the AssignmentManager#updateTimer:
> Make a thread do this work.
> After the improvement, it took only 4.5mins
> 2012-05-07 11:03:36,581 INFO
> org.apache.hadoop.hbase.master.AssignmentManager: Bulk assigning 100000
> region(s) across 5 server(s), retainAssignment=true
> 2012-05-07 11:07:57,073 INFO
> org.apache.hadoop.hbase.master.AssignmentManager: Bulk assigning done
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
