[jira] [Commented] (HBASE-4324) Single unassigned directory is very slow when there are many unassigned nodes
[ https://issues.apache.org/jira/browse/HBASE-4324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13218529#comment-13218529 ] stack commented on HBASE-4324: -- Yeah, should still be an issue. Probably better to have it in 0.96, the singularity, since will necessitate change in layout up in zk. Single unassigned directory is very slow when there are many unassigned nodes - Key: HBASE-4324 URL: https://issues.apache.org/jira/browse/HBASE-4324 Project: HBase Issue Type: Bug Components: zookeeper Affects Versions: 0.90.4 Reporter: Todd Lipcon Fix For: 0.96.0 Because we use a single znode for /unassigned, and we re-list it every time its contents change, assignment speed per region is O(number of unassigned regions) rather than O(1). Every time something changes about one unassigned region, the master has to re-list the entire contents of the directory inside of AssignmentManager.nodeChildrenChanged(). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-4324) Single unassigned directory is very slow when there are many unassigned nodes
[ https://issues.apache.org/jira/browse/HBASE-4324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13095676#comment-13095676 ] Todd Lipcon commented on HBASE-4324: We may be able to get a nice boost by moving the watchAndGetNewChildren call outside of the synchronization on regionsInTransition... need to think carefully about that to see if it's correct. Single unassigned directory is very slow when there are many unassigned nodes - Key: HBASE-4324 URL: https://issues.apache.org/jira/browse/HBASE-4324 Project: HBase Issue Type: Bug Components: zookeeper Affects Versions: 0.92.0 Reporter: Todd Lipcon Fix For: 0.94.0 Because we use a single znode for /unassigned, and we re-list it every time its contents change, assignment speed per region is O(number of unassigned regions) rather than O(1). Every time something changes about one unassigned region, the master has to re-list the entire contents of the directory inside of AssignmentManager.nodeChildrenChanged(). -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira