[jira] [Updated] (HBASE-15249) Provide lower bound on number of regions in region normalizer for pre-split tables
[ https://issues.apache.org/jira/browse/HBASE-15249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-15249: --- Labels: normalization (was: ) > Provide lower bound on number of regions in region normalizer for pre-split > tables > -- > > Key: HBASE-15249 > URL: https://issues.apache.org/jira/browse/HBASE-15249 > Project: HBase > Issue Type: Bug >Reporter: Ted Yu >Assignee: Ted Yu > Labels: normalization > Attachments: HBASE-15249.v1.txt, HBASE-15249.v2.txt > > > AMS (Ambari Metrics System) developer found the following scenario: > Metrics table was pre-split with many regions on large cluster (1600 nodes). > After some time, AMS stopped working because region normalizer merged the > regions into few big regions which were not able to serve high read / write > load. > This is a big problem since the write requests flood the regions faster than > the splits can happen resulting in poor performance. > We should consider setting reasonable lower bound on region count. > If the table is pre-split, we can use initial region count as the lower bound. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-15249) Provide lower bound on number of regions in region normalizer for pre-split tables
[ https://issues.apache.org/jira/browse/HBASE-15249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-15249: --- Attachment: HBASE-15249.v1.txt Draft patch > Provide lower bound on number of regions in region normalizer for pre-split > tables > -- > > Key: HBASE-15249 > URL: https://issues.apache.org/jira/browse/HBASE-15249 > Project: HBase > Issue Type: Bug >Reporter: Ted Yu >Assignee: Ted Yu > Attachments: HBASE-15249.v1.txt > > > AMS (Ambari Metrics System) developer found the following scenario: > Metrics table was pre-split with many regions on large cluster. > After some time, AMS stopped working because region normalizer merged the > regions into few big regions which were not able to serve high read / write > load. > We should consider setting reasonable lower bound on region count. > If the table is pre-split, we can use initial region count as the lower bound. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-15249) Provide lower bound on number of regions in region normalizer for pre-split tables
[ https://issues.apache.org/jira/browse/HBASE-15249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-15249: --- Description: AMS (Ambari Metrics System) developer found the following scenario: Metrics table was pre-split with many regions on large cluster (1600 nodes). After some time, AMS stopped working because region normalizer merged the regions into few big regions which were not able to serve high read / write load. This is a big problem since the write requests flood the regions faster than the splits can happen resulting in poor performance. We should consider setting reasonable lower bound on region count. If the table is pre-split, we can use initial region count as the lower bound. was: AMS (Ambari Metrics System) developer found the following scenario: Metrics table was pre-split with many regions on large cluster. After some time, AMS stopped working because region normalizer merged the regions into few big regions which were not able to serve high read / write load. We should consider setting reasonable lower bound on region count. If the table is pre-split, we can use initial region count as the lower bound. > Provide lower bound on number of regions in region normalizer for pre-split > tables > -- > > Key: HBASE-15249 > URL: https://issues.apache.org/jira/browse/HBASE-15249 > Project: HBase > Issue Type: Bug >Reporter: Ted Yu >Assignee: Ted Yu > Attachments: HBASE-15249.v1.txt, HBASE-15249.v2.txt > > > AMS (Ambari Metrics System) developer found the following scenario: > Metrics table was pre-split with many regions on large cluster (1600 nodes). > After some time, AMS stopped working because region normalizer merged the > regions into few big regions which were not able to serve high read / write > load. > This is a big problem since the write requests flood the regions faster than > the splits can happen resulting in poor performance. > We should consider setting reasonable lower bound on region count. > If the table is pre-split, we can use initial region count as the lower bound. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-15249) Provide lower bound on number of regions in region normalizer for pre-split tables
[ https://issues.apache.org/jira/browse/HBASE-15249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-15249: --- Attachment: HBASE-15249.v2.txt Patch v2 responds to table disablement and removes entry from internal map for the table > Provide lower bound on number of regions in region normalizer for pre-split > tables > -- > > Key: HBASE-15249 > URL: https://issues.apache.org/jira/browse/HBASE-15249 > Project: HBase > Issue Type: Bug >Reporter: Ted Yu >Assignee: Ted Yu > Attachments: HBASE-15249.v1.txt, HBASE-15249.v2.txt > > > AMS (Ambari Metrics System) developer found the following scenario: > Metrics table was pre-split with many regions on large cluster. > After some time, AMS stopped working because region normalizer merged the > regions into few big regions which were not able to serve high read / write > load. > We should consider setting reasonable lower bound on region count. > If the table is pre-split, we can use initial region count as the lower bound. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
