[jira] [Updated] (HBASE-20883) HMaster Read / Write Requests Per Sec across RegionServers, currently only Total Requests Per Sec
[ https://issues.apache.org/jira/browse/HBASE-20883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Sekhon updated HBASE-20883: Description: HMaster currently shows Requests Per Second per RegionServer under HMaster UI's /master-status page -> Region Servers -> Base Stats section in the Web UI. Please add Reads Per Second and Writes Per Second per RegionServer alongside this in the HMaster UI, and also expose the Read/Write/Total requests per sec information in the HMaster JMX API. This will make it easier to find read or write hotspotting on HBase as a combined total will minimize and mask differences between RegionServers. For example, we do 30,000 reads/sec but only 900 writes/sec to each RegionServer, so write skew will be masked as it won't show enough significant difference in the much larger combined Total Requests Per Second stat. For now I've written a Python tool to calculate this info from RegionServers JMX read/write/total request counts but since HMaster is collecting this info anyway it shouldn't be a big change to improve it to also show Reads / Writes Per Sec as well as Total. Find my tools for more granular Read/Write Requests Per Sec Per Regionserver and also Per Region at my [PyTools github repo|https://github.com/harisekhon/pytools] along with a selection of other HBase tools I've used for performance debugging over the years. was: HMaster currently shows Requests Per Second per RegionServer under HMaster UI's /master-status page -> Region Servers -> Base Stats section in the Web UI. Please add Reads Per Second and Writes Per Second per RegionServer alongside this in the HMaster UI, and also expose the Read/Write/Total requests per sec information in the HMaster JMX API. This will make it easier to find read or write hotspotting on HBase as a combined total will minimize and mask differences between RegionServers. For example, we do 30,000 reads/sec but only 900 writes/sec to each RegionServer, so write skew will be masked as it won't show enough significant difference in the much larger combined Total Requests Per Second stat. For now I've written a Python tool to calculate this info from RegionServers JMX read/write/total request counts but since HMaster is collecting this info anyway it shouldn't be a big change to improve it to also show Reads / Writes Per Sec as well as Total. Find my tools for more granular Read/Write Requests Per Sec Per Regionserver and also per region at my [PyTools github repo|https://github.com/harisekhon/pytools] along with a selection of other HBase tools I've used for performance debugging over the years. > HMaster Read / Write Requests Per Sec across RegionServers, currently only > Total Requests Per Sec > -- > > Key: HBASE-20883 > URL: https://issues.apache.org/jira/browse/HBASE-20883 > Project: HBase > Issue Type: Improvement > Components: Admin, master, metrics, monitoring, UI, Usability >Affects Versions: 1.1.2 >Reporter: Hari Sekhon >Priority: Major > > HMaster currently shows Requests Per Second per RegionServer under HMaster > UI's /master-status page -> Region Servers -> Base Stats section in the Web > UI. > Please add Reads Per Second and Writes Per Second per RegionServer alongside > this in the HMaster UI, and also expose the Read/Write/Total requests per sec > information in the HMaster JMX API. > This will make it easier to find read or write hotspotting on HBase as a > combined total will minimize and mask differences between RegionServers. For > example, we do 30,000 reads/sec but only 900 writes/sec to each RegionServer, > so write skew will be masked as it won't show enough significant difference > in the much larger combined Total Requests Per Second stat. > For now I've written a Python tool to calculate this info from RegionServers > JMX read/write/total request counts but since HMaster is collecting this info > anyway it shouldn't be a big change to improve it to also show Reads / Writes > Per Sec as well as Total. > Find my tools for more granular Read/Write Requests Per Sec Per Regionserver > and also Per Region at my [PyTools github > repo|https://github.com/harisekhon/pytools] along with a selection of other > HBase tools I've used for performance debugging over the years. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HBASE-20883) HMaster Read / Write Requests Per Sec across RegionServers, currently only Total Requests Per Sec
[ https://issues.apache.org/jira/browse/HBASE-20883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Sekhon updated HBASE-20883: Description: HMaster currently shows Requests Per Second per RegionServer under HMaster UI's /master-status page -> Region Servers -> Base Stats section in the Web UI. Please add Reads Per Second and Writes Per Second per RegionServer alongside this in the HMaster UI, and also expose the Read/Write/Total requests per sec information in the HMaster JMX API. This will make it easier to find read or write hotspotting on HBase as a combined total will minimize and mask differences between RegionServers. For example, we do 30,000 reads/sec but only 900 writes/sec to each RegionServer, so write skew will be masked as it won't show enough significant difference in the much larger combined Total Requests Per Second stat. For now I've written a Python tool to calculate this info from RegionServers JMX read/write/total request counts but since HMaster is collecting this info anyway it shouldn't be a big change to improve it to also show Reads / Writes Per Sec as well as Total. Find my tools for more granular Read/Write Requests Per Sec Per Regionserver and also per region at my [PyTools github repo|https://github.com/harisekhon/pytools] along with a selection of other HBase tools I've used for performance debugging over the years. was: HMaster currently shows Requests Per Second per RegionServer under HMaster UI's /master-status page -> Region Servers -> Base Stats section in the Web UI. Please add Reads Per Second and Writes Per Second per RegionServer alongside this in the HMaster UI, and also expose the Read/Write/Total requests per sec information in the HMaster JMX API. This will make it easier to find read or write hotspotting on HBase as a combined total will minimize and mask differences between RegionServers. For example, we do 30,000 reads/sec but only 900 writes/sec to each RegionServer, so write skew will be masked as it won't show enough significant difference in the much larger combined Total Requests Per Second stat. For now I've written a Python tool to calculate this info from RegionServers JMX read/write/total request counts but since HMaster is collecting this info anyway it shouldn't be a big change to improve it to also show Reads / Writes Per Sec. Find my tools for more granular Read/Write Requests Per Sec Per Regionserver and also per region at my [PyTools github repo|https://github.com/harisekhon/pytools] along with a selection of other HBase tools I've used for performance debugging over the years. > HMaster Read / Write Requests Per Sec across RegionServers, currently only > Total Requests Per Sec > -- > > Key: HBASE-20883 > URL: https://issues.apache.org/jira/browse/HBASE-20883 > Project: HBase > Issue Type: Improvement > Components: Admin, master, metrics, monitoring, UI, Usability >Affects Versions: 1.1.2 >Reporter: Hari Sekhon >Priority: Major > > HMaster currently shows Requests Per Second per RegionServer under HMaster > UI's /master-status page -> Region Servers -> Base Stats section in the Web > UI. > Please add Reads Per Second and Writes Per Second per RegionServer alongside > this in the HMaster UI, and also expose the Read/Write/Total requests per sec > information in the HMaster JMX API. > This will make it easier to find read or write hotspotting on HBase as a > combined total will minimize and mask differences between RegionServers. For > example, we do 30,000 reads/sec but only 900 writes/sec to each RegionServer, > so write skew will be masked as it won't show enough significant difference > in the much larger combined Total Requests Per Second stat. > For now I've written a Python tool to calculate this info from RegionServers > JMX read/write/total request counts but since HMaster is collecting this info > anyway it shouldn't be a big change to improve it to also show Reads / Writes > Per Sec as well as Total. > Find my tools for more granular Read/Write Requests Per Sec Per Regionserver > and also per region at my [PyTools github > repo|https://github.com/harisekhon/pytools] along with a selection of other > HBase tools I've used for performance debugging over the years. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HBASE-20883) HMaster Read / Write Requests Per Sec across RegionServers, currently only Total Requests Per Sec
[ https://issues.apache.org/jira/browse/HBASE-20883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Sekhon updated HBASE-20883: Description: HMaster currently shows Requests Per Second per RegionServer under HMaster UI's /master-status page -> Region Servers -> Base Stats section in the Web UI. Please add Reads Per Second and Writes Per Second per RegionServer alongside this in the HMaster UI, and also expose the Read/Write/Total requests per sec information in the HMaster JMX API. This will make it easier to find read or write hotspotting on HBase as a combined total will minimize and mask differences between RegionServers. For example, we do 30,000 reads/sec but only 900 writes/sec to each RegionServer, so write skew will be masked as it won't show enough significant difference in the much larger combined Total Requests Per Second stat. For now I've written a Python tool to calculate this info from RegionServers JMX read/write/total request counts but since HMaster is collecting this info anyway it shouldn't be a big change to improve it to also show Reads / Writes Per Sec. Find my tools for more granular Read/Write Requests Per Sec Per Regionserver and also per region at my [PyTools github repo|https://github.com/harisekhon/pytools] along with a selection of other HBase tools I've used for performance debugging over the years. was: HMaster currently shows Requests Per Second per RegionServer under HMaster UI's /master-status page -> Region Servers -> Base Stats section in the Web UI. Please add Reads Per Second and Writes Per Second per RegionServer alongside this in the HMaster UI, and also expose the Read/Write/Total requests per sec information in the HMaster JMX API. This will make it easier to find read or write hotspotting on HBase as a combined total will minimize and mask differences between RegionServers. For example, we do 30,000 reads/sec but only 900 writes/sec to each RegionServer, so write skew will be masked as it won't show enough significant difference in the much larger combined Total Requests Per Second stat. For now I've written a Python tool to calculate this info from RegionServers but since HMaster is collecting this info anyway it shouldn't be a big change to improve it to also show Reads / Writes Per Sec. Find my tools for more granular Read/Write Requests Per Sec Per Regionserver and also per region at my [PyTools github repo|https://github.com/harisekhon/pytools] along with a selection of other HBase tools I've used for performance debugging over the years. > HMaster Read / Write Requests Per Sec across RegionServers, currently only > Total Requests Per Sec > -- > > Key: HBASE-20883 > URL: https://issues.apache.org/jira/browse/HBASE-20883 > Project: HBase > Issue Type: Improvement > Components: Admin, master, metrics, monitoring, UI, Usability >Affects Versions: 1.1.2 >Reporter: Hari Sekhon >Priority: Major > > HMaster currently shows Requests Per Second per RegionServer under HMaster > UI's /master-status page -> Region Servers -> Base Stats section in the Web > UI. > Please add Reads Per Second and Writes Per Second per RegionServer alongside > this in the HMaster UI, and also expose the Read/Write/Total requests per sec > information in the HMaster JMX API. > This will make it easier to find read or write hotspotting on HBase as a > combined total will minimize and mask differences between RegionServers. For > example, we do 30,000 reads/sec but only 900 writes/sec to each RegionServer, > so write skew will be masked as it won't show enough significant difference > in the much larger combined Total Requests Per Second stat. > For now I've written a Python tool to calculate this info from RegionServers > JMX read/write/total request counts but since HMaster is collecting this info > anyway it shouldn't be a big change to improve it to also show Reads / Writes > Per Sec. > Find my tools for more granular Read/Write Requests Per Sec Per Regionserver > and also per region at my [PyTools github > repo|https://github.com/harisekhon/pytools] along with a selection of other > HBase tools I've used for performance debugging over the years. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HBASE-20883) HMaster Read / Write Requests Per Sec across RegionServers, currently only Total Requests Per Sec
[ https://issues.apache.org/jira/browse/HBASE-20883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Sekhon updated HBASE-20883: Description: HMaster currently shows Requests Per Second per RegionServer under HMaster UI's /master-status page -> Region Servers -> Base Stats section in the Web UI. Please add Reads Per Second and Writes Per Second per RegionServer alongside this in the HMaster UI, and also expose the Read/Write/Total requests per sec information in the HMaster JMX API. This will make it easier to find read or write hotspotting on HBase as a combined total will minimize and mask differences between RegionServers. For example, we do 30,000 reads/sec but only 900 writes/sec to each RegionServer, so write skew will be masked as it won't show enough significant difference in the much larger combined Total Requests Per Second stat. For now I've written a Python tool to calculate this info from RegionServers but since HMaster is collecting this info anyway it shouldn't be a big change to improve it to also show Reads / Writes Per Sec. Find my tools for more granular Read/Write Requests Per Sec Per Regionserver and also per region at my [PyTools github repo|https://github.com/harisekhon/pytools] along with a selection of other HBase tools I've used for performance debugging over the years. was: HMaster UI currently shows Requests Per Second per RegionServer under /master-status Region Servers -> Base Stats section in the Web UI. Please add Reads Per Second and Writes Per Second per RegionServer alongside this in the HMaster UI, and also expose the Read/Write/Total requests per sec information in the HMaster JMX API. This will make it easier to find read or write hotspotting on HBase as a combined total will minimize and mask differences between RegionServers. For example, we do 30,000 reads/sec but only 900 writes/sec to each RegionServer, so write skew will be masked as it won't show enough significant difference in the much larger combined Total Requests Per Second stat. For now I've written a Python tool to calculate this info from RegionServers but since HMaster is collecting this info anyway it shouldn't be a big change to improve it to also show Reads / Writes Per Sec. Find my tools for more granular Read/Write Requests Per Sec Per Regionserver and also per region at my [PyTools github repo|https://github.com/harisekhon/pytools] along with a selection of other HBase tools I've used for performance debugging over the years. > HMaster Read / Write Requests Per Sec across RegionServers, currently only > Total Requests Per Sec > -- > > Key: HBASE-20883 > URL: https://issues.apache.org/jira/browse/HBASE-20883 > Project: HBase > Issue Type: Improvement > Components: Admin, master, metrics, monitoring, UI, Usability >Affects Versions: 1.1.2 >Reporter: Hari Sekhon >Priority: Major > > HMaster currently shows Requests Per Second per RegionServer under HMaster > UI's /master-status page -> Region Servers -> Base Stats section in the Web > UI. > Please add Reads Per Second and Writes Per Second per RegionServer alongside > this in the HMaster UI, and also expose the Read/Write/Total requests per sec > information in the HMaster JMX API. > This will make it easier to find read or write hotspotting on HBase as a > combined total will minimize and mask differences between RegionServers. For > example, we do 30,000 reads/sec but only 900 writes/sec to each RegionServer, > so write skew will be masked as it won't show enough significant difference > in the much larger combined Total Requests Per Second stat. > For now I've written a Python tool to calculate this info from RegionServers > but since HMaster is collecting this info anyway it shouldn't be a big change > to improve it to also show Reads / Writes Per Sec. > Find my tools for more granular Read/Write Requests Per Sec Per Regionserver > and also per region at my [PyTools github > repo|https://github.com/harisekhon/pytools] along with a selection of other > HBase tools I've used for performance debugging over the years. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HBASE-20883) HMaster Read+Write Requests Per Sec across RegionServers, currently only Total Requests Per Sec
[ https://issues.apache.org/jira/browse/HBASE-20883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Sekhon updated HBASE-20883: Summary: HMaster Read+Write Requests Per Sec across RegionServers, currently only Total Requests Per Sec (was: HMaster UI/JMX Read+Write Requests per sec across RegionServers) > HMaster Read+Write Requests Per Sec across RegionServers, currently only > Total Requests Per Sec > --- > > Key: HBASE-20883 > URL: https://issues.apache.org/jira/browse/HBASE-20883 > Project: HBase > Issue Type: Improvement > Components: Admin, master, metrics, monitoring, UI, Usability >Affects Versions: 1.1.2 >Reporter: Hari Sekhon >Priority: Major > > HMaster UI currently shows Requests Per Second per RegionServer under > /mater-status Region Servers -> Base Stats section in the Web UI. > Please add Reads Per Second and Writes Per Second per RegionServer alongside > this in the HMaster UI, and also expose the Read/Write/Total requests per sec > information in the HMaster JMX API. > This will make it easier to find read or write hotspotting on HBase as a > combined total will minimize and mask differences between RegionServers. For > example, we do 30,000 reads/sec but only 900 writes/sec to each RegionServer, > so write skew will be masked as it won't show enough significant difference > in the much larger combined Total Requests Per Second stat. > For now I've written a Python tool to calculate this info from RegionServers > but since HMaster is collecting this info anyway it shouldn't be a big change > to improve it to also show Reads / Writes Per Sec. > Find my tools for more granular Read/Write Requests Per Sec Per Regionserver > and also per region at my [PyTools github > repo|https://github.com/harisekhon/pytools] along with a selection of other > HBase tools I've used for performance debugging over the years. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HBASE-20883) HMaster Read / Write Requests Per Sec across RegionServers, currently only Total Requests Per Sec
[ https://issues.apache.org/jira/browse/HBASE-20883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Sekhon updated HBASE-20883: Summary: HMaster Read / Write Requests Per Sec across RegionServers, currently only Total Requests Per Sec (was: HMaster Read+Write Requests Per Sec across RegionServers, currently only Total Requests Per Sec) > HMaster Read / Write Requests Per Sec across RegionServers, currently only > Total Requests Per Sec > -- > > Key: HBASE-20883 > URL: https://issues.apache.org/jira/browse/HBASE-20883 > Project: HBase > Issue Type: Improvement > Components: Admin, master, metrics, monitoring, UI, Usability >Affects Versions: 1.1.2 >Reporter: Hari Sekhon >Priority: Major > > HMaster UI currently shows Requests Per Second per RegionServer under > /mater-status Region Servers -> Base Stats section in the Web UI. > Please add Reads Per Second and Writes Per Second per RegionServer alongside > this in the HMaster UI, and also expose the Read/Write/Total requests per sec > information in the HMaster JMX API. > This will make it easier to find read or write hotspotting on HBase as a > combined total will minimize and mask differences between RegionServers. For > example, we do 30,000 reads/sec but only 900 writes/sec to each RegionServer, > so write skew will be masked as it won't show enough significant difference > in the much larger combined Total Requests Per Second stat. > For now I've written a Python tool to calculate this info from RegionServers > but since HMaster is collecting this info anyway it shouldn't be a big change > to improve it to also show Reads / Writes Per Sec. > Find my tools for more granular Read/Write Requests Per Sec Per Regionserver > and also per region at my [PyTools github > repo|https://github.com/harisekhon/pytools] along with a selection of other > HBase tools I've used for performance debugging over the years. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HBASE-20883) HMaster Read / Write Requests Per Sec across RegionServers, currently only Total Requests Per Sec
[ https://issues.apache.org/jira/browse/HBASE-20883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Sekhon updated HBASE-20883: Description: HMaster UI currently shows Requests Per Second per RegionServer under /master-status Region Servers -> Base Stats section in the Web UI. Please add Reads Per Second and Writes Per Second per RegionServer alongside this in the HMaster UI, and also expose the Read/Write/Total requests per sec information in the HMaster JMX API. This will make it easier to find read or write hotspotting on HBase as a combined total will minimize and mask differences between RegionServers. For example, we do 30,000 reads/sec but only 900 writes/sec to each RegionServer, so write skew will be masked as it won't show enough significant difference in the much larger combined Total Requests Per Second stat. For now I've written a Python tool to calculate this info from RegionServers but since HMaster is collecting this info anyway it shouldn't be a big change to improve it to also show Reads / Writes Per Sec. Find my tools for more granular Read/Write Requests Per Sec Per Regionserver and also per region at my [PyTools github repo|https://github.com/harisekhon/pytools] along with a selection of other HBase tools I've used for performance debugging over the years. was: HMaster UI currently shows Requests Per Second per RegionServer under /mater-status Region Servers -> Base Stats section in the Web UI. Please add Reads Per Second and Writes Per Second per RegionServer alongside this in the HMaster UI, and also expose the Read/Write/Total requests per sec information in the HMaster JMX API. This will make it easier to find read or write hotspotting on HBase as a combined total will minimize and mask differences between RegionServers. For example, we do 30,000 reads/sec but only 900 writes/sec to each RegionServer, so write skew will be masked as it won't show enough significant difference in the much larger combined Total Requests Per Second stat. For now I've written a Python tool to calculate this info from RegionServers but since HMaster is collecting this info anyway it shouldn't be a big change to improve it to also show Reads / Writes Per Sec. Find my tools for more granular Read/Write Requests Per Sec Per Regionserver and also per region at my [PyTools github repo|https://github.com/harisekhon/pytools] along with a selection of other HBase tools I've used for performance debugging over the years. > HMaster Read / Write Requests Per Sec across RegionServers, currently only > Total Requests Per Sec > -- > > Key: HBASE-20883 > URL: https://issues.apache.org/jira/browse/HBASE-20883 > Project: HBase > Issue Type: Improvement > Components: Admin, master, metrics, monitoring, UI, Usability >Affects Versions: 1.1.2 >Reporter: Hari Sekhon >Priority: Major > > HMaster UI currently shows Requests Per Second per RegionServer under > /master-status Region Servers -> Base Stats section in the Web UI. > Please add Reads Per Second and Writes Per Second per RegionServer alongside > this in the HMaster UI, and also expose the Read/Write/Total requests per sec > information in the HMaster JMX API. > This will make it easier to find read or write hotspotting on HBase as a > combined total will minimize and mask differences between RegionServers. For > example, we do 30,000 reads/sec but only 900 writes/sec to each RegionServer, > so write skew will be masked as it won't show enough significant difference > in the much larger combined Total Requests Per Second stat. > For now I've written a Python tool to calculate this info from RegionServers > but since HMaster is collecting this info anyway it shouldn't be a big change > to improve it to also show Reads / Writes Per Sec. > Find my tools for more granular Read/Write Requests Per Sec Per Regionserver > and also per region at my [PyTools github > repo|https://github.com/harisekhon/pytools] along with a selection of other > HBase tools I've used for performance debugging over the years. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
