[ 
https://issues.apache.org/jira/browse/HBASE-15134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16104915#comment-16104915
 ] 

Hudson commented on HBASE-15134:
--------------------------------

FAILURE: Integrated in Jenkins build HBase-Trunk_matrix #3449 (See 
[https://builds.apache.org/job/HBase-Trunk_matrix/3449/])
HBASE-15134 Add visibility into Flush and Compaction queues (achouhan: rev 
2d06a06ba4bbd2f64e28be5973eb1d447114bedc)
* (edit) 
hbase-hadoop2-compat/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionSourceImpl.java
* (edit) 
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/CompactSplit.java
* (edit) 
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestMetricsRegion.java
* (edit) 
hbase-hadoop2-compat/src/test/java/org/apache/hadoop/hbase/regionserver/TestMetricsRegionSourceImpl.java
* (edit) 
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/MetricsRegionWrapperStub.java
* (edit) 
hbase-hadoop-compat/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionSource.java
* (edit) 
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MemStoreFlusher.java
* (edit) 
hbase-hadoop-compat/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionWrapper.java
* (edit) 
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
* (edit) 
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionWrapperImpl.java


> Add visibility into Flush and Compaction queues
> -----------------------------------------------
>
>                 Key: HBASE-15134
>                 URL: https://issues.apache.org/jira/browse/HBASE-15134
>             Project: HBase
>          Issue Type: New Feature
>          Components: Compaction, metrics, regionserver
>            Reporter: Elliott Clark
>            Assignee: Abhishek Singh Chouhan
>             Fix For: 3.0.0, 1.4.0, 1.5.0, 2.0.0-alpha-2
>
>         Attachments: HBASE-15134.branch-1.001.patch, 
> HBASE-15134.branch-1.001.patch, HBASE-15134.master.001.patch, 
> HBASE-15134.master.002.patch, HBASE-15134.master.003.patch, 
> HBASE-15134.patch, HBASE-15134.patch
>
>
> On busy spurts we can see regionservers start to see large queues for 
> compaction. It's really hard to tell if the server is queueing a lot of 
> compactions for the same region, lots of compactions for lots of regions, or 
> just falling behind.
> For flushes much the same. There can be flushes in queue that aren't being 
> run because of delayed flushes. There's no way to know from the metrics how 
> many flushes are for each region, how many are delayed. Etc.
> We should add either more metrics around this ( num per region, max per 
> region, min per region ) or add on a UI page that has the list of compactions 
> and flushes.
> Or both.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Reply via email to