[
https://issues.apache.org/jira/browse/HBASE-15464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15205692#comment-15205692
]
Hudson commented on HBASE-15464:
--------------------------------
SUCCESS: Integrated in HBase-1.3-IT #573 (See
[https://builds.apache.org/job/HBase-1.3-IT/573/])
HBASE-15464 Flush / Compaction metrics revisited (enis: rev
249e37f83c32a8231824d4e84f298e3b344e158a)
*
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreFlushContext.java
*
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/DefaultStoreEngine.java
*
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServer.java
*
hbase-hadoop-compat/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServerSource.java
*
hbase-hadoop2-compat/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServerSourceImpl.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
*
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RegionServerServices.java
*
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/compactions/CompactionContext.java
*
hbase-server/src/main/java/org/apache/hadoop/hbase/procedure/flush/FlushTableSubprocedure.java
*
hbase-server/src/test/java/org/apache/hadoop/hbase/MockRegionServerServices.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java
*
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RSRpcServices.java
*
hbase-server/src/test/java/org/apache/hadoop/hbase/master/MockRegionServer.java
*
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestMetricsRegionServer.java
*
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestStripeStoreEngine.java
*
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StripeStoreEngine.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/Store.java
*
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestCompaction.java
*
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/compactions/CompactionRequest.java
*
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
*
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MemStoreFlusher.java
> Flush / Compaction metrics revisited
> ------------------------------------
>
> Key: HBASE-15464
> URL: https://issues.apache.org/jira/browse/HBASE-15464
> Project: HBase
> Issue Type: Sub-task
> Components: metrics
> Reporter: Enis Soztutar
> Assignee: Enis Soztutar
> Fix For: 2.0.0, 1.3.0, 1.4.0
>
> Attachments: hbase-15464_v1.patch, hbase-15464_v2.patch,
> hbase-15464_v3.patch, hbase-15464_v3.patch, hbase-15464_v4.patch
>
>
> We can add a couple of metrics related to flushes and compactions:
> - flush memstore and output file size histogram: This will allow seeing
> whether we are flushing too early due to memory pressure, too many regions,
> etc. Tracking flush memstore size vs output file size is useful in
> understanding the block encoding compression benefits.
> - total flushed output bytes: This will allow to monitor the IO / throughput
> from flushers. You can use this to set num flushers, flush throttle, etc.
> - smallCompactionQueueLength / large...: This is tracked, but not emitted
> anymore due to a bug.
> - compaction time histogram: similar to flush time histogram, how long
> compactions are taking.
> - compaction input num files / output num files histogram: How many files on
> average we are compacting. Stripe compaction / date tiered compaction can use
> the num output files metric.
> - compaction input / output data sizes histogram: How much data on average
> we are compacting.
> - compaction input / output total bytes: Measure compaction IO / throughput.
> measure write amplification, enables to set compaction throttle.
> - Breakdown for above for major compactions
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
