[
https://issues.apache.org/jira/browse/HBASE-4463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13160636#comment-13160636
]
Hudson commented on HBASE-4463:
-------------------------------
Integrated in HBase-TRUNK #2504 (See
[https://builds.apache.org/job/HBase-TRUNK/2504/])
HBASE-4463 [jira] Run more aggressive compactions during off peak hours
Summary:
HBASE-4463 Run more aggressive compactions during off peak hours
Increases the compact selection ratio from 1.3 to 5 at off-peak hours. This
will help utilize the available iops and bandwidth to decrease average num of
files per store. Only one such aggressive compaction is queued per store at any
point.
The number of iops on the disk and the top of the rack bandwidth utilization at
off peak hours is much lower than at peak hours depending on the application
usage pattern. We can utilize this knowledge to improve the performance of the
HBase cluster by increasing the compact selection ratio to a much larger value
during off-peak hours than otherwise - increasing hbase.hstore.compaction.ratio
(1.2 default) to hbase.hstore.compaction.ratio.offpeak (5 default). This will
help reduce the average number of files per store.
Test Plan: Started running the unit tests.
Reviewers: JIRA, Kannan, nspiegelberg, mbautin, stack
Reviewed By: nspiegelberg
CC: nspiegelberg, tedyu, lhofhansl, Karthik
Differential Revision: 471
karthik :
Files :
* /hbase/trunk/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
* /hbase/trunk/src/main/java/org/apache/hadoop/hbase/regionserver/Store.java
*
/hbase/trunk/src/main/java/org/apache/hadoop/hbase/regionserver/compactions/CompactSelection.java
*
/hbase/trunk/src/main/java/org/apache/hadoop/hbase/regionserver/compactions/CompactionRequest.java
*
/hbase/trunk/src/test/java/org/apache/hadoop/hbase/regionserver/TestCompactSelection.java
> Run more aggressive compactions during off peak hours
> -----------------------------------------------------
>
> Key: HBASE-4463
> URL: https://issues.apache.org/jira/browse/HBASE-4463
> Project: HBase
> Issue Type: Improvement
> Components: regionserver
> Reporter: Karthik Ranganathan
> Assignee: Karthik Ranganathan
> Fix For: 0.94.0
>
> Attachments: HBASE-4463.D471.1.patch, HBASE-4463.D471.2.patch
>
>
> The number of iops on the disk and the top of the rack bandwidth utilization
> at off peak hours is much lower than at peak hours depending on the
> application usage pattern. We can utilize this knowledge to improve the
> performance of the HBase cluster by increasing the compact selection ratio to
> a much larger value during off-peak hours than otherwise - increasing
> hbase.hstore.compaction.ratio (1.2 default) to
> hbase.hstore.compaction.ratio.offpeak (5 default). This will help reduce the
> average number of files per store.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
