[
https://issues.apache.org/jira/browse/HBASE-4463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Phabricator updated HBASE-4463:
-------------------------------
Attachment: HBASE-4463.D471.1.patch
Karthik requested code review of "HBASE-4463 [jira] Run more aggressive
compactions during off peak hours".
Reviewers: JIRA
HBASE-4463 Run more aggressive compactions during off peak hours
Increases the compact selection ratio from 1.3 to 5 at off-peak hours. This
will help utilize the available iops and bandwidth to decrease average num of
files per store. Only one such aggressive compaction is queued per store at
any
point.
The number of iops on the disk and the top of the rack bandwidth utilization
at off peak hours is much lower than at peak hours depending on the application
usage pattern. We can utilize this knowledge to improve the performance of the
HBase cluster by increasing the compact selection ratio to a much larger value
during off-peak hours than otherwise - increasing hbase.hstore.compaction.ratio
(1.2 default) to hbase.hstore.compaction.ratio.offpeak (5 default). This will
help reduce the average number of files per store.
TEST PLAN
Started running the unit tests.
REVISION DETAIL
https://reviews.facebook.net/D471
AFFECTED FILES
src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
src/main/java/org/apache/hadoop/hbase/regionserver/Store.java
src/main/java/org/apache/hadoop/hbase/regionserver/compactions/CompactSelection.java
src/main/java/org/apache/hadoop/hbase/regionserver/compactions/CompactionRequest.java
src/test/java/org/apache/hadoop/hbase/regionserver/TestCompactSelection.java
MANAGE HERALD DIFFERENTIAL RULES
https://reviews.facebook.net/herald/view/differential/
WHY DID I GET THIS EMAIL?
https://reviews.facebook.net/herald/transcript/993/
Tip: use the X-Herald-Rules header to filter Herald messages in your client.
> Run more aggressive compactions during off peak hours
> -----------------------------------------------------
>
> Key: HBASE-4463
> URL: https://issues.apache.org/jira/browse/HBASE-4463
> Project: HBase
> Issue Type: Improvement
> Components: regionserver
> Reporter: Karthik Ranganathan
> Assignee: Karthik Ranganathan
> Attachments: HBASE-4463.D471.1.patch
>
>
> The number of iops on the disk and the top of the rack bandwidth utilization
> at off peak hours is much lower than at peak hours depending on the
> application usage pattern. We can utilize this knowledge to improve the
> performance of the HBase cluster by increasing the compact selection ratio to
> a much larger value during off-peak hours than otherwise - increasing
> hbase.hstore.compaction.ratio (1.2 default) to
> hbase.hstore.compaction.ratio.offpeak (5 default). This will help reduce the
> average number of files per store.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
