[
https://issues.apache.org/jira/browse/HBASE-17280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15849645#comment-15849645
]
Hudson commented on HBASE-17280:
--------------------------------
FAILURE: Integrated in Jenkins build HBase-Trunk_matrix #2429 (See
[https://builds.apache.org/job/HBase-Trunk_matrix/2429/])
HBASE-17280 Add mechanism to control hbase cleaner behavior (busbey: rev
f8b1f57b057eabfe6aa6434a790c685dd964a513)
* (edit)
hbase-client/src/main/java/org/apache/hadoop/hbase/client/HBaseAdmin.java
* (edit)
hbase-client/src/main/java/org/apache/hadoop/hbase/shaded/protobuf/RequestConverter.java
* (add) hbase-shell/src/main/ruby/shell/commands/cleaner_chore_switch.rb
* (edit)
hbase-server/src/main/java/org/apache/hadoop/hbase/master/cleaner/CleanerChore.java
* (edit)
hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java
* (edit) hbase-shell/src/main/ruby/hbase/admin.rb
* (edit)
hbase-protocol-shaded/src/main/java/org/apache/hadoop/hbase/shaded/protobuf/generated/MasterProtos.java
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
* (edit) hbase-shell/src/main/ruby/shell.rb
* (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/Admin.java
* (edit)
hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterRpcServices.java
* (edit)
hbase-server/src/test/java/org/apache/hadoop/hbase/master/cleaner/TestCleanerChore.java
* (edit)
hbase-client/src/main/java/org/apache/hadoop/hbase/shaded/protobuf/ResponseConverter.java
* (add) hbase-shell/src/main/ruby/shell/commands/cleaner_chore_enabled.rb
* (add) hbase-shell/src/main/ruby/shell/commands/cleaner_chore_run.rb
* (edit) hbase-protocol-shaded/src/main/protobuf/Master.proto
> Add mechanism to control hbase cleaner behavior
> -----------------------------------------------
>
> Key: HBASE-17280
> URL: https://issues.apache.org/jira/browse/HBASE-17280
> Project: HBase
> Issue Type: Improvement
> Components: Client, hbase, shell
> Affects Versions: 2.0.0, 1.2.0
> Reporter: Ajay Jadhav
> Priority: Minor
> Fix For: 2.0.0, 1.2.0
>
> Attachments: HBASE-17280.branch-1.2.patch,
> HBASE-17280.branch-2.0.patch, HBASE-17280.master.003.patch,
> HBASE-17280.master.004.patch, HBASE-17280.master.005.patch,
> HBASE-17280.v1-branch-1.2.patch, HBASE-17280.v2-branch-1.2.patch,
> HBASE-17280.v2-branch-2.patch
>
>
> Cleaner is used to get rid of archived HFiles and old WALs in HBase.
> In the case of heavy workload, cleaner can affect query performance by
> creating a lot of connections to perform costly reads/ writes against
> underlying filesystem.
> This patch allows the user to control HBase cleaner behavior by providing
> shell commands to enable/ disable and manually run it.
> Our main intention with this patch was to avoid running the expensive cleaner
> chore during peak times. During our experimentation, we saw a lot of HFiles
> and WAL log related files getting created inside archive dir (didn't see
> ZKlock related files). Since we were replacing hdfs with S3, these delete
> calls will take forever to complete.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
