[
https://issues.apache.org/jira/browse/HBASE-26342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17542120#comment-17542120
]
Hudson commented on HBASE-26342:
--------------------------------
Results for branch branch-2.5
[build #126 on
builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/126/]:
(/) *{color:green}+1 overall{color}*
----
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/126/General_20Nightly_20Build_20Report/]
(/) {color:green}+1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/126/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/]
(/) {color:green}+1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/126/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 jdk11 hadoop3 checks{color}
-- For more information [see jdk11
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/126/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> Support custom paths of independent configuration and pool for hfile cleaner
> ----------------------------------------------------------------------------
>
> Key: HBASE-26342
> URL: https://issues.apache.org/jira/browse/HBASE-26342
> Project: HBase
> Issue Type: New Feature
> Components: master
> Affects Versions: 1.7.1, 3.0.0-alpha-2, 2.4.10
> Reporter: Xiaolin Ha
> Assignee: Xiaolin Ha
> Priority: Major
> Fix For: 2.5.0, 2.6.0, 3.0.0-alpha-3
>
> Attachments: result.png
>
>
> With this, we can clean some paths more quickly.
> We found in our cluster, when the very huge table with thousands of regions
> and high write throughputs and many snapshots tables on the same cluster, the
> speed of delete files in archive path will lower than the speed of moved in
> files by compaction. Then archive may remains PB level data.
> The bottleneck is in cleaner but not in the thread pool size or queue size.
> It is because there is synchronized lock in SnapshotFileCache, and a batch of
> files need once SnapshotFileCache#refreshCache(), which look through all the
> snapshot dirs.
> The speed of clear a path without the SnapshotHFileCleaner is thirty times
> faster.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
