[jira] [Commented] (HBASE-25363) Improve performance of HFileLinkCleaner by using ReadWriteLock instead of synchronize
[
https://issues.apache.org/jira/browse/HBASE-25363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246729#comment-17246729
]
Hudson commented on HBASE-25363:
Results for branch branch-2
[build #125 on
builds.a.o|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2/125/]:
(/) *{color:green}+1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2/125/General_20Nightly_20Build_20Report/]
(/) {color:green}+1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2/125/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/]
(/) {color:green}+1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2/125/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 jdk11 hadoop3 checks{color}
-- For more information [see jdk11
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2/125/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> Improve performance of HFileLinkCleaner by using ReadWriteLock instead of
> synchronize
> -
>
> Key: HBASE-25363
> URL: https://issues.apache.org/jira/browse/HBASE-25363
> Project: HBase
> Issue Type: Improvement
> Components: master
>Reporter: Xiaolin Ha
>Assignee: Xiaolin Ha
>Priority: Major
> Fix For: 3.0.0-alpha-1, 2.5.0
>
>
> HFileLinkCleaner uses synchronized method isFileDeletable, as a result, to
> cross the cleaner chain, all files will be processed serially. It may block
> the fork-join thread which scans out some archived files.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HBASE-25363) Improve performance of HFileLinkCleaner by using ReadWriteLock instead of synchronize
[
https://issues.apache.org/jira/browse/HBASE-25363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246519#comment-17246519
]
Hudson commented on HBASE-25363:
Results for branch master
[build #153 on
builds.a.o|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/master/153/]:
(/) *{color:green}+1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/master/153/General_20Nightly_20Build_20Report/]
(/) {color:green}+1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/master/153/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 jdk11 hadoop3 checks{color}
-- For more information [see jdk11
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/master/153/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> Improve performance of HFileLinkCleaner by using ReadWriteLock instead of
> synchronize
> -
>
> Key: HBASE-25363
> URL: https://issues.apache.org/jira/browse/HBASE-25363
> Project: HBase
> Issue Type: Improvement
> Components: master
>Reporter: Xiaolin Ha
>Assignee: Xiaolin Ha
>Priority: Major
> Fix For: 3.0.0-alpha-1, 2.5.0
>
>
> HFileLinkCleaner uses synchronized method isFileDeletable, as a result, to
> cross the cleaner chain, all files will be processed serially. It may block
> the fork-join thread which scans out some archived files.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HBASE-25363) Improve performance of HFileLinkCleaner by using ReadWriteLock instead of synchronize
[ https://issues.apache.org/jira/browse/HBASE-25363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17245905#comment-17245905 ] Yulin Niu commented on HBASE-25363: --- push to master and branch-2 Thanks [~Xiaolin Ha]'s contribution > Improve performance of HFileLinkCleaner by using ReadWriteLock instead of > synchronize > - > > Key: HBASE-25363 > URL: https://issues.apache.org/jira/browse/HBASE-25363 > Project: HBase > Issue Type: Improvement >Reporter: Xiaolin Ha >Assignee: Xiaolin Ha >Priority: Major > > HFileLinkCleaner uses synchronized method isFileDeletable, as a result, to > cross the cleaner chain, all files will be processed serially. It may block > the fork-join thread which scans out some archived files. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HBASE-25363) Improve performance of HFileLinkCleaner by using ReadWriteLock instead of synchronize
[ https://issues.apache.org/jira/browse/HBASE-25363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17244498#comment-17244498 ] Xiaolin Ha commented on HBASE-25363: HFileLinkCleaner is a required cleaner for almost all the cluster, I think improve the performance for it will be benefit for large clusters. > Improve performance of HFileLinkCleaner by using ReadWriteLock instead of > synchronize > - > > Key: HBASE-25363 > URL: https://issues.apache.org/jira/browse/HBASE-25363 > Project: HBase > Issue Type: Test >Reporter: Xiaolin Ha >Assignee: Xiaolin Ha >Priority: Major > > HFileLinkCleaner uses synchronized method isFileDeletable, as a result, to > cross the cleaner chain, all files will be processed serially. It may block > the fork-join thread which scans out some archived files. -- This message was sent by Atlassian Jira (v8.3.4#803005)
