[ 
https://issues.apache.org/jira/browse/HBASE-26320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17541236#comment-17541236
 ] 

Xiaolin Ha commented on HBASE-26320:
------------------------------------

This issue blocked the back port of HBASE-26342 to branch-2, I'll prepare a PR 
for branch-2.5+.

FYI [~apurtell].

> Separate Log Cleaner DirScanPool to prevent the OLDWALs from filling up the 
> disk when archive is large
> ------------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-26320
>                 URL: https://issues.apache.org/jira/browse/HBASE-26320
>             Project: HBase
>          Issue Type: Improvement
>          Components: Operability
>    Affects Versions: 1.7.1, 2.4.6
>            Reporter: Zach York
>            Assignee: Zach York
>            Priority: Major
>
> We currently share the DirScanPool (threadpool for scanning for files to 
> delete in the OldLogs and archive directories) between the LogCleaner and 
> HFileCleaner. This means that if the archive directory is large/has lots of 
> files/directories, the threads can get stuck scanning through the archive 
> directory, starving the LogCleaner. This is especially apparent on S3 where 
> list can be slower than on HDFS.
> This JIRA creates separate DirScanPools for the LogCleaner and HFileCleaner



--
This message was sent by Atlassian Jira
(v8.20.7#820007)

Reply via email to