[
https://issues.apache.org/jira/browse/HBASE-19478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16307514#comment-16307514
]
Hudson commented on HBASE-19478:
--------------------------------
FAILURE: Integrated in Jenkins build HBase-Trunk_matrix #4325 (See
[https://builds.apache.org/job/HBase-Trunk_matrix/4325/])
HBASE-19478 Utilize multi-get to speed up WAL file checking in (tedyu: rev
cafd4e4ad76f45be912edc9d5021f872de94fd5c)
* (edit)
hbase-backup/src/main/java/org/apache/hadoop/hbase/backup/master/BackupLogCleaner.java
* (edit)
hbase-backup/src/main/java/org/apache/hadoop/hbase/backup/impl/BackupSystemTable.java
* (edit)
hbase-backup/src/test/java/org/apache/hadoop/hbase/backup/TestBackupSystemTable.java
> Utilize multi-get to speed up WAL file checking in BackupLogCleaner
> -------------------------------------------------------------------
>
> Key: HBASE-19478
> URL: https://issues.apache.org/jira/browse/HBASE-19478
> Project: HBase
> Issue Type: Improvement
> Reporter: Ted Yu
> Assignee: Toshihiro Suzuki
> Fix For: 3.0.0
>
> Attachments: HBASE-19478.patch, HBASE-19478.v2.patch,
> HBASE-19478.v3.patch
>
>
> Currently BackupLogCleaner#getDeletableFiles() issues one Get per WAL file:
> {code}
> for (FileStatus file : files) {
> String wal = file.getPath().toString();
> boolean logInSystemTable = table.isWALFileDeletable(wal);
> {code}
> This is rather inefficient considering the number of WAL files in production
> can get quite large.
> We should use multi-get to reduce the number of calls to backup table (which
> normally resides on another server).
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
