[
https://issues.apache.org/jira/browse/HBASE-22617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Duo Zhang updated HBASE-22617:
------------------------------
Release Note:
In HBASE-20723 and HBASE-20734 we moved the recovered.edits onto the wal file
system but when constructing the directory we missed the
BASE_NAMESPACE_DIR('data'). So when using the default config, you will find
that there are lots of new directories at the same level with the 'data'
directory.
In this issue, we add the BASE_NAMESPACE_DIR back, and also try our best to
clean up the wrong directories. But we can only clean up the region level
directories, so if you want a clean fs layout on HDFS you still need to
manually delete the empty directories at the same level with 'data'.
The effect versions are 2.2.0, 2.1.[0-5].
was:
In HBASE-20723 and HBASE-20734 we moved the recovered.edits onto the wal file
system but when constructing the directory we missed the
BASE_NAMESPACE_DIR('data'). So when using the default config, you will find
that there are lots of new directories at the same level with the 'data'
directory.
In this issue, we add the BASE_NAMESPACE_DIR back, and also try our best to
clean up the wrong directories. But we can only clean up the region level
directories, so if you want a clean fs layout on HDFS you still need to
manually delete the empty directories at the same level with 'data'.
The effect versions are 2.2.0, 2.1.[1-5].
> Recovered WAL directories not getting cleaned up
> ------------------------------------------------
>
> Key: HBASE-22617
> URL: https://issues.apache.org/jira/browse/HBASE-22617
> Project: HBase
> Issue Type: Bug
> Components: wal
> Affects Versions: 1.5.0
> Reporter: Abhishek Singh Chouhan
> Assignee: Duo Zhang
> Priority: Blocker
> Fix For: 3.0.0, 1.5.0, 2.3.0, 2.0.6, 2.2.1, 2.1.6, 1.4.11
>
>
> While colocating the recovered edits directory with hbase.wal.dir,
> BASE_NAMESPACE_DIR got missed. This results in recovered edits being put in a
> separate directory rather than the default region directory even if the
> hbase.wal.dir is not overridden. Eg. if data is stored in
> /hbase/data/namespace/table1, recovered edits are put in
> /hbase/namespace/table1. This also messes up the regular cleaner chores which
> never operate on this new directory and these directories will never be
> deleted, even for split parents or dropped tables. We should change the
> default back to have the base namespace directory in path.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
