[
https://issues.apache.org/jira/browse/HBASE-11644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14637844#comment-14637844
]
Hudson commented on HBASE-11644:
--------------------------------
FAILURE: Integrated in HBase-TRUNK #6672 (See
[https://builds.apache.org/job/HBase-TRUNK/6672/])
HBASE-11644 External MOB compaction tools (Jingcheng Du) (jmhsieh: rev
84e957c875ae971578a5b147775445368ea26188)
* hbase-server/src/main/java/org/apache/hadoop/hbase/mob/MobConstants.java
*
hbase-server/src/test/java/org/apache/hadoop/hbase/mob/mapreduce/TestMobSweepJob.java
*
hbase-server/src/main/java/org/apache/hadoop/hbase/mob/mapreduce/SweepMapper.java
*
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestMobStoreScanner.java
*
hbase-server/src/test/java/org/apache/hadoop/hbase/mob/mapreduce/TestMobSweeper.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/mob/MobUtils.java
*
hbase-server/src/main/java/org/apache/hadoop/hbase/mob/mapreduce/MemStoreWrapper.java
*
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestMobCompaction.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/mob/mapreduce/Sweeper.java
*
hbase-server/src/main/java/org/apache/hadoop/hbase/mob/ExpiredMobFileCleaner.java
*
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MobReferenceOnlyFilter.java
*
hbase-server/src/main/java/org/apache/hadoop/hbase/master/ExpiredMobFileCleanerChore.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/mob/mapreduce/SweepJob.java
*
hbase-server/src/main/java/org/apache/hadoop/hbase/mob/mapreduce/SweepJobNodeTracker.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/mob/MobZookeeper.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HMobStore.java
*
hbase-server/src/main/java/org/apache/hadoop/hbase/mob/mapreduce/SweepReducer.java
*
hbase-server/src/test/java/org/apache/hadoop/hbase/mob/TestExpiredMobFileCleaner.java
*
hbase-server/src/test/java/org/apache/hadoop/hbase/mob/mapreduce/TestMobSweepMapper.java
*
hbase-server/src/main/java/org/apache/hadoop/hbase/mob/mapreduce/MobFilePathHashPartitioner.java
* hbase-common/src/main/resources/hbase-default.xml
*
hbase-server/src/test/java/org/apache/hadoop/hbase/mob/mapreduce/TestMobSweepReducer.java
*
hbase-server/src/main/java/org/apache/hadoop/hbase/mob/DefaultMobCompactor.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
> External MOB compaction tools
> -----------------------------
>
> Key: HBASE-11644
> URL: https://issues.apache.org/jira/browse/HBASE-11644
> Project: HBase
> Issue Type: Sub-task
> Components: Compaction, master
> Affects Versions: hbase-11339
> Reporter: Jingcheng Du
> Assignee: Jingcheng Du
> Fix For: hbase-11339
>
> Attachments: HBASE-11644-Sep-15.diff, HBASE-11644-Sep-16.diff,
> HBASE-11644-Sep-16.diff, HBASE-11644-Sep-18.diff,
> HBASE-11644-Sep-19-V2.patch, HBASE-11644-Sep-19.diff, HBASE-11644.diff,
> HBASE-11646-0918-bad.patch
>
>
> From the design doc, mob files are not involved in the normal HBase
> compaction process. This means deleted mobs would still take up space and
> that we never really merge mob files that accrue over time. Currently, MOBs
> depend on two external tools:
> 1) A TTL cleaner that removes mobs that have passed their TTL or exceeded
> minVersions.
> 2) A 'sweep tool' cleaner that remove mobs that have had their references
> deleted and merges small files into larger ones.
> Today the tools are triggered by admins. The longer term goal would be to
> integrate them into hbase such that by default mobs are cleaned. The tools
> will be preserved however so that advanced admins can disable automatic
> cleanups and manually trigger these compaction like operaitons. #1 would
> likely be a chore in the master while #2 requires some design work to
> integrate into hbase.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
