[
https://issues.apache.org/jira/browse/HBASE-16981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15666761#comment-15666761
]
Jingcheng Du commented on HBASE-16981:
--------------------------------------
Thanks Anoop.
bq. One quick Q is what if policy is monthly? The major compaction will happen
only once in a month? Or say it is yearly then till end of the year only minor
compactions? WHat abt #files issue then?
The frequency of the mob compaction is not related with the partition policy.
The partition policy tells how to group mob files. For example if we define a
yearly policy, the mob files within the same year would be regarded as a group
and compacted together as one or several new files. The frequency is defined by
the interval in configurations, it tells how often such compactions run, and is
not related with the policy.
> Expand Mob Compaction Partition policy from daily to weekly, monthly and
> beyond
> -------------------------------------------------------------------------------
>
> Key: HBASE-16981
> URL: https://issues.apache.org/jira/browse/HBASE-16981
> Project: HBase
> Issue Type: New Feature
> Components: mob
> Affects Versions: 2.0.0
> Reporter: huaxiang sun
> Assignee: huaxiang sun
> Attachments: HBASE-16981.master.001.patch,
> HBASE-16981.master.002.patch,
> Supportingweeklyandmonthlymobcompactionpartitionpolicyinhbase.pdf
>
>
> Today the mob region holds all mob files for all regions. With daily
> partition mob compaction policy, after major mob compaction, there is still
> one file per region daily. Given there is 365 days in one year, at least 365
> files per region. Since HDFS has limitation for number of files under one
> folder, this is not going to scale if there are lots of regions. To reduce
> mob file number, we want to introduce other partition policies such as
> weekly, monthly to compact mob files within one week or month into one file.
> This jira is create to track this effort.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
