[ 
https://issues.apache.org/jira/browse/HBASE-14511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14938213#comment-14938213
 ] 

Vladimir Rodionov commented on HBASE-14511:
-------------------------------------------

[[email protected]], [~enis], [~ndimiduk] can you take a look at the patch? It 
has one limitation: it does not support MOB files due to some bug inside MOB 
compaction which manifests itself when something unexpected is added to meta 
section of store file. This look like a MOB "feature/bug" to me. I want this 
JIRA to be committed asap since my compaction work depends on it and I will 
open separate JIRA to support Plugin for MOB files as well.

> StoreFile.Writer Meta Plugin
> ----------------------------
>
>                 Key: HBASE-14511
>                 URL: https://issues.apache.org/jira/browse/HBASE-14511
>             Project: HBase
>          Issue Type: New Feature
>            Reporter: Vladimir Rodionov
>            Assignee: Vladimir Rodionov
>         Attachments: HBASE-14511.v1.patch, HBASE-14511.v2.patch
>
>
> During my work on a new compaction policies (HBASE-14468, HBASE-14477) I had 
> to modify the existing code of a StoreFile.Writer to add additional meta-info 
> required by these new  policies. I think that it should be done by means of a 
> new Plugin framework, because this seems to be a general capability/feature. 
> As a future enhancement this can become a part of a more general 
> StoreFileWriter/Reader plugin architecture. But I need only Meta section of a 
> store file.
> This could be used, for example, to collect rowkeys distribution information 
> during hfile creation. This info can be used later to find the optimal region 
> split key or to create optimal set of sub-regions for M/R jobs or other jobs 
> which can operate on a sub-region level.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to