[
https://issues.apache.org/jira/browse/HBASE-3150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12970316#action_12970316
]
Mingjie Lai commented on HBASE-3150:
------------------------------------
A WAL coprocessor (HBASE-3257) can help to solve the problem.
By a WAL cp implementation, one or multiple specified columns can be removed
from the passed WALEdit before appending to WAL, so that they will be ignored
at WAL. However they will still be written to store files.
Another option is to utilize existing WALObserver which provides a hook to
insert user code before HLog.doWrite(). But currently it doesn't support to
modify the passed WALEdit. I think Coprocessor is a better way to do it.
> Allow some column to not write WALs
> -----------------------------------
>
> Key: HBASE-3150
> URL: https://issues.apache.org/jira/browse/HBASE-3150
> Project: HBase
> Issue Type: Improvement
> Reporter: Karthik Ranganathan
> Priority: Minor
>
> We have this unique requirement where some column families hold data that is
> indexed from other existing column families. The index data is very large,
> and we end up writing these inserts into the WAL and then into the store
> files. In addition to taking more iops, this also slows down splitting files
> for recovery, etc.
> Creating this task to have an option to suppress WAL logging on a per CF
> basis.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
