[ 
https://issues.apache.org/jira/browse/FLUME-1906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13574154#comment-13574154
 ] 

Mubarak Seyed commented on FLUME-1906:
--------------------------------------

bq. I am just a bit concerned about completing the transaction on the sink side 
without the data being persisted. This could potentially cause debugging issues.
I think it is a trade-off by giving up durability (for yet-to-flush in-memory 
data) to save disk space in HDFS. There are some instances where ops runs hbase 
clusters with WAL turned off to save 3 copies of WAL data in HDFS. if config 
changes for WAL then we can add a INFO in log for easy debugging.
                
> Ability to disable WAL for put operation in HBaseSink
> -----------------------------------------------------
>
>                 Key: FLUME-1906
>                 URL: https://issues.apache.org/jira/browse/FLUME-1906
>             Project: Flume
>          Issue Type: Improvement
>          Components: Sinks+Sources
>    Affects Versions: v1.3.1
>            Reporter: Mubarak Seyed
>
> HBase supports setWriteToWAL(boolean) in Put to write edits to WAL or not. 
> User can specify the disable option in HBase sink configurations.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to