[
https://issues.apache.org/jira/browse/HBASE-2231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12844304#action_12844304
]
dhruba borthakur commented on HBASE-2231:
-----------------------------------------
A offline discussion among Karthik and Arvind resulted in the idea that the
master should rename the directory where hlogs are written. It should then open
the last file for "append" to ensure that the old region server cannot write
anymore to it. After that, the master is free to safely process all the logs in
the hlog directory.
This would need that the region server use org.apache.hadoop.fs.create() while
crearing a hlog file (which allows failing a create if any intermediate
directory in the path is absent).
> Compaction events should be written to HLog
> -------------------------------------------
>
> Key: HBASE-2231
> URL: https://issues.apache.org/jira/browse/HBASE-2231
> Project: Hadoop HBase
> Issue Type: Improvement
> Components: regionserver
> Reporter: Todd Lipcon
>
> The sequence for a compaction should look like this:
> # Compact region to "new" files
> # Write a "Compacted Region" entry to the HLog
> # Delete "old" files
> This deals with a case where the RS has paused between step 1 and 2 and the
> regions have since been reassigned.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.