[ 
https://issues.apache.org/jira/browse/HBASE-2231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12844304#action_12844304
 ] 

dhruba borthakur commented on HBASE-2231:
-----------------------------------------

A offline discussion among Karthik and Arvind resulted in the idea that the 
master should rename the directory where hlogs are written. It should then open 
the last file for "append" to ensure that the old region server cannot write 
anymore to it. After that, the master is free to safely process all the logs in 
the hlog directory.

This would need that the region server use org.apache.hadoop.fs.create() while 
crearing a hlog file (which allows failing a create if any intermediate 
directory in the path is absent).

> Compaction events should be written to HLog
> -------------------------------------------
>
>                 Key: HBASE-2231
>                 URL: https://issues.apache.org/jira/browse/HBASE-2231
>             Project: Hadoop HBase
>          Issue Type: Improvement
>          Components: regionserver
>            Reporter: Todd Lipcon
>
> The sequence for a compaction should look like this:
> # Compact region to "new" files
> # Write a "Compacted Region" entry to the HLog
> # Delete "old" files
> This deals with a case where the RS has paused between step 1 and 2 and the 
> regions have since been reassigned.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply via email to