[ 
https://issues.apache.org/jira/browse/HDFS-3425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13397029#comment-13397029
 ] 

Todd Lipcon commented on HDFS-3425:
-----------------------------------

My plan is the following (similar to what you said:)

3. tail finalized segments
4. transit to active mode
5. calls recoverUnclosedStreams()
5a. Does the "recovery" process whereby it determines the correct txn to 
synchronize to
5b. finalizes the last segment to this txnid on all the available JNs
6. reads the last finalized segment
7. begins writing at the next txid

I think this interface can be kept entirely generic -- 
recoverUnfinalizedSegments() is already a JM API which is implemented correctly 
by FileJournalManager.

Looking at {{startActiveServices()}} we basically already take this approach of 
calling {{recoverUnclosedStreams()}} followed by tailing edits one more time 
before writing.
                
> Enable standby namenode to tail edits from journal service
> ----------------------------------------------------------
>
>                 Key: HDFS-3425
>                 URL: https://issues.apache.org/jira/browse/HDFS-3425
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: ha, name-node
>            Reporter: Brandon Li
>            Assignee: Brandon Li
>         Attachments: HDFS-3425.HDFS-3092.patch, HDFS-3425.HDFS-3092.patch.2
>
>
> In an HA cluster with the journal service configured, namenode should get 
> edit logs from journal service instead of from local or shared storage 
> directories.  
> As one of the first steps towards this goal, this JIRA is to enable standby 
> namenode to tail edits from journal services. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to