[ 
https://issues.apache.org/jira/browse/OOZIE-615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Robert Kanter updated OOZIE-615:
--------------------------------

    Attachment: OozieHADesign.pdf

Here's a document describing at a high level the HA design.  

I've also mostly implemented it and should (hopefully) be able to post a patch 
on Monday.  

I didn't end up using any of the old code that Virag attached (it was _too_ old 
:)).  I ended up using Apache Curator for the ZooKeeper primitives (locks and 
service discovery).  I'll explain some more details about the 
implementation/code when I post the patch.  
                
> Support high availability for the Oozie service
> -----------------------------------------------
>
>                 Key: OOZIE-615
>                 URL: https://issues.apache.org/jira/browse/OOZIE-615
>             Project: Oozie
>          Issue Type: New Feature
>            Reporter: Craig Peters
>            Assignee: Robert Kanter
>         Attachments: OozieHADesign.pdf, zookeeper_yahoo_code.zip
>
>
> As Oozie becomes a critical component in the Hadoop ecosystem users needs 
> assured availability of the services provided by Oozie.  To support this need 
> Oozie should include a new feature to support high availability.  This 
> feature needs to take into consideration that Oozie provides RESTful APIs, 
> Java APIs, and a command line API that should all be insensitive to the 
> availability of any specific server or components.  At Yahoo! it is not 
> required that there be session fail-over from the client.  It is acceptable 
> for the client to reconnect if a session is lost as long as the state data 
> managed by the Oozie service is not lost.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to