Hey Ethan, Yes, we plan to support this, but haven't done any testing with it yet.
The main question that I have is whether supporting HA RM requires Samza's AM to have code changes, or whether the YARN AM client will transparently handle RM failover. Until we run some tests on this (or are told otherwise), I just don't know (and haven't had time to investigate). Does anyone know the answer to this question? Cheers, Chris On 9/11/14 1:55 PM, "Ethan Setnik" <[email protected]> wrote: >Yarn 2.4.0 brings support for high availability configurations by >specifying a cluster of resource managers and a state store via zookeeper. > > >"When there are multiple RMs, the configuration (yarn-site.xml) used by >clients and nodes is expected to list all the RMs. Clients, >ApplicationMasters (AMs) and NodeManagers (NMs) try connecting to the RMs >in a round-robin fashion until they hit the Active RM. If the Active goes >down, they resume the round-robin polling until they hit the "new" >Active.² > > >Does Samza have any plans to support Yarn HA configurations?
