Beebs.systap added a comment. In https://phabricator.wikimedia.org/T90109#1058712, @Joe wrote:
> First of all, sorry If I did not get back to you earlier. > > I don't like the idea of having a complex tool like zookeeper running just to > ensure HA. This is actually pretty bad for me, but still not a blocker per se. > > We surely don't want to run Zookeeper in share with analytics, we do have > different needs/usage patterns and we surely don't need to cross our work > with them. > > We also don't want something as important as Zookeeper on VMs, IMO. At least > not until our virtualization infrastructure is a bit more tested out (right > now we're just starting to build it in codfw). > > So I'd say that as long as we plan from the start to have 1 master and N > slaves for BlazeGraph with N>1 (a wise choice anyways) we can co-host > zookeeper on the same machines, if this doesn't starve system resources in > some way. I'll have to investigate that but I guess that's a pretty common > usage pattern. In HA our usage of ZK is a little different than systems like Hadoop, SolrCloud, etc. We only use ZK for the leader follower elections and we use Apache River for the distributed state transfer, i.e. writes/updates are not sent through ZK. As such, it's likely that you won't see issues with co-hosting ZKs on the same machines. We are doing internal testing with the effects of running an embedded ZK as our usages is fairly light. TASK DETAIL https://phabricator.wikimedia.org/T90109 REPLY HANDLER ACTIONS Reply to comment or attach files, or !close, !claim, !unsubscribe or !assign <username>. EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Joe, Beebs.systap Cc: JanZerebecki, Beebs.systap, Haasepeter, Aklapper, Manybubbles, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, GWicke, daniel _______________________________________________ Wikidata-bugs mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
