I suggest you check KIP-30 and the extensive discussion about it in the mailing list from around December 2015 called "[DISCUSS] KIP-30 Allow for brokers to have plug-able consensus and meta data storage sub systems" If I remember correctly, it ran into some objections, as the existing commiters thought at the time that ZK was significantly more reliable, so it was not worth the effort to add inferior options. I personally think nowadays, when a lot of other critical cluster infra relies on these coordination services anyway, this KIP makes a lot of sense. The current dependency of ZK creates a large, unneeded operational overhead for those who have already deployed and relies on etcd/consul for the rest of their stack (including other stateful services). Just my two cents,
Ofir Manor Co-Founder & CTO | Equalum Mobile: +972-54-7801286 | Email: ofir.ma...@equalum.io On Mon, Mar 6, 2017 at 12:15 PM, Alexander Binzberger < alexander.binzber...@wingcon.com> wrote: > I would also be interested in this. (etcd) > > > Am 02.03.2017 um 12:24 schrieb Molnár Bálint: > >> Hi, >> >> I was wonderring to refactor Kafka core code to be able to use different >> Coordination Service than Zookeeper. I know I will need to create a KIP >> for >> that. >> I think the first part of this task to refactor the classes which are >> using >> the ZkUtil methods to use a zookeeper independent trait instead. >> After that I think it will be possible to replace Zookeeper with >> etcd/Consul or even with a Raft implementation. >> Even without additional implementation it would help to test the code >> without starting an embedded zookeeper. >> I have already started to implement a POC and it seems doable, even if >> it's >> not a small patch. >> >> Balint >> >> > -- > Alexander Binzberger > System Designer - WINGcon AG > Tel. +49 7543 966-119 > > Sitz der Gesellschaft: Langenargen > Registergericht: ULM, HRB 734260 > USt-Id.: DE232931635, WEEE-Id.: DE74015979 > Vorstand: thomasThomas Ehrle (Vorsitz), Fritz R. Paul (Stellvertreter), > Tobias Treß > Aufsichtsrat: Jürgen Maucher (Vorsitz), Andreas Paul (Stellvertreter), > Martin Sauter > >
