Thanks, for the feedback. Developing an internal consensus service inside Kafka would require a team dedicated to this task. We second what Flavio said in https://lists.apache.org/thread.html/24ae56e073104c4531cf64f7a1f1c0a84f895d139d334c88e9fe6028@1449008733@%3Cdev.kafka.apache.org%3E that getting an implementation which really works and is maintainable is difficult. We think that Kafka being able to use another widely used consensus system beside Zookeeper its a safer and workable solution. It will be easier for users to use a consensus system with Kafka that they are already familiar with.
The implementation found here: https://github.com/banzaicloud/apache-kafka-on-k8s/tree/kafka-on-etcd/core/src/main/scala/kafka/etcd is a first version of enabling Etcd in Kafka. This implementation hooked in Etcd with a slight change in the existing interfaces. While this implementation works its far from being complete. Ideally existing interfaces should be reworked to abstract out the used consensus system. We opened this KIP to start a discussion and the community to have a look at the initial implementation and receive feedback if this initiative is viable. Balint 2018-03-29 11:23 GMT+02:00 Jakub Scholz <ja...@scholz.cz>: > I can understand the concerns about the plugability of Zookeeper/Etcd. It > would not be good for Kafka community if it splits into several groups > using different implementations. > > On the other hand, Zookeeper development seems to be a bit stalled. So > maybe there should be at least a discussion whether it makes sense to > replace Zookeeper with something like Etcd or not. > > JAkub > > On Wed, Mar 28, 2018 at 6:18 PM, Molnár Bálint <molnarcsi...@gmail.com> > wrote: > > > Hi all, > > > > I have created KIP-273: Kafka to support using ETCD beside Zookeeper > > > > Here is the link to the KIP: > > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP- > > 273+-+Kafka+to+support+using+ETCD+beside+Zookeeper > > > > Looking forward to the discussion. > > > > Thanks, > > Balint > > >
