Hi! Thanks for the greate work and I'm excited to see it happens. This KIP looks well to me. Seems Batch Coordinator is very important in the diskless implementation, could you explain more details on the implementation? I think it'll be much better to show what Batch Coordinator will do when write/read or other request comes.
I'm also wondering how it "chooses the total ordering for writes" and what's the "information necessary to support idempotent producers". I'm thinking about the following cases: 1: client is going to send message A, B, C to Kafka 2: client sending A, B to broker1, broker1 recieve A, B 3: broker1 down, client send C to broker2 4: since broker1 is down, then client recieve A,B fail and retry to send A,B to broker2 Then, how Batch Coordinator can choose total order to be A,B,C ? Best regards, Yuxia ----- 原始邮件 ----- 发件人: "Ivan Yurchenko" <i...@ivanyu.me> 收件人: "dev" <dev@kafka.apache.org> 发送时间: 星期三, 2025年 4 月 23日 下午 5:46:46 主题: [SPAM][DISCUSS] KIP-1164: Topic Based Batch Coordinator Hi all! We want to start the discussion thread for KIP-1164: Topic Based Batch Coordinator [1], which is a sub-KIP for KIP-1150 [2]. Let's use the main KIP-1150 discuss thread [3] for high-level questions, motivation, and general direction of the feature and this thread for discussing the batch coordinator interface and the proposed topic-based implementation. Best, Ivan [1] https://cwiki.apache.org/confluence/display/KAFKA/KIP-1164%3A+Topic+Based+Batch+Coordinator [2] https://cwiki.apache.org/confluence/display/KAFKA/KIP-1150%3A+Diskless+Topics [3] https://lists.apache.org/thread/ljxc495nf39myp28pmf77sm2xydwjm6d
