Hi Jun, Thank you for your questions!
On Tue, May 13, 2025, at 19:34, Jun Rao wrote: > Hi, Josep, > > Thanks for the KIP. At the highlevel, the KIP is well thought through and > provides multiple benefits for Kafka in the Cloud. A few comments below. > > JR1. One of the key motivations is to eliminate inter-zone data transfer > costs from Kafka replication. It would be useful to provide a short summary > regarding the cost saving from the major Cloud providers. As people > mentioned in another email, currently Azure doesn't charge for inter-zone > data transfer. Potential cost savings heavily depend on how much cross-AZ traffic and local disk contribute to the TCO. In some cases they dominate so much that savings from switching to diskless topics could be up to 80%. Since Azure doesn’t charge for cross-AZ traffic, the cost saving curve is very much shifted there and diskless topics may be not that beneficial (tiered storage may be better). Best, Ivan > > On Wed, Apr 16, 2025 at 5:00 AM Josep Prat <josep.p...@aiven.io.invalid> > wrote: > > > Hi Kafka Devs! > > > > We want to start a new KIP discussion about introducing a new type of > > topics that would make use of Object Storage as the primary source of > > storage. However, as this KIP is big we decided to split it into multiple > > related KIPs. > > We have the motivational KIP-1150 ( > > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-1150%3A+Diskless+Topics > > ) > > that aims to discuss if Apache Kafka should aim to have this type of > > feature at all. This KIP doesn't go onto details on how to implement it. > > This follows the same approach used when we discussed KRaft. > > > > But as we know that it is sometimes really hard to discuss on that meta > > level, we also created several sub-kips (linked in KIP-1150) that offer an > > implementation of this feature. > > > > We kindly ask you to use the proper DISCUSS threads for each type of > > concern and keep this one to discuss whether Apache Kafka wants to have > > this feature or not. > > > > Thanks in advance on behalf of all the authors of this KIP. > > > > ------------------ > > Josep Prat > > Open Source Engineering Director, Aiven > > josep.p...@aiven.io | +491715557497 | aiven.io > > Aiven Deutschland GmbH > > Alexanderufer 3-7, 10117 Berlin > > Geschäftsführer: Oskari Saarenmaa, Hannu Valtonen, > > Anna Richardson, Kenneth Chen > > Amtsgericht Charlottenburg, HRB 209739 B > > >
