Re: [DISCUSS] KIP-1046: Expose producer.id.expiration.check.interval.ms as dynamic broker configuration

2024-06-06 Thread Divij Vaidya
Hey Jorge I understand the pain point which is driving this KIP. An operator should be able to proactively mitigate an impending OOM due to large number of producers. I would like to hear your thoughts on alternative ways to solve this problem. As an example, we could potentially add an operator

Re: [DISCUSS] KIP-1046: Expose producer.id.expiration.check.interval.ms as dynamic broker configuration

2024-05-16 Thread Jorge Esteban Quilcate Otoya
Thanks Justine. I have updated the KIP with the configuration details. On Thu, 16 May 2024 at 21:14, Justine Olshan wrote: > Hey Jorge, > > Thanks for the KIP. I didn't realize until I read the details that this > configuration is currently not public at all. I think it is still ok that > we

Re: [DISCUSS] KIP-1046: Expose producer.id.expiration.check.interval.ms as dynamic broker configuration

2024-05-16 Thread Justine Olshan
Hey Jorge, Thanks for the KIP. I didn't realize until I read the details that this configuration is currently not public at all. I think it is still ok that we are exposing the value though. Can we just include some information about the current default, the documentation etc that is already

[DISCUSS] KIP-1046: Expose producer.id.expiration.check.interval.ms as dynamic broker configuration

2024-05-16 Thread Jorge Esteban Quilcate Otoya
Hi dev team, I'd like to start a discussion thread for KIP-1046: https://cwiki.apache.org/confluence/display/KAFKA/KIP-1046%3A+Expose+producer.id.expiration.check.interval.ms+as+dynamic+broker+configuration This KIP aims to align how tuning configurations for Producer ID expiration checks are