tdwells90 commented on PR #4258: URL: https://github.com/apache/iggy/pull/4258#issuecomment-5836670243
While Iggy is unreachable, a named Metadata lookup answers each topic `NOT_LEADER_OR_FOLLOWER` with no partitions. librdkafka 1.x treats any topic error with no partitions, other than an unknown or invalid topic, as permanent and fails every queued record, so producers lose records within seconds of an Iggy outage, whatever their delivery timeout. We patched our copy to remember each topic's partition count whenever Iggy describes it, answer from that while Iggy can't be asked, and send `LEADER_NOT_AVAILABLE` for a topic not seen yet. Sends then fail per partition, which clients retry. Happy to open a follow-up PR once this lands. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
