Aatirhassanpir opened a new issue, #14891: URL: https://github.com/apache/pinot/issues/14891
### Description Problem Statement The Kafka producer is not correctly retrying failed messages when encountering certain exceptions that should be retriable according to the configured retry policy. This results in messages being lost when a non-retriable exception occurs, and the producer stops processing subsequent messages. ### Expected Behavior The Kafka producer should retry the message delivery when a non-retriable exception occurs, based on the retry configurations (e.g., retries, acks, max.in.flight.requests.per.connection). Instead of failing outright, the producer should handle these exceptions and attempt to resend the message until the configured retry limit is reached. ### Actual Behavior Currently, when a non-retriable exception is encountered, the Kafka producer fails to retry the delivery of the failed message. This causes message loss and prevents the producer from proceeding with further message deliveries, effectively halting the production process. ### Steps to Reproduce Configure the Kafka producer with a retry policy (e.g., set retries to a positive integer, configure acks to all, etc.). Simulate a non-retriable exception (such as a TimeoutException or a specific custom exception) while producing a message. Observe that the producer does not retry and instead fails without any retry attempts. ### Environment Kafka version: 3.0.0 Pinot version: 0.7.0 OS: Ubuntu 20.04 LTS Java version: OpenJDK 11 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
