Barak Ben-Nathan created FLINK-38529:
----------------------------------------
Summary: Silent record dropping when exceeding Kafka
max.request.size
Key: FLINK-38529
URL: https://issues.apache.org/jira/browse/FLINK-38529
Project: Flink
Issue Type: Bug
Components: Connectors / Kafka
Affects Versions: 1.18.1
Reporter: Barak Ben-Nathan
+Environment:
+
Flink 1.18.1
flink-connector-kafka 3.2.0-1.18
+Issue:
+
When our Flink jobs process records that exceed the configured Kafka producer
`max.request.size` parameter, the records are silently dropped and processing
continues without any warning or error logs.
While debugging, I discovered that the
`org.apache.kafka.common.errors.RecordTooLargeException` is caught in the
`onCompletion#WriterCallback` method, but it is not propagated upward to fail
the job as expected.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
