Hi,

I would like to propose a small improvement to the Kafka connector's error
handling in KafkaRecordEmitter.

JIRA: https://issues.apache.org/jira/browse/FLINK-39320
PR: https://github.com/apache/flink-connector-kafka/pull/241

Currently, when deserialization fails, the error message is:

  "Failed to deserialize consumer record due to"

This doesn't tell you which record caused the failure. In production
environments with many topics and partitions, this makes debugging
difficult — we ran into this during a production incident where we had
to add custom logging and redeploy just to identify the problematic
record.

The proposed change adds topic, partition, and offset to the exception
message (~6 lines in KafkaRecordEmitter.java, no API or behavioral
change):

  "Failed to deserialize consumer record from topic=my-topic,
   partition=117, offset=448550177 due to"

Would this need a FLIP, or is a direct PR sufficient given the scope?

Thanks,
Pritesh

Reply via email to