Pierre Zemb created FLINK-12400:
-----------------------------------
Summary: NullpointerException using SimpleStringSchema with Kafka
Key: FLINK-12400
URL: https://issues.apache.org/jira/browse/FLINK-12400
Project: Flink
Issue Type: Improvement
Components: API / Type Serialization System
Affects Versions: 1.8.0, 1.7.2
Environment: Flink 1.7.2 job on 1.8 cluster
Kafka 0.10 with a topic in log-compaction
Reporter: Pierre Zemb
Assignee: Pierre Zemb
Hi!
Yesterday, we saw a strange behavior with our Flink job and Kafka. We are
consuming a Kafka topic setup in
[log-compaction|https://kafka.apache.org/documentation/#compaction] mode. As
such, sending a message with a null payload acts like a tombstone.
We are consuming Kafka like this:
{code:java}
new FlinkKafkaConsumer010<> ("topic", new SimpleStringSchema(),
this.kafkaProperties)
{code}
When we sent the message, job failed because of a NullPointerException
[here|https://github.com/apache/flink/blob/master/flink-core/src/main/java/org/apache/flink/api/common/serialization/SimpleStringSchema.java#L75].
`byte[] message` was null, causing the NPE.
We forked the class and added a basic nullable check, returning null if so. It
fixed our issue.
Should we add it to the main class?
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)