lamber-ken commented on issue #8583: [FLINK-11820][serialization] 
SimpleStringSchema handle message record which value is null
URL: https://github.com/apache/flink/pull/8583#issuecomment-505381752
 
 
   > Yes, the Kafka consumer swallows them silently, but if you change 
`SimpleStringSchema`, it will create the nulls in the first place. The problem 
is in the interaction of the different parts, so we cannot change 
`SimpleStringSchema` in isolation because it would lead to silent data dropping.
   
   Thanks for your comment. But, I have a slightly different view from yours. 
Users may not care about the null values in many scenarios, and if mq queue 
contains a null value, the consumer will can not comsumer any records because 
of the NPE and the kafka offset can't commit anymore. 
   
   Users can use `TypeInformationKeyValueSerializationSchema` to handle null 
valuses for now.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to