Re: Discard message on deserialization errors.

2019-10-15 Thread John Smith
Ah ok thanks! On Sat, 12 Oct 2019 at 11:13, Zhu Zhu wrote: > I mean the Kafka source provided in Flink can correctly ignores null > deserialized values. > > isEndOfStream allows you to control when to end the input stream. > If it is used for running infinite stream jobs, you can simply return >

Re: Discard message on deserialization errors.

2019-10-12 Thread Zhu Zhu
I mean the Kafka source provided in Flink can correctly ignores null deserialized values. isEndOfStream allows you to control when to end the input stream. If it is used for running infinite stream jobs, you can simply return false. Thanks, Zhu Zhu John Smith 于2019年10月12日周六 下午8:40写道: > The Kaf

Re: Discard message on deserialization errors.

2019-10-12 Thread John Smith
The Kafka Fetcher you mean the flink JSON schemas? They throw IOExceptions? Also what's the purpose of isEndOfStream most schemas I looked at don't do anything but just return false? On Fri., Oct. 11, 2019, 11:44 p.m. Zhu Zhu, wrote: > Hi John, > > It should work with a *null* return value. > I

Re: Discard message on deserialization errors.

2019-10-11 Thread Zhu Zhu
Hi John, It should work with a *null* return value. In the java doc of DeserializationSchema#deserialize it says that > *@return The deserialized message as an object (null if the message cannot > be deserialized).* I also checked the Kafka fetcher in Flink and it can correctly handle a null de