Re: How to fetch kafka Message have [KEY,VALUE] pair

2016-04-22 Thread Robert Metzger
If you've serialized your data with a custom format, you can also implement a custom deserializer using the KeyedDeserializationSchema. On Fri, Apr 22, 2016 at 2:35 PM, Till Rohrmann wrote: > Depending on how the key value pair is encoded, you could use the > TypeInformationKeyValueSerialization

Re: How to fetch kafka Message have [KEY,VALUE] pair

2016-04-22 Thread Till Rohrmann
Depending on how the key value pair is encoded, you could use the TypeInformationKeyValueSerializationSchema where you provide the BasicTypeInfo.STRING_TYPE_INFO and PrimitiveArrayTypeInfo.BYTE_PRIMITIVE_ARRAY_TYPE_INFO as the key and value type information. But this only works if your data was ser

How to fetch kafka Message have [KEY,VALUE] pair

2016-04-21 Thread prateek arora
Hi I am new for Apache Flink and start using Flink version 1.0.1 In my scenario, kafka message have key value pair [String,Array[Byte]] . I tried to use FlinkKafkaConsumer08 to fetch data but i dont know how to write DeserializationSchema for that. val stream : DataStream[(String,Array[Byte