Re: kafka_2.10-0.8.1 simple consumer retrieves junk data in the message

2017-01-31 Thread Anjani Gupta
We use following method to deserialize the message consumed using Simple Consumer - DatumReader datumReader = new SpecificDatumReader<>(className); ByteArrayInputStream inputStream = new ByteArrayInputStream(byteArray); Decoder decoder = DecoderFactory.get().binaryDecoder(inputStream, null); T

Re: kafka_2.10-0.8.1 simple consumer retrieves junk data in the message

2017-01-30 Thread Ewen Cheslack-Postava
What are the 26 additional bytes? That sounds like a header that a decoder/deserializer is handling with the high level consumer. What class are you using to deserialize the messages with the high level consumer? -Ewen On Fri, Jan 27, 2017 at 10:19 AM, Anjani Gupta

kafka_2.10-0.8.1 simple consumer retrieves junk data in the message

2017-01-27 Thread Anjani Gupta
I am using kafka_2.10-0.8.1 and trying to fetch messages using Simple Consumer API. I notice that byte array for message retrieved has 26 junk bytes appended at the beginning of original message sent by producer. Any idea what's going on here? This works fine with High level consumer. This is