kafka_2.10-0.8.1 simple consumer retrieves junk data in the message

[Anjani Gupta]

I am using kafka_2.10-0.8.1 and trying to fetch messages using Simple
Consumer API. I notice that byte array for message retrieved has 26 junk
bytes appended at the beginning  of original message sent by producer. Any
idea what's going on here? This works fine with High level consumer.

This is how my code looks like -

TopicAndPartition topicAndPartition = new TopicAndPartition(topic,
partition);
        OffsetFetchResponse offsetFetchResponse = consumer.fetchOffsets(new
OffsetFetchRequest(GROUP_ID,
                Collections.singletonList(topicAndPartition), (short) 0, 0,
CLIENT_ID));

        //Fetch messages from Kafka.
        FetchRequest req = new FetchRequestBuilder()
                .clientId(CLIENT_ID)
                .addFetch(topic, partition, readOffset, 1000)
                .build();
        FetchResponse fetchResponse = consumer.fetch(req);
        for (MessageAndOffset messageAndOffset :
fetchResponse.messageSet(topicName, partition)) {
            byte[] message = messageAndOffset.message().payload().array();

}

Here message has additional 26 bytes appended to beginning of array.


Thanks,
Anjani