Hi guys,

I'm trying to consume our Kafka topics using Kafkacat
<https://github.com/edenhill/kafkacat>.
We were able to successfully consume messages using the the default
compression.type (producer, i.e without compression in our case).
When we changed the compression type to either compression algorithm (gzip
/ snappy / lz4), the consumption fails immediately with a fatal error.

Here's the command:

kafkacat -X api.version.request=true -b localhost -t <topic> -o end -C -c 1
-v -p 4

And the response received when consuming a topic configured with any of the
compression algorithms:

% Fatal error at consume_cb:407:

% ERROR: Topic maxwell_with_request_site_sharded [4] error: Message at
offset 733099 is too large to fetch, try increasing
receive.message.max.bytes

The response is the same for all offsets, in different partitions and all
our topics.
Please notice the messages size is quite small (smaller than the value of
receive.message.max.bytes),
I'm using the latest Kafka version (0.10.1).

Please advise.
Thanks,

*Ofir Sharony*
BackEnd Tech Lead

Mobile: +972-54-7560277 | [email protected] | www.myheritage.com
MyHeritage Ltd., 3 Ariel Sharon St., Or Yehuda 60250, Israel

<http://www.myheritage.com/>

<https://www.facebook.com/myheritage>
<https://twitter.com/myheritage>         <http://blog.myheritage.com/>
    <https://www.youtube.com/user/MyHeritageLtd>

Reply via email to