Grant Henke created KAFKA-4203:

             Summary: Java producer default max message size does not align 
with broker default
                 Key: KAFKA-4203
             Project: Kafka
          Issue Type: Bug
    Affects Versions: 0.8.1
            Reporter: Grant Henke
            Assignee: Grant Henke
            Priority: Critical

The Java producer sets max.request.size = 1048576 (the base 2 version of 1 MB 

The broker sets max.message.bytes = 1000012 (the base 10 value of 1 MB + 12 
bytes for overhead)

This means that by default the producer can try to produce messages larger than 
the broker will accept resulting in RecordTooLargeExceptions.

There were not similar issues in the old producer because it sets 
max.message.size = 1000000 (the base 10 value of 1 MB)

I propose we increase the broker default for max.message.bytes to 1048588 (the 
base 2 value of 1 MB (MiB) + 12 bytes for overhead) so that any message 
produced with default configs from either producer does not result in a 

This message was sent by Atlassian JIRA

Reply via email to