[ https://issues.apache.org/jira/browse/KAFKA-3442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15206790#comment-15206790 ]
Dana Powers commented on KAFKA-3442: ------------------------------------ yes, kafka-python uses the same check for partial messages as the java client and will raise a RecordTooLargeException to user if there is only a partial message. I think it would be best if the 0.10 broker continued to return partial messages, but since the protocol spec refers to this behavior as an optimization then I think it would be acceptable to change the behavior and return empty payload. Would it be possible to include an error_code with the empty payload? > FetchResponse size exceeds max.partition.fetch.bytes > ---------------------------------------------------- > > Key: KAFKA-3442 > URL: https://issues.apache.org/jira/browse/KAFKA-3442 > Project: Kafka > Issue Type: Bug > Affects Versions: 0.10.0.0 > Reporter: Dana Powers > Assignee: Jiangjie Qin > Priority: Blocker > Fix For: 0.10.0.0 > > > Produce 10000 byte message to topic foobar > Fetch foobar w/ max.partition.fetch.bytes=1024 > Test expects to receive a truncated message (~1024 bytes). 0.8 and 0.9 pass > this test, but 0.10 FetchResponse has full message, exceeding the max > specified in the FetchRequest. > I tested with v0 and v1 apis, both fail. Have not tested w/ v2 -- This message was sent by Atlassian JIRA (v6.3.4#6332)