[ https://issues.apache.org/jira/browse/KAFKA-19125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17954569#comment-17954569 ]
Andrew Olson commented on KAFKA-19125: -------------------------------------- [~omnia_h_ibrahim] For this type of change to be practical and not limited by the application's heap size, wouldn't we need to enable interaction purely with {{OutputStream}} / {{InputStream}} objects instead of forcing materialization as a {{{}byte[]{}}}? That's the next natural barrier here. There's still a threshold over which an application could not support, and might experience out of memory failure if allowed, whether that's 400 MB, 4 GB, 40 GB, 400 GB, etc depends on their configuration + environment. > Implement Large message reference-based Serializer > -------------------------------------------------- > > Key: KAFKA-19125 > URL: https://issues.apache.org/jira/browse/KAFKA-19125 > Project: Kafka > Issue Type: Improvement > Components: clients > Reporter: Omnia Ibrahim > Assignee: Omnia Ibrahim > Priority: Major > > Implemation of the proposal in KIP-1159 > [https://cwiki.apache.org/confluence/display/KAFKA/KIP-1159%3A+Large+message+reference+based+Serializer] -- This message was sent by Atlassian Jira (v8.20.10#820010)