[ 
https://issues.apache.org/jira/browse/KAFKA-19125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17954569#comment-17954569
 ] 

Andrew Olson commented on KAFKA-19125:
--------------------------------------

[~omnia_h_ibrahim] For this type of change to be practical and not limited by 
the application's heap size, wouldn't we need to enable interaction purely with 
{{OutputStream}} / {{InputStream}} objects instead of forcing materialization 
as a {{{}byte[]{}}}? That's the next natural barrier here. There's still a 
threshold over which an application could not support, and might experience out 
of memory failure if allowed, whether that's 400 MB, 4 GB, 40 GB, 400 GB, etc 
depends on their configuration + environment.

> Implement Large message reference-based Serializer
> --------------------------------------------------
>
>                 Key: KAFKA-19125
>                 URL: https://issues.apache.org/jira/browse/KAFKA-19125
>             Project: Kafka
>          Issue Type: Improvement
>          Components: clients
>            Reporter: Omnia Ibrahim
>            Assignee: Omnia Ibrahim
>            Priority: Major
>
> Implemation of the proposal in KIP-1159 
> [https://cwiki.apache.org/confluence/display/KAFKA/KIP-1159%3A+Large+message+reference+based+Serializer]



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to