Hi, Dhruvil, Thanks for the KIP. Looks good me to overall. Just one comment below.
"To prevent this from happening, we will not delay down-conversion of the first partition in the response. We will down-convert all messages of the first partition in the I/O thread (like we do today), and only delay down-conversion for subsequent partitions." It seems that we can further optimize this by only down-converting the first message set in the first partition in the request handling threads? Jun On Fri, Apr 6, 2018 at 2:56 PM, Dhruvil Shah <dhru...@confluent.io> wrote: > Hi, > > I created a KIP to help mitigate out of memory issues during > down-conversion. The KIP proposes introducing a configuration that can > prevent down-conversions altogether, and also describes a design for > efficient memory usage for down-conversion. > > https://cwiki.apache.org/confluence/display/KAFKA/KIP- > 283%3A+Efficient+Memory+Usage+for+Down-Conversion > > Suggestions and feedback are welcome! > > Thanks, > Dhruvil >
