GitHub user apurvam opened a pull request: https://github.com/apache/kafka/pull/2796
Close the producer batch data stream when the batch gets full to free up compression buffers, etc. You can merge this pull request into a Git repository by running: $ git pull https://github.com/apurvam/kafka idempotent-producer-close-data-stream Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/2796.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2796 ---- commit 8e0b3eba9bde8fb790069ebfe43c3f82f91af4a3 Author: Apurva Mehta <apu...@confluent.io> Date: 2017-04-02T00:53:20Z Close the underlying ProducerBatch data stream once it is closed. This frees up compression buffers, etc. The actual batch will be closed and headers written when the batch is it is about to be sent, or if it is expired, or if the producer is closed. commit e5b0771b74bb576ee1821a7a71bbcc5377b8dcde Author: Ismael Juma <ism...@juma.me.uk> Date: 2017-04-03T14:23:06Z A few improvements ---- --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---