[
https://issues.apache.org/jira/browse/KAFKA-1253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13935548#comment-13935548
]
Guozhang Wang commented on KAFKA-1253:
--------------------------------------
Yes. And I dig a little bit deeper for the reallocation effect, for linger-time
= 0 no reallocation is triggered at all since records are wrapped in each
iteration of the Sender thread and is far from getting full; for linger-time =
500 ms both gzip and snappy have about 5 reallocations per 10K messages, so
reallocation/data-copy does not play an important role in the difference of
GZIP and SNAPPY.
Changing the GZIP block size back to 512 and re-do the experiments, and here is
what we get:
R-linger-500ms: 8842.9058
R-linger-0ms: 8582.4386
A-linger-500ms: 36333.2486
A-linger-0ms: 34940.6010
>From the results it seems the block size does not affect the performance of
>GZIP either.
> Implement compression in new producer
> -------------------------------------
>
> Key: KAFKA-1253
> URL: https://issues.apache.org/jira/browse/KAFKA-1253
> Project: Kafka
> Issue Type: Sub-task
> Components: producer
> Reporter: Jay Kreps
> Assignee: Guozhang Wang
> Attachments: KAFKA-1253.patch, KAFKA-1253_2014-02-21_16:15:21.patch,
> KAFKA-1253_2014-02-21_17:55:52.patch, KAFKA-1253_2014-02-24_13:31:50.patch,
> KAFKA-1253_2014-02-26_17:31:30.patch, KAFKA-1253_2014-03-06_17:48:11.patch,
> KAFKA-1253_2014-03-07_16:34:33.patch, KAFKA-1253_2014-03-10_14:35:56.patch,
> KAFKA-1253_2014-03-10_14:39:58.patch, KAFKA-1253_2014-03-10_15:27:47.patch,
> compression-fix.patch
>
>
--
This message was sent by Atlassian JIRA
(v6.2#6252)
