[
https://issues.apache.org/jira/browse/GEARPUMP-40?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15313616#comment-15313616
]
Karol Brejna commented on GEARPUMP-40:
--------------------------------------
[~mauzhang] Do you think https://github.com/apache/incubator-gearpump/pull/25
could improve the results? did you have a chance to reproduce the test after
the changes?
> KafkaSource poor performance
> ----------------------------
>
> Key: GEARPUMP-40
> URL: https://issues.apache.org/jira/browse/GEARPUMP-40
> Project: Apache Gearpump
> Issue Type: Improvement
> Components: kafka
> Affects Versions: 0.8.0
> Reporter: Manu Zhang
> Assignee: Manu Zhang
>
> As per
> [https://engineering.linkedin.com/kafka/benchmarking-apache-kafka-2-million-writes-second-three-cheap-machines],
> a single thread Kafka consumer could consume at 89.7MB/s from 6x partition
> 3x replica topic whose data are evenly distributed on a 3-node GbE cluster. I
> carried out a similar experiment with KafkaSource and found that the
> throughput is only at 10MB/s.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
