Manu Zhang created GEARPUMP-40:
----------------------------------
Summary: KafkaSource poor performance
Key: GEARPUMP-40
URL: https://issues.apache.org/jira/browse/GEARPUMP-40
Project: Apache Gearpump
Issue Type: Improvement
Components: kafka
Affects Versions: 0.8.0
Reporter: Manu Zhang
Assignee: Manu Zhang
As per
[https://engineering.linkedin.com/kafka/benchmarking-apache-kafka-2-million-writes-second-three-cheap-machines],
a single thread Kafka consumer could consume at 89.7MB/s from 6x partition 3x
replica topic. I carried out a similar experiment with KafkaSource and found
that the throughput is only at 10MB/s.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
