[
https://issues.apache.org/jira/browse/STORM-814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14544255#comment-14544255
]
Rajesh Kucharlapati commented on STORM-814:
-------------------------------------------
I ran the same test with one spout only and here is are the results
Total No of partitions : 8
Test 1:
Kafka Spout parallelism : 8
Latency : 1.649
Spout Pending : 1000
Test2
Kafka Spout parallelism : 1
Latency : 1.149
Spout Pending : 8000
Same test with one spout and one bolt
Test 1:
Kafka Spout parallelism : 8
Latency : 23 ms
Spout Pending : 1000
Test2
Kafka Spout parallelism : 1
Latency : 1.7 ms
Spout Pending : 8000
> Kafka Spout performance
> -----------------------
>
> Key: STORM-814
> URL: https://issues.apache.org/jira/browse/STORM-814
> Project: Apache Storm
> Issue Type: Bug
> Components: storm-kafka
> Affects Versions: 0.9.3
> Environment: Centos, AWS , M3.2xlarge instances
> Reporter: Rajesh Kucharlapati
>
> I am running few test for storm topology with kafka.
> Created a topic with 16 partitions and emitted 10k messages/sec with each
> message 1k size.
> When I set the kafka spout parallelism to 1, I am getting latency of 8.9 ms
> but when i increase the parallelism to 8, I am getting latency of 1.2 sec.
> Settings :
> MAX_SPOUT SPENDING set to 1000-5000
> String zkConnString = "zookeeper1:2181";
> String kafkaTopic = "messages";
> String zkRootPath = "/kafkaStorm";
> String zkOffSetID = "kafka";
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
