[
https://issues.apache.org/jira/browse/STORM-814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14541237#comment-14541237
]
Rajesh Kucharlapati commented on STORM-814:
-------------------------------------------
Here is the bolt latency information
bol2 32 32 2123660 2123660 0.035 1.081 2123620 1.069 2123520
0
bolt3 8 8 2120980 0 0.095 0.906 2121280
0.908 2121280 0
bolt1 8 8 2124180 2124180 0.090 0.957 2125860 0.950 2125840 0
Kafka spout information
Spouts (All time)
kafkaspout 8 8 2125680 2125680 2050.919 2116780 0
Its simple topology with total execution less than 3 ms. I am running this
topology with 4 supervisors with one worker node each.
There are no specific config info set on kafka spout.
> Kafka Spout performance
> -----------------------
>
> Key: STORM-814
> URL: https://issues.apache.org/jira/browse/STORM-814
> Project: Apache Storm
> Issue Type: Bug
> Components: storm-kafka
> Affects Versions: 0.9.3
> Environment: Centos, AWS , M3.2xlarge instances
> Reporter: Rajesh Kucharlapati
>
> I am running few test for storm topology with kafka.
> Created a topic with 16 partitions and emitted 10k messages/sec with each
> message 1k size.
> When I set the kafka spout parallelism to 1, I am getting latency of 8.9 ms
> but when i increase the parallelism to 8, I am getting latency of 1.2 sec.
> Settings :
> MAX_SPOUT SPENDING set to 1000-5000
> String zkConnString = "zookeeper1:2181";
> String kafkaTopic = "messages";
> String zkRootPath = "/kafkaStorm";
> String zkOffSetID = "kafka";
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
