[
https://issues.apache.org/jira/browse/STORM-2871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Roshan Naik updated STORM-2871:
-------------------------------
Description:
Task.getOutgoingTasks() is in critical messaging path. Two observed bottlenecks
in it :
- Looking up HashMap 'streamToGroupers'. Need to look into converting HashMap
into Array lookup ?
-
[outTasks.addAll(compTasks)|https://github.com/apache/storm/blob/master/storm-client/src/jvm/org/apache/storm/daemon/Task.java#L139]
seems to be impacting throughput as well. Identified by .. running
ConstSpoutNullBoltTopo with 1 spout & bolt paralllelism (no Ack) and replacing
this line with hard coded logic to add the single known bolt's taskID.
was:
Task.getOutgoingTasks() is in critical messaging path. Two observed bottlenecks
in it :
- [Looking up HashMap|] 'streamToGroupers'. Need to look into converting
HashMap into Array lookup ?
-
[outTasks.addAll(compTasks)|https://github.com/apache/storm/blob/master/storm-client/src/jvm/org/apache/storm/daemon/Task.java#L139]
seems to be impacting throughput as well. Identified by .. running
ConstSpoutNullBoltTopo with 1 spout & bolt paralllelism (no Ack) and replacing
this line with hard coded logic to add the single known bolt's taskID.
> Performance optimizations for getOutgoingTasks
> -----------------------------------------------
>
> Key: STORM-2871
> URL: https://issues.apache.org/jira/browse/STORM-2871
> Project: Apache Storm
> Issue Type: Improvement
> Reporter: Roshan Naik
>
> Task.getOutgoingTasks() is in critical messaging path. Two observed
> bottlenecks in it :
> - Looking up HashMap 'streamToGroupers'. Need to look into converting HashMap
> into Array lookup ?
> -
> [outTasks.addAll(compTasks)|https://github.com/apache/storm/blob/master/storm-client/src/jvm/org/apache/storm/daemon/Task.java#L139]
> seems to be impacting throughput as well. Identified by .. running
> ConstSpoutNullBoltTopo with 1 spout & bolt paralllelism (no Ack) and
> replacing this line with hard coded logic to add the single known bolt's
> taskID.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
