Stig Rohde Døssing created STORM-2691:
-----------------------------------------
Summary: storm-kafka-client Trident spout communicates with the
Coordinator through a static field
Key: STORM-2691
URL: https://issues.apache.org/jira/browse/STORM-2691
Project: Apache Storm
Issue Type: Bug
Components: storm-kafka-client
Affects Versions: 2.0.0, 1.1.1
Reporter: Stig Rohde Døssing
The Trident Kafka spout uses the KafkaTridentSpoutTopicPartitionRegistry enum
to pass existing topic partitions from the spout to the coordinator. This only
works when those components happen to be in the same JVM.
The coordinator runs in the TridentSpoutCoordinator bolt here
https://github.com/apache/storm/blob/4c8a986f519cdf3e63bed47e9c4f723e4867267a/storm-client/src/jvm/org/apache/storm/trident/topology/TridentTopologyBuilder.java#L162,
while the spout instances run in TridentSpoutExecutors here
https://github.com/apache/storm/blob/4c8a986f519cdf3e63bed47e9c4f723e4867267a/storm-client/src/jvm/org/apache/storm/trident/topology/TridentTopologyBuilder.java#L176.
We should replace the registry enum with writes to Zookeeper or something
similar.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
