Github user redsanket commented on the pull request:
https://github.com/apache/storm/pull/933#issuecomment-163330056
@revans2 I have launched around 5 topologies on 5 supervisor nodes and
could see lot of connections being made to zookeeper and event processing
slowing down. But I could not observe zookeeper slowing down to a point it
could not respond. I will launch more topologies to make sure it really slows
down. I realized in this scenario that it is only performing reads and as per
zookeeper implementation I presume connections are thread safe and hence one
connection to read information would be sufficient I guess. An interesting
point came up with synchronization here, I looked at the localizer code and I
have seen downloads to the supervisor are performed by locking but updates are
not therefore to support nimbus HA checkForUpdate and checkForDownload might
have to be synchronized. Will make sure by running it with more topologies.
Thanks for the review
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
