[ 
https://issues.apache.org/jira/browse/STORM-2122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jungtaek Lim updated STORM-2122:
--------------------------------
    Issue Type: Improvement  (was: Bug)

> Supervisor V2 can use a lot more memory
> ---------------------------------------
>
>                 Key: STORM-2122
>                 URL: https://issues.apache.org/jira/browse/STORM-2122
>             Project: Apache Storm
>          Issue Type: Improvement
>          Components: storm-core
>            Reporter: Robert Joseph Evans
>            Assignee: Robert Joseph Evans
>             Fix For: 2.0.0
>
>          Time Spent: 50m
>  Remaining Estimate: 0h
>
> When launching a worker the supervisor will read in the complete topology to 
> get a small amount of data out of it.  This can be very large.  In the past 
> we would launch the workers one at a time, so we only needed enough memory to 
> read it in once, now we are doing it in parallel, and lots of these tend to 
> show up very close to one another.  We need to find a way to make it so that 
> we read the data one, and ideally cache it someplace that everyone can share.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Reply via email to