On said subject, how does memory allocation work I these cases? Assuming 1 worker per node would you just dump all the memory available into worker.childopts? I guess the memory pool would be shared between the spawned threads as appropriate to their needs?
I'm assuming the equivalent options for supervisor/nimbus are fine left at defaults. Given that the workers/spouts/bolts are the working parts of the topology these would where I should target available memory? D From: Huiliang Zhang<mailto:[email protected]> Sent: ?Tuesday?, ?1? ?April? ?2014 ?19?:?47 To: [email protected]<mailto:[email protected]> Thanks. It should be good if there exist some example figures explaining the relationship between tasks, workers, and threads. On Sat, Mar 29, 2014 at 6:34 AM, Susheel Kumar Gadalay <[email protected]<mailto:[email protected]>> wrote: No, a single worker is dedicated to a single topology no matter how many threads it spawns for different bolts/spouts. A single worker cannot be shared across multiple topologies. On 3/29/14, Nathan Leung <[email protected]<mailto:[email protected]>> wrote: > From what I have seen, the second topology is run with 1 worker until you > kill the first topology or add more worker slots to your cluster. > > > On Sat, Mar 29, 2014 at 2:57 AM, Huiliang Zhang > <[email protected]<mailto:[email protected]>> wrote: > >> Thanks. I am still not clear. >> >> Do you mean that in a single worker process, there will be multiple >> threads and each thread will handle part of a topology? If so, what does >> the number of workers mean when submitting topology? >> >> >> On Fri, Mar 28, 2014 at 11:18 PM, padma priya chitturi < >> [email protected]<mailto:[email protected]>> wrote: >> >>> Hi, >>> >>> No, its not the case. No matter how many topologies you submit, the >>> workers will be shared among the topologies. >>> >>> Thanks, >>> Padma Ch >>> >>> >>> On Sat, Mar 29, 2014 at 5:11 AM, Huiliang Zhang >>> <[email protected]<mailto:[email protected]>> >>> wrote: >>> >>>> Hi, >>>> >>>> I have a simple question about storm. >>>> >>>> My cluster has just 1 supervisor and 4 ports are defined to run 4 >>>> workers. I first submit a topology which needs 3 workers. Then I submit >>>> another topology which needs 2 workers. Does this mean that the 2nd >>>> topology will never be run? >>>> >>>> Thanks, >>>> Huiliang >>>> >>> >>> >> >
