Get the Executor-Id to Slot-Id mapping in a file

2016-09-15 Thread Aakash Khochare
Greetings,

I am running storm on two VMs(ubuntu 16.04, 2GB Ram) on my laptop(in 
distributed mode). The issue is that the VM runs out of RAM as soon as I start 
a simple(but with a large number of workers) topology.

Actually I am interested only in the executor-Id to Slot-Id mapping from the 
Default Scheduler and I need it real quick as I am on a strict deadline. 
Getting it through the UI is near impossible as browsers take up too much RAM. 
Shifting to a different environment isn't really feasible. Can I get the 
mapping from say a file? Or where does the UI pick it up from?


Regards,
Aakash Khochare




Details about the Storm Scheduler

2016-08-21 Thread Aakash Khochare
Greetings,

I am Aakash Khochare. I am currently a Masters student in Indian Institute of 
Science, Bangalore. I know that the number of worker processes to be used by a 
topology and the number of executors can be changed using storm rebalance.  
However, is there any facility that does this work automatically based on 
probably the workload of the component/node. And if it doesn't exist, would 
such a facility be a valuable addition towards storm?


Regards,

Aakash Khochare