Get the Executor-Id to Slot-Id mapping in a file
Greetings, I am running storm on two VMs(ubuntu 16.04, 2GB Ram) on my laptop(in distributed mode). The issue is that the VM runs out of RAM as soon as I start a simple(but with a large number of workers) topology. Actually I am interested only in the executor-Id to Slot-Id mapping from the Default Scheduler and I need it real quick as I am on a strict deadline. Getting it through the UI is near impossible as browsers take up too much RAM. Shifting to a different environment isn't really feasible. Can I get the mapping from say a file? Or where does the UI pick it up from? Regards, Aakash Khochare
Details about the Storm Scheduler
Greetings, I am Aakash Khochare. I am currently a Masters student in Indian Institute of Science, Bangalore. I know that the number of worker processes to be used by a topology and the number of executors can be changed using storm rebalance. However, is there any facility that does this work automatically based on probably the workload of the component/node. And if it doesn't exist, would such a facility be a valuable addition towards storm? Regards, Aakash Khochare