Re: Building history of storm worker assignments

2018-02-27 Thread Jungtaek Lim
Hi Nikhil, While Nimbus would be a best place to hook the information of assignment and record, but Nimbus doesn't provide the hook (if I'm not missing here). As you already stated, you could leverage IWorkerHook to record the start of worker which looks enough on your case. It only records when

Re: Building history of storm worker assignments

2018-02-27 Thread Nikhil Bafna
Would implementiong IWorkerHook be more appropriate? On Tue, Feb 27, 2018 at 11:19 PM, Nikhil Bafna wrote: > > Hello, > > I want to build a centralised history that looks like > > timestamp : topology_name : component_name : topology_id : component_id : VM > hostname

Building history of storm worker assignments

2018-02-27 Thread Nikhil Bafna
Hello, I want to build a centralised history that looks like timestamp : topology_name : component_name : topology_id : component_id : VM hostname : VM IP : Worker port What would be the best to go about it in Storm? I can think of 1. Reporting this from prepare() method of a spout/bolt