Thanks Eugene. Building on this, it looks like one can monitor the DRPC server the same way. Which is going to be very helpful to us. ... checking out monit... Date: Sun, 6 Jul 2014 22:12:32 -0400 Subject: Re: The role of supervisor in Storm From: [email protected] To: [email protected]
Monitoring application checks periodically if Unix process is running and restart or do some other actions if it's down. This is generic unix daemons, not related to storm, Most popular are supervisord - http://supervisord.org/ and monit -.http://mmonit.com/monit/. I prefer monit, check it out. On Sun, Jul 6, 2014 at 9:42 PM, jeff saremi <[email protected]> wrote: ok thanks. Understand it better now. What is the monitor application? How does it monitor a process? Date: Mon, 7 Jul 2014 09:31:49 +0800 From: [email protected] To: [email protected] Subject: Re: The role of supervisor in Storm But does it monitor them yes, the supervisor will monitor worker processes, and restart them once they go down. Who monitors the supervisor itself if it goes down? If a supervisor goes down the nimbus simply remove the node from the cluster and reassigns the job to other node, in other word, you lose a worknode in your cluster. It is always a good practice to run nimbus and supervisor under monitor application. 2014-07-07 唐思成 发件人： jeff saremi 发送时间： 2014-07-06 23:20:38 收件人： [email protected]; [email protected] 抄送： 主题： The role of supervisor in Storm I posted another note earlier asking for hints and links on in-depth architecture documentation. I didn't get any responses. Which probably means I am the only one with this problem. So i'll just go ahead and ask specific questions: What is the role of the supervisor? I know that it starts and stops the worker processes. But does it monitor them? how? Who monitors the supervisor itself if it goes down? Launching something with "%java storm something" is referred to as launching the item (nimbus) under supervision. Can anything be launched like that? Is Supervisable an interface? or a protocol? I tried reading the supervisor's code but it looked like hieroglyphs to me. thanks Jeff -- Eugene DvorkinSoftware EngineerNew York City Storm User Group - organizer WebMDemail: [email protected] phone: 646-250-9649eugenedvorkin.com Connect with me on: LinkedIn Twitter
