Jeff, Check this article - http://www.michael-noll.com/tutorials/running-multi-node-storm-cluster/ Paragraph - Running storm daemon under supervision. You find a ready to use recipe for supervisord along with some detailed explanation.
On Sun, Jul 6, 2014 at 10:33 PM, jeff saremi <[email protected]> wrote: > Thanks Eugene. > Building on this, it looks like one can monitor the DRPC server the same > way. Which is going to be very helpful to us. > ... checking out monit... > > ------------------------------ > Date: Sun, 6 Jul 2014 22:12:32 -0400 > > Subject: Re: The role of supervisor in Storm > From: [email protected] > To: [email protected] > > > Monitoring application checks periodically if Unix process is running and > restart or do some other actions if it's down. > This is generic unix daemons, not related to storm, Most popular are > supervisord - http://supervisord.org/ and monit -. > http://mmonit.com/monit/. > I prefer monit, check it out. > > > > > > On Sun, Jul 6, 2014 at 9:42 PM, jeff saremi <[email protected]> > wrote: > > ok thanks. Understand it better now. > What is the monitor application? How does it monitor a process? > > > ------------------------------ > Date: Mon, 7 Jul 2014 09:31:49 +0800 > From: [email protected] > To: [email protected] > Subject: Re: The role of supervisor in Storm > > > > But does it monitor them > yes, the supervisor will monitor worker processes, and restart them once > they go down. > > Who monitors the supervisor itself if it goes down? > If a supervisor goes down the nimbus simply remove the node from the > cluster and reassigns the job to other node, in other word, you lose a > worknode in your cluster. It is always a good practice to run nimbus and > supervisor under monitor application. > > > > 2014-07-07 > ------------------------------ > 唐思成 > ------------------------------ > *发件人：* jeff saremi > *发送时间：* 2014-07-06 23:20:38 > *收件人：* [email protected]; [email protected] > *抄送：* > *主题：* The role of supervisor in Storm > I posted another note earlier asking for hints and links on in-depth > architecture documentation. I didn't get any responses. Which probably > means I am the only one with this problem. > So i'll just go ahead and ask specific questions: > > What is the role of the supervisor? I know that it starts and stops the > worker processes. But does it monitor them? how? Who monitors the > supervisor itself if it goes down? Launching something with "%java storm > something" is referred to as launching the item (nimbus) under supervision. > Can anything be launched like that? Is Supervisable an interface? or a > protocol? > > I tried reading the supervisor's code but it looked like hieroglyphs to me. > > thanks > Jeff > > > > > -- > Eugene Dvorkin > Software Engineer > New York City Storm User Group - organizer > WebMD > email: [email protected] > phone: 646-250-9649 > eugenedvorkin.com > Connect with me on: > LinkedIn <http://www.linkedin.com/in/eugenedvorkin> Twitter > <http://twitter.com/edvorkin> > -- Eugene Dvorkin Software Engineer New York City Storm User Group - organizer WebMD email: [email protected] phone: 646-250-9649 eugenedvorkin.com Connect with me on: LinkedIn <http://www.linkedin.com/in/eugenedvorkin> Twitter <http://twitter.com/edvorkin>
