Re: Incident notification
Pushover and email to sms from both an inband and off site monitoring vm. On November 21, 2014 9:52:00 AM CST, Thijs Stuurman thijs.stuur...@is.nl wrote: Nanog list members, I was looking at some statistic and noticed we are sending out a massive amount of SMS messages from our monitoring systems. This left me wondering if there isn't a better (and cheaper) alternative to this, something just as reliant but IP based. We all have smartphones these days anyway. Therefore my question, what are you using to notify admins of incidents? Kind regards / Met vriendelijke groet, Thijs Stuurman [IS Logo] IS Group Wielingenstraat 8 T +31 (0)299 476 185 i...@is.nlmailto:i...@is.nl 1441 ZR Purmerend F +31 (0)299 476 288 www.is.nlhttp://www.is.nl IS Group is ISO 9001:2008, ISO/IEC 27001:2005, ISO 20.000-1:2005, ISAE 3402 certified. De datacenters zijn PCI DSS en ISO 14001 compliant. !DSPAM:546f5ff6238696356864932! -- Sent from my Android device with K-9 Mail. Please excuse my brevity.
Re: Incident notification
Multiple nagios servers directly sending via amazon web services SES to pager duty. Unlikely SES would go completely down. Nagios boxes monitor eachother from different continents. On Nov 21, 2014 10:52 AM, Thijs Stuurman thijs.stuur...@is.nl wrote: Nanog list members, I was looking at some statistic and noticed we are sending out a massive amount of SMS messages from our monitoring systems. This left me wondering if there isn't a better (and cheaper) alternative to this, something just as reliant but IP based. We all have smartphones these days anyway. Therefore my question, what are you using to notify admins of incidents? Kind regards / Met vriendelijke groet, Thijs Stuurman [IS Logo] IS Group Wielingenstraat 8 T +31 (0)299 476 185 i...@is.nlmailto:i...@is.nl 1441 ZR Purmerend F +31 (0)299 476 288 www.is.nlhttp://www.is.nl IS Group is ISO 9001:2008, ISO/IEC 27001:2005, ISO 20.000-1:2005, ISAE 3402 certified. De datacenters zijn PCI DSS en ISO 14001 compliant.
RE: Incident notification
The advantage of SMS is that it is out of band. Any smtp or other IP based solution requires a stable and working network environment, which is what the alert may be trying to tell you is down. Matthew Huff | 1 Manhattanville Rd Director of Operations | Purchase, NY 10577 OTA Management LLC | Phone: 914-460-4039 aim: matthewbhuff | Fax: 914-694-5669 -Original Message- From: NANOG [mailto:nanog-boun...@nanog.org] On Behalf Of Thijs Stuurman Sent: Friday, November 21, 2014 10:52 AM To: nanog@nanog.org Subject: Incident notification Nanog list members, I was looking at some statistic and noticed we are sending out a massive amount of SMS messages from our monitoring systems. This left me wondering if there isn't a better (and cheaper) alternative to this, something just as reliant but IP based. We all have smartphones these days anyway. Therefore my question, what are you using to notify admins of incidents? Kind regards / Met vriendelijke groet, Thijs Stuurman [IS Logo] IS Group Wielingenstraat 8 T +31 (0)299 476 185 i...@is.nlmailto:i...@is.nl 1441 ZR Purmerend F +31 (0)299 476 288 www.is.nlhttp://www.is.nl IS Group is ISO 9001:2008, ISO/IEC 27001:2005, ISO 20.000-1:2005, ISAE 3402 certified. De datacenters zijn PCI DSS en ISO 14001 compliant.
Re: Incident notification
Pagerduty for phone calls. Can do SMS as well, I believe. Josh Luthman Office: 937-552-2340 Direct: 937-552-2343 1100 Wayne St Suite 1337 Troy, OH 45373 On Fri, Nov 21, 2014 at 10:52 AM, Thijs Stuurman thijs.stuur...@is.nl wrote: Nanog list members, I was looking at some statistic and noticed we are sending out a massive amount of SMS messages from our monitoring systems. This left me wondering if there isn't a better (and cheaper) alternative to this, something just as reliant but IP based. We all have smartphones these days anyway. Therefore my question, what are you using to notify admins of incidents? Kind regards / Met vriendelijke groet, Thijs Stuurman [IS Logo] IS Group Wielingenstraat 8 T +31 (0)299 476 185 i...@is.nlmailto:i...@is.nl 1441 ZR Purmerend F +31 (0)299 476 288 www.is.nlhttp://www.is.nl IS Group is ISO 9001:2008, ISO/IEC 27001:2005, ISO 20.000-1:2005, ISAE 3402 certified. De datacenters zijn PCI DSS en ISO 14001 compliant.
RE: Incident notification
The advantage of SMS is that it is out of band. Any smtp or other IP based solution requires a stable and working network environment, which is what the alert may be trying to tell you is down. I do not worry so much about that, part of the monitoring solution is out of band for that reason. Kind regards / Met vriendelijke groet, Thijs Stuurman
Re: Incident notification
While we do not do this ourseleves, I wonder why we would not use Twitter. You can receive SMS, or texts in the app on a smart phone, or look at a webpage. You can make them private and have lots of subscribers. I find Twitter more reliable that our local SMS providers too. d On Fri, Nov 21, 2014 at 9:52 AM, Thijs Stuurman thijs.stuur...@is.nl wrote: Nanog list members, I was looking at some statistic and noticed we are sending out a massive amount of SMS messages from our monitoring systems. This left me wondering if there isn't a better (and cheaper) alternative to this, something just as reliant but IP based. We all have smartphones these days anyway. Therefore my question, what are you using to notify admins of incidents? Kind regards / Met vriendelijke groet, Thijs Stuurman [IS Logo] IS Group Wielingenstraat 8 T +31 (0)299 476 185 i...@is.nlmailto:i...@is.nl 1441 ZR Purmerend F +31 (0)299 476 288 www.is.nlhttp://www.is.nl IS Group is ISO 9001:2008, ISO/IEC 27001:2005, ISO 20.000-1:2005, ISAE 3402 certified. De datacenters zijn PCI DSS en ISO 14001 compliant. -- Copyright 2014 Derek Andrew (excluding quotations) +1 306 966 4808 Information Systems University of Saskatchewan Peterson 120; 54 Innovation Boulevard Saskatoon,Saskatchewan,Canada. S7N 2V3 Timezone GMT-6 Typed but not read.
Re: Incident notification
We use OpsGenie for notifications (and on-call scheduling, etc). There are other similar options such as PagerDuty, etc, as well. Notifications can be submitted to the service in a variety of ways (email, web API, etc), has a variety of integrations with other tools (Nagios, Pingdom, etc) to aggregate all of your alerts, and there is a callback mechanism where the user can trigger custom actions right from the app (for example, I wrote an interface for it such that when we get an alert, the on-call person can choose to restart the affected service -- or even reboot the entire VM hosting it -- right from within the OpsGenie app). Each user can choose their method of contact (notification to the smartphone app, SMS, phone call, email, whatever), and on-call schedules (and exceptions) are easily managed. It works for us... YMMV. ;) - Peter On 11/21/2014 10:52 AM, Thijs Stuurman wrote: Nanog list members, I was looking at some statistic and noticed we are sending out a massive amount of SMS messages from our monitoring systems. This left me wondering if there isn't a better (and cheaper) alternative to this, something just as reliant but IP based. We all have smartphones these days anyway. Therefore my question, what are you using to notify admins of incidents? Kind regards / Met vriendelijke groet, Thijs Stuurman [IS Logo] IS Group Wielingenstraat 8 T +31 (0)299 476 185 i...@is.nlmailto:i...@is.nl 1441 ZR Purmerend F +31 (0)299 476 288 www.is.nlhttp://www.is.nl IS Group is ISO 9001:2008, ISO/IEC 27001:2005, ISO 20.000-1:2005, ISAE 3402 certified. De datacenters zijn PCI DSS en ISO 14001 compliant.
RE: Incident notification
I know of a firend that is using Growl / Prowl to push out the notifications to their phones, even to their TV's at home. Sk. -Original Message- From: NANOG [mailto:nanog-boun...@nanog.org] On Behalf Of Thijs Stuurman Sent: Friday, November 21, 2014 10:52 AM To: nanog@nanog.org Subject: Incident notification Nanog list members, I was looking at some statistic and noticed we are sending out a massive amount of SMS messages from our monitoring systems. This left me wondering if there isn't a better (and cheaper) alternative to this, something just as reliant but IP based. We all have smartphones these days anyway. Therefore my question, what are you using to notify admins of incidents? Kind regards / Met vriendelijke groet, Thijs Stuurman [IS Logo] IS Group Wielingenstraat 8 T +31 (0)299 476 185 i...@is.nlmailto:i...@is.nl 1441 ZR Purmerend F +31 (0)299 476 288 www.is.nlhttp://www.is.nl IS Group is ISO 9001:2008, ISO/IEC 27001:2005, ISO 20.000-1:2005, ISAE 3402 certified. De datacenters zijn PCI DSS en ISO 14001 compliant.
Re: Incident notification
On Fri, Nov 21, 2014 at 10:56 AM, Matthew Huff mh...@ox.com wrote: The advantage of SMS is that it is out of band. Any smtp or other IP based solution requires a stable and working network environment, which is what the alert may be trying to tell you is down. Which is why you locate a small NMS outside your network (on a VM somewhere) whose only job is to start alerting when it can't reach the NMS inside your network. That also helps when your interior NMS system gets gummed up or when a general emergency in your locality damages your infrastructure at the same time as the SMS provider's infrastructure. If your monitoring system is structured well to begin with, email has efficacy comparable to sms. A smartphone app expecting heartbeats via your in-band infrastructure has effectiveness superior to both. Regards, Bill Herrin -- William Herrin her...@dirtside.com b...@herrin.us Owner, Dirtside Systems . Web: http://www.dirtside.com/ May I solve your unusual networking challenges?
