[Asterisk-Users] Re: Death at 2am

2005-11-21 Thread Tony Mountifield
In article [EMAIL PROTECTED],
Chris Hastie [EMAIL PROTECTED] wrote:
 Hello
 
 I've just installed Asterisk 1.2 onto a FreeBSD system and it is mostly 
 working well.
 
 But it dies at 2am every morning. Not quite a complete death, but it 
 seems to loose any ability to communicate with the rest of the world. In 
 /var/log/messages I just see endless entries like this:
 
 Nov 21 02:00:13 WARNING[18841] chan_sip.c: No such host: voipfone.co.uk
 Nov 21 02:00:13 WARNING[18841] chan_sip.c: Probably a DNS error for 
 registration to
 [EMAIL PROTECTED], trying
 REGISTER again (after 20 seconds)
 
 An attempt to connect to the console leaves asterisk eating up CPU 
 cycles and this in /var/log/messages
 
 Nov 20 11:51:25 WARNING[94218] asterisk.c: Accept returned -1: Too many open 
 files
 
 A message which reoccurs several hundred times a second.
 
 Can anyone either solve this problem for me completely, or at least give 
 me a hint as to the significance of 02:00? Is this an Asterisk thing 
 (most of my configurations are as per install samples), or an underlying 
 OS thing?

Firstly, look and see what the too many open files are:

# lsof -p94218

(or whatever the complaining PID is). I'm assuming FreeBSD has lsof.
I don't know, as I use Linux.

Next, examine the cron jobs that happen at 2am, to see if any of them
could explain anything.

Failing that, it could be that something ishappening at your provider
everyday at 2am and Asterisk is not coping with it gracefully.

You could also try specifying 212.187.162.178 temporarily instead of
voipfone.co.uk - that would tell you whether the problem is DNS related.

Cheers
Tony
-- 
Tony Mountifield
Work: [EMAIL PROTECTED] - http://www.softins.co.uk
Play: [EMAIL PROTECTED] - http://tony.mountifield.org
___
--Bandwidth and Colocation sponsored by Easynews.com --

Asterisk-Users mailing list
Asterisk-Users@lists.digium.com
http://lists.digium.com/mailman/listinfo/asterisk-users
To UNSUBSCRIBE or update options visit:
   http://lists.digium.com/mailman/listinfo/asterisk-users


Re: [Asterisk-Users] Re: Death at 2am

2005-11-21 Thread Chris Hastie

On Mon, 21 Nov 2005, Tony Mountifield [EMAIL PROTECTED] wrote:


In article [EMAIL PROTECTED],
Chris Hastie [EMAIL PROTECTED] wrote:

Hello

I've just installed Asterisk 1.2 onto a FreeBSD system and it is mostly
working well.

But it dies at 2am every morning. Not quite a complete death, but it
seems to loose any ability to communicate with the rest of the world.

Firstly, look and see what the too many open files are:

# lsof -p94218

(or whatever the complaining PID is). I'm assuming FreeBSD has lsof.
I don't know, as I use Linux.



Thanks. I'll give this ago tomorrow morning


Next, examine the cron jobs that happen at 2am, to see if any of them
could explain anything.


I did look at that. Nothing seems to run at 2am that doesn't run on 
every other

hour. My first inclination was that maybe newsyslog was trying to rotate
Asterisk's logs at 2am, but that doesn't look to be the case.

I take it that Asterisk (with mostly the standard sample config files) doesn't
try to do anything at 02:00 then?


Failing that, it could be that something ishappening at your provider
everyday at 2am and Asterisk is not coping with it gracefully.


I hadn't considered that. Connectivity provider, or VOIP provider (of 
the latter

I have more than one)?

I'll experiment with some debug output overnight tonight to see if it gives me
any more clues.


You could also try specifying 212.187.162.178 temporarily instead of
voipfone.co.uk - that would tell you whether the problem is DNS related.



I'm pretty sure it is not DNS related. Asterisk seems to loose the ability to
connect to anything, irrespective of the direction of the connection. Phones
can not connect to Asterisk either. I think the inability of Asterisk to
connect to a DNS server is merely one of the symptons of a total inability to
talk to anything else at all.

--
Chris Hastie
___
--Bandwidth and Colocation sponsored by Easynews.com --

Asterisk-Users mailing list
Asterisk-Users@lists.digium.com
http://lists.digium.com/mailman/listinfo/asterisk-users
To UNSUBSCRIBE or update options visit:
  http://lists.digium.com/mailman/listinfo/asterisk-users


Re: [Asterisk-Users] Re: Death at 2am

2005-11-21 Thread Chris Hastie

On Mon, 21 Nov 2005, Tony Mountifield [EMAIL PROTECTED] wrote:


In article [EMAIL PROTECTED],
Chris Hastie [EMAIL PROTECTED] wrote:

Hello

I've just installed Asterisk 1.2 onto a FreeBSD system and it is mostly
working well.

But it dies at 2am every morning. Not quite a complete death, but it
seems to loose any ability to communicate with the rest of the world.

Firstly, look and see what the too many open files are:

# lsof -p94218

(or whatever the complaining PID is). I'm assuming FreeBSD has lsof.
I don't know, as I use Linux.



Thanks. I'll give this ago tomorrow morning


Next, examine the cron jobs that happen at 2am, to see if any of them
could explain anything.


I did look at that. Nothing seems to run at 2am that doesn't run on 
every other

hour. My first inclination was that maybe newsyslog was trying to rotate
Asterisk's logs at 2am, but that doesn't look to be the case.

I take it that Asterisk (with mostly the standard sample config files) doesn't
try to do anything at 02:00 then?


Failing that, it could be that something ishappening at your provider
everyday at 2am and Asterisk is not coping with it gracefully.


I hadn't considered that. Connectivity provider, or VOIP provider (of 
the latter

I have more than one)?

I'll experiment with some debug output overnight tonight to see if it gives me
any more clues.


You could also try specifying 212.187.162.178 temporarily instead of
voipfone.co.uk - that would tell you whether the problem is DNS related.



I'm pretty sure it is not DNS related. Asterisk seems to loose the ability to
connect to anything, irrespective of the direction of the connection. Phones
can not connect to Asterisk either. I think the inability of Asterisk to
connect to a DNS server is merely one of the symptons of a total inability to
talk to anything else at all.

--
Chris Hastie
___
--Bandwidth and Colocation sponsored by Easynews.com --

Asterisk-Users mailing list
Asterisk-Users@lists.digium.com
http://lists.digium.com/mailman/listinfo/asterisk-users
To UNSUBSCRIBE or update options visit:
  http://lists.digium.com/mailman/listinfo/asterisk-users


[Asterisk-Users] Re: Death at 2am

2005-11-21 Thread Tony Mountifield
In article [EMAIL PROTECTED],
Chris Hastie [EMAIL PROTECTED] wrote:
 On Mon, 21 Nov 2005, Tony Mountifield [EMAIL PROTECTED] wrote:
 
  Next, examine the cron jobs that happen at 2am, to see if any of them
  could explain anything.
 
 I did look at that. Nothing seems to run at 2am that doesn't run on 
 every other
 hour. My first inclination was that maybe newsyslog was trying to rotate
 Asterisk's logs at 2am, but that doesn't look to be the case.
 
 I take it that Asterisk (with mostly the standard sample config files) doesn't
 try to do anything at 02:00 then?

I don't believe it does anything according to a fixed schedule like that.

  Failing that, it could be that something ishappening at your provider
  everyday at 2am and Asterisk is not coping with it gracefully.
 
 I hadn't considered that. Connectivity provider, or VOIP provider (of 
 the latter I have more than one)?

Could be either. My theory is that something your Asterisk tries to do
regularly is failing for some reason at that time, due to something either
internal or external, and that the error handling is not closing one or
more file descriptors that it had opened. As the failed operation gets
retried (possibly quickly and often), these leaked fd's accumulate and
eventually reach the process limit.

You could also add or uncomment the following line in
/etc/asterisk/logger.conf:

full = notice,warning,error,debug,verbose

(you may have to restart asterisk or do a logger reload)

Then you can see what is in /var/log/asterisk/full after the problem
has occurred.

Cheers
Tony
-- 
Tony Mountifield
Work: [EMAIL PROTECTED] - http://www.softins.co.uk
Play: [EMAIL PROTECTED] - http://tony.mountifield.org
___
--Bandwidth and Colocation sponsored by Easynews.com --

Asterisk-Users mailing list
Asterisk-Users@lists.digium.com
http://lists.digium.com/mailman/listinfo/asterisk-users
To UNSUBSCRIBE or update options visit:
   http://lists.digium.com/mailman/listinfo/asterisk-users