Hi all, it might be completely unrelated, but it reminds me at an issue that only occured many years ago only on 32bit Geode boxes (Alix/net5501) after we integrated Monit into AstLinux. On these boxes all RAM was eaten up slowly and then these boxes locked up after a few days. That's why we didn't installed Monit for these build types.
To figure it out I then created a cronjob that logged uptime, RAM and used Asterisk channels into a logfile every 10 minutes. > Am 16.09.2020 um 15:07 schrieb Lonnie Abelbeck <li...@lonnie.abelbeck.com>: > > Hi Daryl, > > Has the AstLinux version changed in the last couple weeks ? > > What version are you running ? > > Lonnie > > > >> On Sep 16, 2020, at 8:01 AM, Daryl Richards via Astlinux-users >> <astlinux-users@lists.sourceforge.net> wrote: >> >> This is good timing (in a bad way..) Time for a "Me too!" >> >> Recently, over the last couple weeks my APU2 has started locking up exactly >> the same way, just hard lock. I have a serial console cable hooked up and >> there are no messages printed out before, there's just nothing. When the >> problem first started I didn't have a console cable hooked up but I put it >> in to see if any messages were appearing.. >> >> My system is on a UPS. Nothing else in the rack glitches. >> >> On 2020-09-15 8:36 p.m., Michael Knill wrote: >>> Thanks Chris >>> Yep I have plenty out there too with no issues. It also happened on a Qotom >>> box so not hardware related. >>> Regards >>> Michael Knill >>> *From: *AstLinux List <astlinux-users@lists.sourceforge.net> >>> *Reply to: *AstLinux List <astlinux-users@lists.sourceforge.net> >>> *Date: *Wednesday, 16 September 2020 at 8:53 am >>> *To: *AstLinux List <astlinux-users@lists.sourceforge.net> >>> *Cc: *The Cadillac Kid <eldorado...@yahoo.com> >>> *Subject: *Re: [Astlinux-users] APU2 keeps locking up >>> for whatever its worth.. from a hardware standpoint I have probably 200 >>> APU2s in the field and dont have then just freeze like that.. granted they >>> arent running astlinux, but just mentioning it from a power / hardware >>> point of view. >>> mine are all running Centos 6.X and asterisk 11 or 13 >>> I have had a few chan_sip freezes.. (we wrote a watchdog to catch those and >>> restart asterisk).. we get maybe 1 every 3 or 4 months .. (not each site >>> but collectively) >>> I have kenrel panicked an APU before by upping and downing the ethernet >>> port too much (or so it seems).. it doesnt happen very often and is hard >>> to repeat in the lab. but have done it esp on an install.. where one is >>> prone to plug and unplug cables multiple times in succession for dressing >>> in.. >>> I have had a few power bricks go bad.. in all cases there was just no >>> output.. no lights on the board at all. its not been that many 3 or 4.. >>> considering we have sites in some pretty lightning-prone areas i dont feel >>> too bad about a few power bricks. >>> we run UPSs on all of our sites >>> we run the US power supply that is sold on the PC-Engines store. >>> On Tuesday, September 15, 2020, 6:04:44 PM EDT, Michael Knill >>> <michael.kn...@ipcsolutions.com.au> wrote: >>> Yep I would say environmental for 1, maybe 2 sites but for 3 sites and all >>> only recently I cant see how it could be. >>> No serial or long ethernet cables are connected. >>> Yes completely different power adaptors when I changed from APU2 -> Qotom. >>> Yes they are all DSL however ALL different modems and service types. >>> I'm thinking I will upgrade all Runnix versions at these sites and if still >>> happening upgrade to 1.3.10 and if still happening then I have no idea what >>> to do. >>> Regards >>> Michael Knill >>> On 16/9/20, 7:36 am, "Lonnie Abelbeck" <li...@lonnie.abelbeck.com >>> <mailto:li...@lonnie.abelbeck.com>> wrote: >>> So a UPS may solve the issue as with Site 1 ? >>> Do you have any serial cables connected ? >>> Any long ethernet cables connected ? >>> Is this with a variety of power adapters ? ie. the APU2 -> Qotom switch >>> did the power adapter change as well ? >>> Sure sounds environmental to me. >>> I've seen DC-to-DC UPSs for about $40 USD, but never tried one. >>> https://protectli.com/product/uninterruptible-power-supply/ >>> Lonnie >>>> On Sep 15, 2020, at 3:58 PM, Michael Knill >>>> <michael.kn...@ipcsolutions.com.au<mailto:michael.kn...@ipcsolutions.com.au>> >>>> wrote: >>>> >>>> Ok I'm reviving this thread as I have now had my third site with this >>>> issue. >>>> >>>> Symptom: >>>> Astlinux completely locks up and requires a power reset. The log shows >>>> NOTHING in all cases. >>>> >>>> Troubleshooting conducted: >>>> Site 1 - The problem has not occurred since both a UPS AND Power Filter >>>> have been added >>>> Site 2 - A power filter has been added and the problem has reoccurred. I >>>> have completely changed the system from an APU2 to Qotom and it did the >>>> same thing again >>>> Site 3 - A known working APU2 was installed and it locked up yesterday. >>>> >>>> I have checked mSATA cards and they were different across systems at these >>>> sites. >>>> All systems are running 1.3.7.1 but I am running this at many other sites >>>> on the same hardware with no issues. >>>> >>>> Power quality testing is extremely expensive and surely I cant be having a >>>> power issue at 3 sites! >>>> The whole thing just doesn't make any sense and I don't know where to go >>>> from here. >>>> Any ideas? >>>> >>>> Regards >>>> Michael Knill >>>> >>>> On 22/4/20, 9:24 pm, "Michael Knill" >>>> <michael.kn...@ipcsolutions.com.au<mailto:michael.kn...@ipcsolutions.com.au>> >>>> wrote: >>>> >>>> Looks like this problem was bad power. I was told by the local IT Guy >>>> that there are regular brownouts so I installed a UPS. No more problems >>>> since doing so. >>>> Seems like APU's don't like low voltage scenarios. >>>> >>>> Thanks for your help. >>>> >>>> Regards >>>> Michael Knill >>>> >>>> On 13/4/20, 1:05 pm, "Michael Knill" >>>> <michael.kn...@ipcsolutions.com.au<mailto:michael.kn...@ipcsolutions.com.au>> >>>> wrote: >>>> >>>> Yes could be but very unusual. I have never had this problem with >>>> any other APU. >>>> Maybe I will look for a good surge suppressor. >>>> >>>> Regards >>>> Michael Knill >>>> >>>> On 13/4/20, 12:47 pm, "Lonnie Abelbeck" <li...@lonnie.abelbeck.com >>>> <mailto:li...@lonnie.abelbeck.com>> wrote: >>>> >>>> Interesting, maybe bad power (spikes, noise, etc.) >>>> >>>> Test with a UPS attached or good surge suppresser. >>>> >>>> Lonnie >>>> >>>> >>>> >>>>> On Apr 12, 2020, at 9:17 PM, Michael Knill >>>>> <michael.kn...@ipcsolutions.com.au<mailto:michael.kn...@ipcsolutions.com.au>> >>>>> wrote: >>>>> >>>>> Hi Lonnie >>>>> >>>>> I have replaced the hardware already and it did EXACTLY the same thing ☹ >>>>> >>>>> Regards >>>>> Michael Knill >>>>> >>>>> On 13/4/20, 12:15 pm, "Lonnie Abelbeck" <li...@lonnie.abelbeck.com >>>>> <mailto:li...@lonnie.abelbeck.com>> wrote: >>>>> >>>>> >>>>> >>>>>> On Apr 12, 2020, at 7:03 PM, Michael Knill >>>>>> <michael.kn...@ipcsolutions.com.au<mailto:michael.kn...@ipcsolutions.com.au>> >>>>>> wrote: >>>>>> >>>>>> May not have anything to do with Astlinux but I have a site which >>>>>> completely locks up e.g. cannot even communicate using serial port. >>>>>> On reboot its fine but there is nothing in the logs but the bootup >>>>>> messages. >>>>>> So far I have replaced the hardware with new storage as well and power >>>>>> supply and it is still doing it. >>>>>> >>>>>> It is currently running Astlinux 1.3.7.1 which has been running fine on >>>>>> another APU2 but its only been 8 days. >>>>>> >>>>>> Any ideas what I can do next? >>>>>> >>>>>> Regards >>>>>> Michael Knill >>>>> >>>>> Sounds like an APU2 hardware issue. >>>>> >>>>> Maybe Pascal will give you a replacement. >>>>> >>>>> Lonnie >>>>> >>>>> >>>>> >>>>> >>>>> _______________________________________________ >>>>> Astlinux-users mailing list >>>>> Astlinux-users@lists.sourceforge.net >>>>> <mailto:Astlinux-users@lists.sourceforge.net> >>>>> https://lists.sourceforge.net/lists/listinfo/astlinux-users >>>>> >>>>> Donations to support AstLinux are graciously accepted via PayPal to >>>>> pay...@krisk.org. <mailto:pay...@krisk.org.> >>>>> >>>>> >>>>> >>>>> _______________________________________________ >>>>> Astlinux-users mailing list >>>>> Astlinux-users@lists.sourceforge.net >>>>> <mailto:Astlinux-users@lists.sourceforge.net> >>>>> https://lists.sourceforge.net/lists/listinfo/astlinux-users >>>>> >>>>> Donations to support AstLinux are graciously accepted via PayPal to >>>>> pay...@krisk.org. <mailto:pay...@krisk.org.> >>>> >>>> >>>> >>>> _______________________________________________ >>>> Astlinux-users mailing list >>>> Astlinux-users@lists.sourceforge.net >>>> <mailto:Astlinux-users@lists.sourceforge.net> >>>> https://lists.sourceforge.net/lists/listinfo/astlinux-users >>>> >>>> Donations to support AstLinux are graciously accepted via PayPal >>>> to pay...@krisk.org. <mailto:pay...@krisk.org.> >>>> >>>> >>>> _______________________________________________ >>>> Astlinux-users mailing list >>>> Astlinux-users@lists.sourceforge.net >>>> <mailto:Astlinux-users@lists.sourceforge.net> >>>> https://lists.sourceforge.net/lists/listinfo/astlinux-users >>>> >>>> Donations to support AstLinux are graciously accepted via PayPal to >>>> pay...@krisk.org. <mailto:pay...@krisk.org.> >>>> >>>> >>>> _______________________________________________ >>>> Astlinux-users mailing list >>>> Astlinux-users@lists.sourceforge.net >>>> <mailto:Astlinux-users@lists.sourceforge.net> >>>> https://lists.sourceforge.net/lists/listinfo/astlinux-users >>>> >>>> Donations to support AstLinux are graciously accepted via PayPal to >>>> pay...@krisk.org. <mailto:pay...@krisk.org.> >>>> >>>> >>>> _______________________________________________ >>>> Astlinux-users mailing list >>>> Astlinux-users@lists.sourceforge.net >>>> <mailto:Astlinux-users@lists.sourceforge.net> >>>> https://lists.sourceforge.net/lists/listinfo/astlinux-users >>>> >>>> Donations to support AstLinux are graciously accepted via PayPal to >>>> pay...@krisk.org. <mailto:pay...@krisk.org.> >>> _______________________________________________ >>> Astlinux-users mailing list >>> Astlinux-users@lists.sourceforge.net >>> <mailto:Astlinux-users@lists.sourceforge.net> >>> https://lists.sourceforge.net/lists/listinfo/astlinux-users >>> Donations to support AstLinux are graciously accepted via PayPal to >>> pay...@krisk.org. <mailto:pay...@krisk.org.> >>> _______________________________________________ >>> Astlinux-users mailing list >>> Astlinux-users@lists.sourceforge.net >>> <mailto:Astlinux-users@lists.sourceforge.net> >>> https://lists.sourceforge.net/lists/listinfo/astlinux-users >>> Donations to support AstLinux are graciously accepted via PayPal to >>> pay...@krisk.org. <mailto:pay...@krisk.org.> >>> _______________________________________________ >>> Astlinux-users mailing list >>> Astlinux-users@lists.sourceforge.net >>> https://lists.sourceforge.net/lists/listinfo/astlinux-users >>> Donations to support AstLinux are graciously accepted via PayPal to >>> pay...@krisk.org. >> >> -- >> Daryl Richards >> Isle Technical Services Inc. >> >> >> _______________________________________________ >> Astlinux-users mailing list >> Astlinux-users@lists.sourceforge.net >> https://lists.sourceforge.net/lists/listinfo/astlinux-users >> >> Donations to support AstLinux are graciously accepted via PayPal to >> pay...@krisk.org. > > > > _______________________________________________ > Astlinux-users mailing list > Astlinux-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/astlinux-users > > Donations to support AstLinux are graciously accepted via PayPal to > pay...@krisk.org. Michael http://www.mksolutions.info _______________________________________________ Astlinux-users mailing list Astlinux-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/astlinux-users Donations to support AstLinux are graciously accepted via PayPal to pay...@krisk.org.