Hi sorry all but this is not an APU problem. I have had EXACTLY the same
problem on a Qotom box.
At all three sites the common denominators are:
-- Astlinux 1.3.7.1
-- PPPoE
My next tests will be (in this order):
1) Install another system onsite connected to the same environment e.g. power
to see if it happens to both systems
2) Put a firewall in front of the Astlinux box to do PPPoE
3) OS upgrade
Regards
Michael Knill
On 17/9/20, 8:12 am, "Lonnie Abelbeck" <li...@lonnie.abelbeck.com> wrote:
Yes, this is very strange.
I have had an APU2 for years, never locked-up once ... and it is currently
running a UniFi controller in a Linux container.
I also ran my APU2 without a UPS for a year or two, though it is using one
now. But we have good quality power where I live outside of thunder-storms.
Possibly the Coreboot BIOS version also needs to be tracked to find some
common denominator. I have never updated my APU2 coreboot BIOS.
Also my APU2 sits inside my network, without a public interface.
A common denominator list for APU2 lock-up reports:
-- AstLinux version:
-- Asterisk: 13se, 13 or 16
-- RAM: 2GB or 4GB
-- Coreboot BIOS version:
-- Public interface yes/no, if 'yes' public SSH, HTTPS, etc. access yes/no
-- PPPoE: yes/no
-- UPS Power: yes/no
Lonnie
> On Sep 16, 2020, at 4:09 PM, Michael Knill
<michael.kn...@ipcsolutions.com.au> wrote:
>
> I do have Zabbix running on these boxes which checks memory and will
notify me if its getting too low and this has not happened. This is what
alerted me to the Zabbix client memory leak.
> Also the lockups are very sporadic. Can happen after a couple of weeks or
the next day.
>
> Regards
> Michael Knill
>
> On 16/9/20, 11:21 pm, "Michael Keuter" <li...@mksolutions.info> wrote:
>
> Hi all,
>
> it might be completely unrelated, but it reminds me at an issue that
only occured many years ago only on 32bit Geode boxes (Alix/net5501) after we
integrated Monit into AstLinux.
> On these boxes all RAM was eaten up slowly and then these boxes locked
up after a few days. That's why we didn't installed Monit for these build types.
>
> To figure it out I then created a cronjob that logged uptime, RAM and
used Asterisk channels into a logfile every 10 minutes.
>
>> Am 16.09.2020 um 15:07 schrieb Lonnie Abelbeck
<li...@lonnie.abelbeck.com>:
>>
>> Hi Daryl,
>>
>> Has the AstLinux version changed in the last couple weeks ?
>>
>> What version are you running ?
>>
>> Lonnie
>>
>>
>>
>>> On Sep 16, 2020, at 8:01 AM, Daryl Richards via Astlinux-users
<astlinux-users@lists.sourceforge.net> wrote:
>>>
>>> This is good timing (in a bad way..) Time for a "Me too!"
>>>
>>> Recently, over the last couple weeks my APU2 has started locking up
exactly the same way, just hard lock. I have a serial console cable hooked up
and there are no messages printed out before, there's just nothing. When the
problem first started I didn't have a console cable hooked up but I put it in
to see if any messages were appearing..
>>>
>>> My system is on a UPS. Nothing else in the rack glitches.
>>>
>>> On 2020-09-15 8:36 p.m., Michael Knill wrote:
>>>> Thanks Chris
>>>> Yep I have plenty out there too with no issues. It also happened on a
Qotom box so not hardware related.
>>>> Regards
>>>> Michael Knill
>>>> *From: *AstLinux List <astlinux-users@lists.sourceforge.net>
>>>> *Reply to: *AstLinux List <astlinux-users@lists.sourceforge.net>
>>>> *Date: *Wednesday, 16 September 2020 at 8:53 am
>>>> *To: *AstLinux List <astlinux-users@lists.sourceforge.net>
>>>> *Cc: *The Cadillac Kid <eldorado...@yahoo.com>
>>>> *Subject: *Re: [Astlinux-users] APU2 keeps locking up
>>>> for whatever its worth.. from a hardware standpoint I have probably
200 APU2s in the field and dont have then just freeze like that.. granted they
arent running astlinux, but just mentioning it from a power / hardware point of
view.
>>>> mine are all running Centos 6.X and asterisk 11 or 13
>>>> I have had a few chan_sip freezes.. (we wrote a watchdog to catch
those and restart asterisk).. we get maybe 1 every 3 or 4 months .. (not each
site but collectively)
>>>> I have kenrel panicked an APU before by upping and downing the
ethernet port too much (or so it seems).. it doesnt happen very often and is
hard to repeat in the lab. but have done it esp on an install.. where one is
prone to plug and unplug cables multiple times in succession for dressing in..
>>>> I have had a few power bricks go bad.. in all cases there was just no
output.. no lights on the board at all. its not been that many 3 or 4..
considering we have sites in some pretty lightning-prone areas i dont feel too
bad about a few power bricks.
>>>> we run UPSs on all of our sites
>>>> we run the US power supply that is sold on the PC-Engines store.
>>>> On Tuesday, September 15, 2020, 6:04:44 PM EDT, Michael Knill
<michael.kn...@ipcsolutions.com.au> wrote:
>>>> Yep I would say environmental for 1, maybe 2 sites but for 3 sites and
all only recently I cant see how it could be.
>>>> No serial or long ethernet cables are connected.
>>>> Yes completely different power adaptors when I changed from APU2 ->
Qotom.
>>>> Yes they are all DSL however ALL different modems and service types.
>>>> I'm thinking I will upgrade all Runnix versions at these sites and if
still happening upgrade to 1.3.10 and if still happening then I have no idea
what to do.
>>>> Regards
>>>> Michael Knill
>>>> On 16/9/20, 7:36 am, "Lonnie Abelbeck" <li...@lonnie.abelbeck.com
<mailto:li...@lonnie.abelbeck.com>> wrote:
>>>> So a UPS may solve the issue as with Site 1 ?
>>>> Do you have any serial cables connected ?
>>>> Any long ethernet cables connected ?
>>>> Is this with a variety of power adapters ? ie. the APU2 -> Qotom
switch did the power adapter change as well ?
>>>> Sure sounds environmental to me.
>>>> I've seen DC-to-DC UPSs for about $40 USD, but never tried one.
>>>> https://protectli.com/product/uninterruptible-power-supply/
>>>> Lonnie
>>>>> On Sep 15, 2020, at 3:58 PM, Michael Knill
<michael.kn...@ipcsolutions.com.au<mailto:michael.kn...@ipcsolutions.com.au>>
wrote:
>>>>>
>>>>> Ok I'm reviving this thread as I have now had my third site with this
issue.
>>>>>
>>>>> Symptom:
>>>>> Astlinux completely locks up and requires a power reset. The log
shows NOTHING in all cases.
>>>>>
>>>>> Troubleshooting conducted:
>>>>> Site 1 - The problem has not occurred since both a UPS AND Power
Filter have been added
>>>>> Site 2 - A power filter has been added and the problem has
reoccurred. I have completely changed the system from an APU2 to Qotom and it
did the same thing again
>>>>> Site 3 - A known working APU2 was installed and it locked up
yesterday.
>>>>>
>>>>> I have checked mSATA cards and they were different across systems at
these sites.
>>>>> All systems are running 1.3.7.1 but I am running this at many other
sites on the same hardware with no issues.
>>>>>
>>>>> Power quality testing is extremely expensive and surely I cant be
having a power issue at 3 sites!
>>>>> The whole thing just doesn't make any sense and I don't know where to
go from here.
>>>>> Any ideas?
>>>>>
>>>>> Regards
>>>>> Michael Knill
>>>>>
>>>>> On 22/4/20, 9:24 pm, "Michael Knill"
<michael.kn...@ipcsolutions.com.au<mailto:michael.kn...@ipcsolutions.com.au>>
wrote:
>>>>>
>>>>> Looks like this problem was bad power. I was told by the local IT
Guy that there are regular brownouts so I installed a UPS. No more problems
since doing so.
>>>>> Seems like APU's don't like low voltage scenarios.
>>>>>
>>>>> Thanks for your help.
>>>>>
>>>>> Regards
>>>>> Michael Knill
>>>>>
>>>>> On 13/4/20, 1:05 pm, "Michael Knill"
<michael.kn...@ipcsolutions.com.au<mailto:michael.kn...@ipcsolutions.com.au>>
wrote:
>>>>>
>>>>> Yes could be but very unusual. I have never had this problem
with any other APU.
>>>>> Maybe I will look for a good surge suppressor.
>>>>>
>>>>> Regards
>>>>> Michael Knill
>>>>>
>>>>> On 13/4/20, 12:47 pm, "Lonnie Abelbeck"
<li...@lonnie.abelbeck.com <mailto:li...@lonnie.abelbeck.com>> wrote:
>>>>>
>>>>> Interesting, maybe bad power (spikes, noise, etc.)
>>>>>
>>>>> Test with a UPS attached or good surge suppresser.
>>>>>
>>>>> Lonnie
>>>>>
>>>>>
>>>>>
>>>>>> On Apr 12, 2020, at 9:17 PM, Michael Knill
<michael.kn...@ipcsolutions.com.au<mailto:michael.kn...@ipcsolutions.com.au>>
wrote:
>>>>>>
>>>>>> Hi Lonnie
>>>>>>
>>>>>> I have replaced the hardware already and it did EXACTLY the same
thing ☹
>>>>>>
>>>>>> Regards
>>>>>> Michael Knill
>>>>>>
>>>>>> On 13/4/20, 12:15 pm, "Lonnie Abelbeck" <li...@lonnie.abelbeck.com
<mailto:li...@lonnie.abelbeck.com>> wrote:
>>>>>>
>>>>>>
>>>>>>
>>>>>>> On Apr 12, 2020, at 7:03 PM, Michael Knill
<michael.kn...@ipcsolutions.com.au<mailto:michael.kn...@ipcsolutions.com.au>>
wrote:
>>>>>>>
>>>>>>> May not have anything to do with Astlinux but I have a site which
completely locks up e.g. cannot even communicate using serial port.
>>>>>>> On reboot its fine but there is nothing in the logs but the bootup
messages.
>>>>>>> So far I have replaced the hardware with new storage as well and
power supply and it is still doing it.
>>>>>>>
>>>>>>> It is currently running Astlinux 1.3.7.1 which has been running
fine on another APU2 but its only been 8 days.
>>>>>>>
>>>>>>> Any ideas what I can do next?
>>>>>>>
>>>>>>> Regards
>>>>>>> Michael Knill
>>>>>>
>>>>>> Sounds like an APU2 hardware issue.
>>>>>>
>>>>>> Maybe Pascal will give you a replacement.
>>>>>>
>>>>>> Lonnie
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> _______________________________________________
>>>>>> Astlinux-users mailing list
>>>>>> Astlinux-users@lists.sourceforge.net
<mailto:Astlinux-users@lists.sourceforge.net>
>>>>>> https://lists.sourceforge.net/lists/listinfo/astlinux-users
>>>>>>
>>>>>> Donations to support AstLinux are graciously accepted via PayPal to
pay...@krisk.org. <mailto:pay...@krisk.org.>
>>>>>>
>>>>>>
>>>>>>
>>>>>> _______________________________________________
>>>>>> Astlinux-users mailing list
>>>>>> Astlinux-users@lists.sourceforge.net
<mailto:Astlinux-users@lists.sourceforge.net>
>>>>>> https://lists.sourceforge.net/lists/listinfo/astlinux-users
>>>>>>
>>>>>> Donations to support AstLinux are graciously accepted via PayPal to
pay...@krisk.org. <mailto:pay...@krisk.org.>
>>>>>
>>>>>
>>>>>
>>>>> _______________________________________________
>>>>> Astlinux-users mailing list
>>>>> Astlinux-users@lists.sourceforge.net
<mailto:Astlinux-users@lists.sourceforge.net>
>>>>> https://lists.sourceforge.net/lists/listinfo/astlinux-users
>>>>>
>>>>> Donations to support AstLinux are graciously accepted via
PayPal to pay...@krisk.org. <mailto:pay...@krisk.org.>
>>>>>
>>>>>
>>>>> _______________________________________________
>>>>> Astlinux-users mailing list
>>>>> Astlinux-users@lists.sourceforge.net
<mailto:Astlinux-users@lists.sourceforge.net>
>>>>> https://lists.sourceforge.net/lists/listinfo/astlinux-users
>>>>>
>>>>> Donations to support AstLinux are graciously accepted via PayPal
to pay...@krisk.org. <mailto:pay...@krisk.org.>
>>>>>
>>>>>
>>>>> _______________________________________________
>>>>> Astlinux-users mailing list
>>>>> Astlinux-users@lists.sourceforge.net
<mailto:Astlinux-users@lists.sourceforge.net>
>>>>> https://lists.sourceforge.net/lists/listinfo/astlinux-users
>>>>>
>>>>> Donations to support AstLinux are graciously accepted via PayPal to
pay...@krisk.org. <mailto:pay...@krisk.org.>
>>>>>
>>>>>
>>>>> _______________________________________________
>>>>> Astlinux-users mailing list
>>>>> Astlinux-users@lists.sourceforge.net
<mailto:Astlinux-users@lists.sourceforge.net>
>>>>> https://lists.sourceforge.net/lists/listinfo/astlinux-users
>>>>>
>>>>> Donations to support AstLinux are graciously accepted via PayPal to
pay...@krisk.org. <mailto:pay...@krisk.org.>
>>>> _______________________________________________
>>>> Astlinux-users mailing list
>>>> Astlinux-users@lists.sourceforge.net
<mailto:Astlinux-users@lists.sourceforge.net>
>>>> https://lists.sourceforge.net/lists/listinfo/astlinux-users
>>>> Donations to support AstLinux are graciously accepted via PayPal to
pay...@krisk.org. <mailto:pay...@krisk.org.>
>>>> _______________________________________________
>>>> Astlinux-users mailing list
>>>> Astlinux-users@lists.sourceforge.net
<mailto:Astlinux-users@lists.sourceforge.net>
>>>> https://lists.sourceforge.net/lists/listinfo/astlinux-users
>>>> Donations to support AstLinux are graciously accepted via PayPal to
pay...@krisk.org. <mailto:pay...@krisk.org.>
>>>> _______________________________________________
>>>> Astlinux-users mailing list
>>>> Astlinux-users@lists.sourceforge.net
>>>> https://lists.sourceforge.net/lists/listinfo/astlinux-users
>>>> Donations to support AstLinux are graciously accepted via PayPal to
pay...@krisk.org.
>>>
>>> --
>>> Daryl Richards
>>> Isle Technical Services Inc.
>>>
>>>
>>> _______________________________________________
>>> Astlinux-users mailing list
>>> Astlinux-users@lists.sourceforge.net
>>> https://lists.sourceforge.net/lists/listinfo/astlinux-users
>>>
>>> Donations to support AstLinux are graciously accepted via PayPal to
pay...@krisk.org.
>>
>>
>>
>> _______________________________________________
>> Astlinux-users mailing list
>> Astlinux-users@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/astlinux-users
>>
>> Donations to support AstLinux are graciously accepted via PayPal to
pay...@krisk.org.
>
>
> Michael
>
> http://www.mksolutions.info
>
>
>
>
>
> _______________________________________________
> Astlinux-users mailing list
> Astlinux-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/astlinux-users
>
> Donations to support AstLinux are graciously accepted via PayPal to
pay...@krisk.org.
>
>
> _______________________________________________
> Astlinux-users mailing list
> Astlinux-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/astlinux-users
>
> Donations to support AstLinux are graciously accepted via PayPal to
pay...@krisk.org.
_______________________________________________
Astlinux-users mailing list
Astlinux-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/astlinux-users
Donations to support AstLinux are graciously accepted via PayPal to
pay...@krisk.org.
_______________________________________________
Astlinux-users mailing list
Astlinux-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/astlinux-users
Donations to support AstLinux are graciously accepted via PayPal to
pay...@krisk.org.
