Thanks All. Looks like someone routed around HE for me. Came back at 16:00 EDT:
nog2.angryox.com (0.0.0.0) Tue Apr 26
16:13:08 2016
Packets Pings
Host Loss% Snt Last Avg Best
Wrst StDev
1. xl0.tic.nova.org 0.0% 5 0.1 0.1 0.1
0.2 0.0
2. wsip-70-168-111-17.dc.dc.cox.net 0.0% 5 1.4 1.4 1.2
1.6 0.0
3. ip68-100-3-109.dc.dc.cox.net 0.0% 5 1.1 1.5 1.1
2.3 0.0
4. ashbbprj01-ae5.0.rd.as.cox.net 0.0% 4 1.7 1.8 1.7
2.1 0.0
5. xe-5-0-0.edge2.Washington4.Level3.net 0.0% 4 2.3 2.0 1.8
2.3 0.0
6. ae-3-80.edge1.Washington4.Level3.net 0.0% 4 3.3 3.1 2.6
3.8 0.0
7. ash-b1-link.telia.net 0.0% 4 3.3 18.3 3.3
59.8 27.7
8. ash-bb4-link.telia.net 0.0% 4 2.8 3.0 2.8
3.3 0.0
9. sjo-b21-link.telia.net 0.0% 4 76.7 76.2 75.5
76.7 0.0
10. den-b1-link.telia.net 0.0% 4 73.0 73.0 72.7
73.5 0.0
11. handynet-ic-145041-den-b1.c.telia.net 0.0% 4 72.7 73.1 72.7
73.4 0.0
12. ae2-14.core1.denver2.handynetworks.com 0.0% 4 73.0 72.9 72.7
73.1 0.0
13. ae0-10.dist2.denver2.handynetworks.com 0.0% 4 73.5 73.8 73.5
74.3 0.0
14. vlan954.sw2-g4.denver2.handynetworks.com 0.0% 4 74.1 74.6 73.7
76.7 1.2
15. vlan11.sw1-h3.softsyshosting.com 0.0% 4 72.8 73.0 72.8
73.4 0.0
16. 72.18.145.210 0.0% 4 73.4 73.0 72.7
73.4 0.0
On Tue, 26 Apr 2016, Jason Lixfeld wrote:
Our NLNOG ring alerted us to a brief issue which lasted about 5 minutes:
rackcentral02.ring.nlnog.net AS58443 (AU)
mtr -i0.5 -c5 -r -w -n 163.53.233.70
HOST: beanfield01.ring.nlnog.net Loss% Snt Last Avg Best Wrst StDev
1.|-- 66.207.196.129 0.0% 5 0.4 1.1 0.3 3.9 1.3
2.|-- 72.15.51.2 0.0% 5 0.8 0.8 0.7 0.9 0.0
3.|-- 72.15.49.83 0.0% 5 1.0 0.9 0.9 1.1 0.0
4.|-- 206.108.34.112 0.0% 5 0.4 1.9 0.4 8.1 3.3
5.|-- ??? 100.0 5 0.0 0.0 0.0 0.0 0.0
vocus01.ring.nlnog.net AS4826 (AU)
mtr -i0.5 -c5 -r -w -n 175.45.73.66
HOST: beanfield01.ring.nlnog.net Loss% Snt Last Avg Best Wrst StDev
1.|-- 66.207.196.129 0.0% 5 0.3 0.3 0.3 0.4 0.0
2.|-- 72.15.51.2 0.0% 5 0.6 0.8 0.6 1.0 0.0
3.|-- 72.15.49.83 0.0% 5 1.0 1.1 1.0 1.2 0.0
4.|-- 206.108.34.112 0.0% 5 8.8 10.4 8.8 12.8 1.6
5.|-- ??? 100.0 5 0.0 0.0 0.0 0.0 0.0
Once it came back:
BlackBox-3:Beanfield jlixfeld$ mtr -c 5 -rw rackcentral02.ring.nlnog.net
Start: Tue Apr 26 16:04:49 2016
HOST: BlackBox-3.local Loss% Snt
Last Avg Best Wrst StDev
1.|-- vl4091.trs01.002.77mowatav01.yyz.beanfield.com 0.0% 5
3.1 4.9 1.9 15.5 5.9
2.|-- te0-2-0-2.bfr01.905kingstw01.yyz.beanfield.com 0.0% 5
3.1 2.6 2.3 3.1 0.0
3.|-- te-0-2-0-14.bfr01.151frontstw01.yyz.beanfield.com 0.0% 5
3.1 3.1 2.9 3.4 0.0
4.|-- he.ip4.torontointernetxchange.net 0.0% 5
2.0 4.2 2.0 9.2 3.1
5.|-- 100ge13-1.core1.chi1.he.net 0.0% 5
17.8 26.2 11.9 68.6 24.0
6.|-- 10ge11-4.core1.pao1.he.net 0.0% 5
70.2 73.0 70.1 79.2 3.6
7.|-- 10ge4-1.core1.sjc1.he.net 0.0% 5
76.7 81.0 76.7 92.4 6.5
8.|-- tpg-internet-pty-ltd.10gigabitethernet3-8.core1.lax2.he.net 0.0% 5
250.9 251.2 249.5 252.2 0.9
9.|-- 203-219-35-193.static.tpgi.com.au 0.0% 5
233.9 233.4 231.2 235.2 1.5
10.|-- nme-apt-bur-wgw1-be-10.tpgi.com.au 0.0% 5
264.4 264.9 264.1 266.7 0.9
11.|-- 203-219-107-206.static.tpgi.com.au 0.0% 5
260.6 260.6 260.2 261.5 0.0
12.|-- po8.mburndist01.aapt.net.au 0.0% 5
443.5 296.5 259.4 443.5 82.2
13.|-- ??? 100.0 5
0.0 0.0 0.0 0.0 0.0
14.|-- 59-100-253-114.mel.static-ipl.aapt.com.au 0.0% 5
249.3 251.9 249.1 256.8 3.1
15.|-- 163.53.233.254 0.0% 5
285.7 256.3 248.9 285.7 16.4
16.|-- 163.53.233.70 0.0% 5
250.4 250.3 250.0 250.5 0.0
BlackBox-3:Beanfield jlixfeld$ mtr -c 5 -rw vocus01.ring.nlnog.net
Start: Tue Apr 26 16:05:15 2016
HOST: BlackBox-3.local Loss% Snt Last
Avg Best Wrst StDev
1.|-- vl4091.trs01.002.77mowatav01.yyz.beanfield.com 0.0% 5 2.2
2.4 2.0 2.8 0.0
2.|-- te0-2-0-2.bfr01.905kingstw01.yyz.beanfield.com 0.0% 5 2.1
2.6 2.1 3.7 0.5
3.|-- te-0-2-0-14.bfr01.151frontstw01.yyz.beanfield.com 0.0% 5 2.7
2.8 2.7 3.0 0.0
4.|-- he.ip4.torontointernetxchange.net 0.0% 5 2.6
6.4 2.0 13.5 4.5
5.|-- 100ge13-1.core1.chi1.he.net 0.0% 5 11.8
14.8 11.8 16.9 1.9
6.|-- eqix-ch1.vocusconnect.com 0.0% 5 104.1
117.0 103.1 148.2 20.1
7.|-- bundle153.cor02.lax01.ca.vocus.net 0.0% 5 266.8
266.5 266.4 266.8 0.0
8.|-- 100g-0-1-0-0.cor01.lax01.ca.vocus.net 0.0% 5 266.2
266.4 266.2 266.6 0.0
9.|-- 100g-0-1-0-0.cor01.sjc01.ca.vocus.net 0.0% 5 266.4
266.4 266.3 266.5 0.0
10.|-- ten-0-2-0-3.cor01.syd04.nsw.vocus.net.au 0.0% 5 266.6
266.8 266.4 267.3 0.0
11.|-- 175.45.72.95 0.0% 5 266.0
266.1 265.8 266.4 0.0
12.|-- ring.vocus.net.au 0.0% 5 269.8
269.8 269.7 270.0 0.0
BlackBox-3:Beanfield jlixfeld$
On Apr 26, 2016, at 3:59 PM, Peter Beckman via Outages <[email protected]>
wrote:
A few minutes ago I was notified that one of my servers in Denver, CO was
down (ip: 72.18.145.210).
Anyone seeing a similar loss on he.net in Chicago?
nog2.angryox.com (0.0.0.0) Tue Apr 26 15:54:54
2016
Packets Pings
Host Loss% Snt Last Avg Best Wrst
StDev
1. xl0.tic.nova.org 0.0% 36 0.1 0.1 0.1 1.0
0.0
2. wsip-70-168-111-17.dc.dc.cox.net 2.8% 36 1.8 13.3 1.1 183.2
40.1
3. ip68-100-3-109.dc.dc.cox.net 0.0% 36 1.1 3.0 1.1 25.6
4.9
4. ashbbprj01-ae5.0.rd.as.cox.net 0.0% 36 1.7 3.6 1.7 20.7
4.3
5. 68.105.30.114 2.8% 36 7.8 15.1 1.8 120.4
21.0
6. 10ge3-6.core2.chi1.he.net 2.8% 36 33.2 35.2 28.1 51.4
6.9
7. ??
But from Verizon it is up:
max.angryox.com (0.0.0.0) Tue Apr 26 15:56:08
2016
Packets Pings
Host Loss% Snt Last Avg Best Wrst
StDev
1. tomato.angryox.com 0.0% 158 0.3 0.4 0.3 2.4
0.2
2. lo0-100.WASHDC-VFTTP-312.verizon-gni 0.0% 158 3.7 7.0 3.0 153.9
13.1
3. T1-3-0-4.WASHDC-LCR-21.verizon-gni.n 0.0% 158 7.9 8.1 3.1 156.9
12.0
4. ???
5. ???
6. 0.ae3.GW11.IAD8.ALTER.NET 0.0% 157 6.5 8.5 5.4 118.2
12.1
7. teliasonera-gw.customer.alter.net 0.0% 157 7.2 9.0 5.5 164.1
15.7
8. ash-bb3-link.telia.net 0.0% 157 8.0 8.9 5.5 148.9
14.4
9. sjo-b21-link.telia.net 0.0% 157 71.1 72.6 68.8 150.8
7.2
10. den-b1-link.telia.net 0.0% 157 99.3 99.6 98.0 122.4
2.4
11. handynet-ic-145041-den-b1.c.telia.ne 0.0% 157 130.4 100.1 98.0 130.4
3.3
12. ae2-14.core1.denver2.handynetworks.c 0.0% 157 97.1 97.1 95.5 113.8
1.8
13. ae0-10.dist2.denver2.handynetworks.c 0.0% 157 99.5 103.9 95.6 828.6
58.2
14. vlan954.sw2-g4.denver2.handynetworks 0.0% 157 98.5 104.7 98.1 761.2
52.8
15. vlan11.sw1-h3.softsyshosting.com 0.0% 157 99.8 103.8 97.1 430.8
33.8
16. 72.18.145.210 0.0% 157 97.3 97.1 95.5 128.1
2.7
---------------------------------------------------------------------------
Peter Beckman Internet Guy
[email protected] http://www.angryox.com/
---------------------------------------------------------------------------
_______________________________________________
Outages mailing list
[email protected]
https://puck.nether.net/mailman/listinfo/outages
---------------------------------------------------------------------------
Peter Beckman Internet Guy
[email protected] http://www.angryox.com/
---------------------------------------------------------------------------
_______________________________________________
Outages mailing list
[email protected]
https://puck.nether.net/mailman/listinfo/outages