Re: [outages] Spectrum/LTWC Ohio/KY

[Sean Harlow via Outages]

Seeing all kinds of up and down from the Spectrum Cable side in NE Ohio
across dozens of client sites.  Pings to 4.2.2.x and access to services
like Discord and Slack get interrupted while pings to 8.8.8.8 stay
working.  I lose access to all my Newark Linodes whenever it happens.

On Tue, Sep 7, 2021 at 12:58 PM Josh Luthman via Outages <
outages@outages.org> wrote:

> No problems with either of 2 circuits in Dayton/Cinci.  Assuming you are
> talking fiber DIA.
>
> Josh Luthman
> 24/7 Help Desk: 937-552-2340
> Direct: 937-552-2343
> 1100 Wayne St
> Suite 1337
> Troy, OH 45373
>
>
> On Tue, Sep 7, 2021 at 12:53 PM Neader, Brent via Outages <
> outages@outages.org> wrote:
>
>> Seeing enterprise DIA sites drop off and come back repeatedly in these
>> areas, Dayton, Cinci, Cleveland, Middletown, Louisville.
>> ___
>> Outages mailing list
>> Outages@outages.org
>> https://puck.nether.net/mailman/listinfo/outages
>>
> ___
> Outages mailing list
> Outages@outages.org
> https://puck.nether.net/mailman/listinfo/outages
>
___
Outages mailing list
Outages@outages.org
https://puck.nether.net/mailman/listinfo/outages

Re: [outages] amazon.com down?

[Sean Harlow via Outages]

Amazon goofed up their DNS for a bit, the A record for www.amazon.com
wasn't there and the raw amazon.com was redirecting to www.

Some discussion on HN: https://news.ycombinator.com/item?id=23341170

On Thu, May 28, 2020 at 3:49 PM Dan Walters via Outages 
wrote:

> Simile.amazon.com and business.amazon.com both seem to be working but
> www.amazon.com and amazon.com both are not.
>
>
>
> Carrier spectrum Wisconsin.
>
>
>
>
>
> Dns seems to be resolving… but have seen a few nxdomains show up from the
> web browser?
>
>
>
>
>
> Best Regards,
>
>
>
> Daniel Walters
>
> Sr. Systems Engineer.
>
> *866.421.2374 ext. 6213*
>
> [image: Omingo Logo]
>
> 7625 S Howell Ave, Oak Creek, WI 53154
>
> www.omnigo.com
>
>
>
>
> ___
> Outages mailing list
> Outages@outages.org
> https://puck.nether.net/mailman/listinfo/outages
>
___
Outages mailing list
Outages@outages.org
https://puck.nether.net/mailman/listinfo/outages

[outages] Linode Newark Down?

[Sean Harlow via Outages]

I seem to have lost all my systems in Linode's Newark location.  Can't ping
or connect to from anywhere, including other Linode-hosted systems in
Dallas and London.  Linode's web console tool also can't connect.
___
Outages mailing list
Outages@outages.org
https://puck.nether.net/mailman/listinfo/outages

Re: [outages] Bandwidth Voice Issues?

[Sean Harlow via Outages]

I saw the issues from my own systems in New York and New Jersey, both of
which connect to the New York POP by default, and also from another
vendor's system in Philadelphia which I assume also uses New York.  I was
seeing ~12% packet loss on every call routed through them.

It doesn't appear to be happening regularly anymore, I'm still getting some
spurious reports from end users but I'm not able to replicate the problem
myself where when I sent my initial message it was literally every call.


On Mon, Dec 4, 2017 at 11:37 AM Phil Lavin  wrote:

> Which POPs are you connected into? Not seeing any issues to New York or
> Atlanta POPs.
>
>
>
___
Outages mailing list
Outages@outages.org
https://puck.nether.net/mailman/listinfo/outages

[outages] Bandwidth Voice Issues?

[Sean Harlow via Outages]

Anyone else experiencing major quality issues on Bandwidth?  I'm having
really bad connections both inbound and outbound from multiple locations in
different states.
___
Outages mailing list
Outages@outages.org
https://puck.nether.net/mailman/listinfo/outages

Re: [outages] cocmast packetloss and high latency

[Sean Harlow via Outages]

I was watching my Houston site MTR and just saw it start taking a different
route that avoids NTT/L3 and at that same time my pings cleared up all
around the country.  I'm now going on three minutes clean.

On Mon, Nov 6, 2017 at 2:25 PM Boyd, Ian via Outages 
wrote:

> I have  the following areas under an outage:
>
> Bellingham, WA
>
> Salem, OR
>
> Beaverton, OR
>
> Seattle, WA
>
> St. Helens, OR
>
> Hillsboro, OR
>
> Portland, OR
>
> All are issues are on the Comcast circuit.
>
>
>
> I have a few Lvl 3 sites, but not having much issues with them yet.
>
>
>
>
>
> Thanks,
>
>
>
> Ian Boyd
>
>
>
> Network Technician
>
> *Avamere Family of Companies *
>
> Desk: (971) 224-2817
>
> Cell: (503) 878-3054
>
> Fax: (503) 570-3315
>
> ib...@avamere.com
>
> Having Issues? Please visit: servicedesk.avamere.com
>
>
>
> --
>
> COMPLIANCE CONFIDENTIAL NOTICE
> ---
> This Electronic Mail and any attached documents may contain confidential
> information, some, or all of which, may be protected health information as
> defined by the federal Health Insurance Portability & Accountability Act
> (HIPAA) Privacy Rule. This transmission is intended for the exclusive use
> of the individual or entity to whom it is addressed.
> Further, this electronic mail may contain information that is proprietary,
> privileged, confidential and/or exempt from disclosure under other
> applicable laws. If you are not the intended recipient (or an employee or
> agent responsible for delivering this electronic mail transmission to the
> intended recipient), you are hereby notified that any disclosure,
> dissemination, distribution or copying of this information is strictly
> prohibited and may be subject to legal restriction or sanction. Please
> notify the sender by telephone or via email to arrange the return or
> destruction of the information and all copies.
> ---
> ___
> Outages mailing list
> Outages@outages.org
> https://puck.nether.net/mailman/listinfo/outages
>
___
Outages mailing list
Outages@outages.org
https://puck.nether.net/mailman/listinfo/outages

Re: [outages] Major DNS DoS

[Sean Harlow via Outages]

I was definitely seeing it this morning, had a few customers unable to
reach a certain vendor due to DNS not responding and my own Reddit browsing
was unreliable, but it cleared up and has been solid since a bit after 9:00
Eastern.

Dyn status page says they consider the problem resolved as of 9:20 Eastern.

On Fri, Oct 21, 2016 at 9:33 AM Rob Hall via Outages 
wrote:

> So far, we’re not seeing any issues in NE TN, SW VA, Western KY, or middle
> GA.
>
>
>
>
>
> Thanks!
>
> --
>
> Rob Hall, CCNP R, CCP-V
>
> I.T. Manager
>
> @Work Personnel Service
>
> 3815 Hwy 66 S, Suite 4
>
> Rogersville, TN 37857
>
> Office: (423)272-7897, x10113 <(423)%20272-7897>
>
> Mobile: (423)312-6003 <(423)%20312-6003>
>
> [image: cisco-certified-ccnp][image: CCP-V]
>
>
>
>
>
>
>
> *From:* Outages [mailto:outages-boun...@outages.org] *On Behalf Of *Colangelo,
> Dom via Outages
> *Sent:* Friday, October 21, 2016 9:23 AM
> *To:* Charles Mills 
>
>
> *Cc:* outages@outages.org
> *Subject:* Re: [outages] Major DNS DoS
>
>
>
> Sorry, should have provided more info last time.
>
>
>
> Same behavior seen up to Boston. Some of our internal health checks
> actually picked it up around 7:30AM EDT
>
>
>
> Dominick Colangelo * Systems Administrator * Technology Services *
> wit.edu/dts  * Follow us on Twitter @ DTSatWIT
> 
>
>
>
> *From:* Charles Mills [mailto:w3y...@gmail.com ]
> *Sent:* Friday, October 21, 2016 9:21 AM
> *To:* Colangelo, Dom 
> *Cc:* outages@outages.org
> *Subject:* Re: [outages] Major DNS DoS
>
>
>
> Saw it here too.  Western PA
>
> intermittent  and verified with various public dns servers.
>
> Chuck
>
>
>
> On Fri, Oct 21, 2016 at 9:11 AM, Colangelo, Dom via Outages <
> outages@outages.org> wrote:
>
> I prefer my updates from the affected company themselves than gizmodo J
>
>
>
> https://www.dynstatus.com/incidents/nlr4yrr162t8
>
>
>
> Dominick Colangelo * Systems Administrator * Technology Services *
> wit.edu/dts  * Follow us on Twitter @ DTSatWIT
> 
>
>
>
> *From:* Outages [mailto:outages-boun...@outages.org] *On Behalf Of *Adam
> Greene via Outages
> *Sent:* Friday, October 21, 2016 9:11 AM
> *To:* outages@outages.org
> *Subject:* [outages] Major DNS DoS
>
>
>
> I’m probably not noticing this being reported on this list, because of the
> very DNS issues taking place, but just in case:
>
>
>
>
> http://gizmodo.com/this-is-probably-why-half-the-internet-shut-down-today-1788062835
>
>
>
> Adam
>
>
> ___
> Outages mailing list
> Outages@outages.org
> https://puck.nether.net/mailman/listinfo/outages
>
>
> ___
> Outages mailing list
> Outages@outages.org
> https://puck.nether.net/mailman/listinfo/outages
>
___
Outages mailing list
Outages@outages.org
https://puck.nether.net/mailman/listinfo/outages

Re: [outages] Level3 VoIP Issues?

[Sean Harlow via Outages]

Not that we likely need more confirmation at this point, but I'm seeing it
on Cleveland-area DIDs.  Definitely some kind of SHTF situation at Level3.

On Tue, Oct 4, 2016 at 10:28 AM Kevin Miller via Outages <
outages@outages.org> wrote:

> All of our Level3 DIDs in PHL and JFK do not seem to working inbound.
> Outgoing seems to be fine.  Waiting for someone to pick up at Level3.
> Anyone else seeing issues?
> ___
> Outages mailing list
> Outages@outages.org
> https://puck.nether.net/mailman/listinfo/outages
>
___
Outages mailing list
Outages@outages.org
https://puck.nether.net/mailman/listinfo/outages

Re: [outages] Cisco.com down

[Sean Harlow via Outages]

I'm seeing the same.  It's not a local DNS error, it's a HTML error page
that contains the following text:

---
Service Unavailable - DNS failure

The server is temporarily unable to service your request. Please try again
later.
Reference #11.832d1bb8.1464798760.162f8dd4
---

If I'm not mistaken that's an Akamai error.

On Tue, May 31, 2016 at 6:18 PM Frank Bulk via Outages 
wrote:

> Don’t see that here, sorry.  Please share your dig output, against both
> your local DNS server, and against Google (8.8.8.8 and 8.8.4.4) and OpenDNS
> (208.67.220.220 and 208.67.222.222).
>
>
>
> Thanks,
>
>
>
> Frank
>
>
>
> *From:* Outages [mailto:outages-boun...@outages.org] *On Behalf Of *Jeremy
> Schwarzrock via Outages
> *Sent:* Tuesday, May 31, 2016 3:30 PM
> *To:* Outages@outages.org
> *Subject:* [outages] Cisco.com down
>
>
>
> I'm seeing DNS error on the main Cisco.com website from Fargo, ND. Also
> unable to reach SourceFire AMP's page right now.
> ___
> Outages mailing list
> Outages@outages.org
> https://puck.nether.net/mailman/listinfo/outages
>
___
Outages mailing list
Outages@outages.org
https://puck.nether.net/mailman/listinfo/outages

Re: [outages] Voip Innovations

[Sean Harlow via Outages]

I have a few dozen clients on VI and haven't heard any complaints yet.  I
was just able to test call all of my normal test lines through my VI trunk
without any issues as well.  Not to say that confirms or denies anything,
they do seem to have a habit of coming up with interesting ways to fail.

On Tue, May 24, 2016 at 11:30 AM Aaron Gustafson via Outages <
outages@outages.org> wrote:

> Is anyone else experiencing issues with VI this morning?
>
>
> I've got two clients saying they're getting various error messages when
> they try to dial out or call there main numbers.
>
>
> Thank You,
> Aaron Gustafson
> Owner
> Computers N' Stuff
> ___
> Outages mailing list
> Outages@outages.org
> https://puck.nether.net/mailman/listinfo/outages
>
___
Outages mailing list
Outages@outages.org
https://puck.nether.net/mailman/listinfo/outages

Re: [outages] VoIP Innovations Down

[Sean Harlow via Outages]

Same experience here, including the DR site not being of any use.  It
responds with a "100 Trying" and then 20 seconds later a "504 Server
Timeout".

Between this and the issue I posted about the other day (which they
confirmed was a bug in their system that caused parts of it to think
certain endpoints were actually at the IP "1.1.1.1") I'm getting pretty fed
up with them this week.

On Fri, May 6, 2016 at 2:18 PM Kurt Duncan via Outages 
wrote:

> It’s not 100% like always.. keeps going up and down.  They recommend
> adding the 209.x.x.x address for disaster recovery but its not working
> either.
>
>
>
>
>
> Kurt Duncan
>
>
>
> *From:* Outages [mailto:outages-boun...@outages.org] *On Behalf Of *Jordan
> Morris via Outages
> *Sent:* Friday, May 6, 2016 11:14 AM
> *To:* Outages@outages.org
>
>
> *Subject:* Re: [outages] VoIP Innovations Down
>
>
>
>
>
> *Just came back up…..let our port out process begain…*
>
>
>
> *From:* Jeff Waddell [mailto:j...@waddellsolutions.com
> ]
> *Sent:* Friday, May 06, 2016 11:09 AM
> *To:* Jordan Morris 
> *Cc:* Outages@outages.org
> *Subject:* Re: [outages] VoIP Innovations Down
>
>
>
> Just came back up for me
>
>
>
>
>
>
> *Jeff Waddell*
>
> *Engineer | Waddell Solutions Group*
>
> Office: 859.818. x3002
>
> *www.waddellsolutions.com* 
>
> *j...@waddellsolutions.com* 
>
>
>
> On Fri, May 6, 2016 at 1:43 PM, Jordan Morris via Outages <
> outages@outages.org> wrote:
>
> Two of their four servers are down for us but we're still getting traffic
> on the other two.
>
>
>
>
> -Original Message-
> From: Outages [mailto:outages-boun...@outages.org] On Behalf Of Alex
> Leach via Outages
> Sent: Friday, May 06, 2016 10:39 AM
> To: outages@outages.org
> Subject: Re: [outages] VoIP Innovations Down
>
> Yes, seeing them down too.
>
>
>
> On 5/6/2016 12:33 PM, Plexicomm via Outages wrote:
> > Anyone else see VoIP Innovations go down, AGAIN!!
> >
> >
> > ___
> > Outages mailing list
> > Outages@outages.org
> > https://puck.nether.net/mailman/listinfo/outages
> >
>
> ___
> Outages mailing list
> Outages@outages.org
> https://puck.nether.net/mailman/listinfo/outages
> ___
> Outages mailing list
> Outages@outages.org
> https://puck.nether.net/mailman/listinfo/outages
>
>
> ___
> Outages mailing list
> Outages@outages.org
> https://puck.nether.net/mailman/listinfo/outages
>
___
Outages mailing list
Outages@outages.org
https://puck.nether.net/mailman/listinfo/outages

Re: [outages] VoIP Innovations timeouts/outage?

[Sean Harlow via Outages]

My systems are mostly in the NYC area but on three different hosts.

VI has responded with a claim that their firewalls somehow "forgot" our
endpoint IP addresses and were intentionally not talking with us as a
result.  I'll be interested to see what their full explanation is, because
we determined at least three of our systems on two of the three hosts were
affected, but others directly IP-adjacent were not.  It seems like they
somehow dropped random IPs from their whitelist, which seems like it would
be very unlikely to only end up affecting a single customer.

On Wed, May 4, 2016 at 7:13 PM Sean Hayes via Outages <outages@outages.org>
wrote:

> Appears to be reachable to Miami, FL and the Florida Keys via VI.
>
> On May 4, 2016 6:58 PM, "Sean Harlow via Outages" <outages@outages.org>
> wrote:
>
> >
>
> > I'm seeing no SIP responses on most of my calls attempting to go out
> VoIP Innovations and while I'm not 100% sure yet (discovered this while not
> in a great place to test) it does not look like I'm getting incoming calls
> from them either.
> >
> > I'm being told that traceroutes to them are looping what looks like one
> hop upstream of their systems, but I haven't confirmed that myself.
> >
> > Anyone else seeing similar?
> >
>
> > ___
> > Outages mailing list
> > Outages@outages.org <Outages@outages.org>
> > https://puck.nether.net/mailman/listinfo/outages
> <https://puck.nether.net/mailman/listinfo/outages>
> >
> ___
> Outages mailing list
> Outages@outages.org
> https://puck.nether.net/mailman/listinfo/outages
>
___
Outages mailing list
Outages@outages.org
https://puck.nether.net/mailman/listinfo/outages

[outages] VoIP Innovations timeouts/outage?

[Sean Harlow via Outages]

I'm seeing no SIP responses on most of my calls attempting to go out VoIP
Innovations and while I'm not 100% sure yet (discovered this while not in a
great place to test) it does not look like I'm getting incoming calls from
them either.

I'm being told that traceroutes to them are looping what looks like one hop
upstream of their systems, but I haven't confirmed that myself.

Anyone else seeing similar?
___
Outages mailing list
Outages@outages.org
https://puck.nether.net/mailman/listinfo/outages