Re: [dns-operations] Google DNS hiccups (Toronto, Canada?)
On Jan 9, 2021, at 04:38, Phil Regnauld wrote: > > Experienced this in Denmark on Wednesday morning (CEST), for several > hours, from two different locations, each talking to a different 8.8.8.8 > cluster (which ones ? id.hostname support would be great...), where > each saw roughly 50% of queries we sent to them timing out. > > Whatever deals with ICMP at that addres responded the whole time, so it > wasn't routing related. Not sure it could be the same issue you saw… Per the other reply I got, I contacted the Google NOC and they said that a bunch of folks at TorIX are experiencing problems this past week: https://en.wikipedia.org/wiki/Toronto_Internet_Exchange So it may be worth talking to the NOC so see if the two are related. They may ask for the IPs of the DNS serves that are doing the queries and the ASNs. When it was occurring we were in a red zone: https://downdetector.ca/status/google/map/ https://downdetector.dk/status/google/map/ Regards, David ___ dns-operations mailing list dns-operations@lists.dns-oarc.net https://lists.dns-oarc.net/mailman/listinfo/dns-operations
Re: [dns-operations] Google DNS hiccups (Toronto, Canada?)
David Magda (dmagda+dns) writes: > Hello, > > Is anyone experiencing timeouts and hangs with Google DNS? Experienced this in Denmark on Wednesday morning (CEST), for several hours, from two different locations, each talking to a different 8.8.8.8 cluster (which ones ? id.hostname support would be great...), where each saw roughly 50% of queries we sent to them timing out. Whatever deals with ICMP at that addres responded the whole time, so it wasn't routing related. Not sure it could be the same issue you saw... Cheers, Phil ___ dns-operations mailing list dns-operations@lists.dns-oarc.net https://lists.dns-oarc.net/mailman/listinfo/dns-operations
Re: [dns-operations] Google DNS hiccups (Toronto, Canada?)
On Fri, Jan 08, 2021 at 10:43:30AM -0500, David Magda wrote a message of 19 lines which said: > Is anyone experiencing timeouts and hangs with Google DNS? It is discussed on the outages mailing list. I quote a Google employee: Google is aware this has recurred over the last 3 days and we are digging into it. If you happen to have crisper start-stop times than ~09:20-09:50 EST for any of the last three days, that might well help us narrow it down. Thanks to those who have come via n...@google.com (our master ticket: b/176930179). Phil Sykes (day job: Google Networking SRE) ___ dns-operations mailing list dns-operations@lists.dns-oarc.net https://lists.dns-oarc.net/mailman/listinfo/dns-operations
[dns-operations] Google DNS hiccups (Toronto, Canada?)
Hello, Is anyone experiencing timeouts and hangs with Google DNS? > I see it wasn't just us who had problems resolving things that had their DNS > hosted by Google this morning (and yesterday morning); DNS failures for > http://gmail.com, http://google.ca, gmail-hosted domains, etc. Google's > 8.8.8.8 DNS server resolved them fine tho. > > I expect Google to not ever say anything about this, and maybe do it again > tomorrow morning around 9am+. Maybe Google is just seeing an early-morning > wave of DNS queries from our area of Canada and deciding to load-limit it. https://twitter.com/thatcks/status/1346898916428689408 This has occurred especially since Monday (1/4), and seems to occur 09:00 (14:00 UTC) to 10:00 ET. This is occurring in the Toronto area, but I’ve seen reports of something similar in the Prairies. Thanks for any info. Regards, David ___ dns-operations mailing list dns-operations@lists.dns-oarc.net https://lists.dns-oarc.net/mailman/listinfo/dns-operations
