Re: all major US carriers received text messages overnight that appear to have been sent around Valentine's Day 2019

[Jim Shankland]

On 11/8/19 10:34 AM, Kain, Becki (.) wrote:


Esp on Valentine’s day.  Of all the days that clear communication is 
important.  I’d be very interested in their reasoning for why these 
messages were not sent and held.



Roses are red,
Violets are blue,
Hope we're still together
When this reaches you.

(Sorry, it's Friday afternoon. I'll show myself out.)

Jim


**

Re: all major US carriers received text messages overnight that appear to have been sent around Valentine's Day 2019

[Carsten Bormann]

On Nov 8, 2019, at 20:38, Chris Kimball  wrote:
> 
> Oct 24, 2019

I’ve seen the date.

But have you seen the content?

> The Cross-Carrier Messaging Initiative will help drive the next generation of 
> messaging for consumers and businesses.

Hello?

> Looks to be within the last month!

Of 2006?

Grüße, Carsten

AWS GeoDNS and Routing...

[John Von Essen]

If anyone from AWS Networking Engineering is here, it would be great if you 
could chime in.

I work for a very large search engine, hosted in AWS. Right around Oct 31st/Nov 
1st, we noticed a significant change/re-routing of traffic that normally goes 
to Virginia to either California or Europe. All of our stats and pixel data 
indicate that approx 6-7% of our us-east-1 inbound traffic (we use Route53, Geo 
DNS, performance based routing, so lowest latency) was migrated to us-west-1 
(Cali) and eu-west-1 (Ireland).

If we used pure Geo-based routing, I could make the argument that there was 
some major Geo IP database update, but we performance based routing based in 
lowest latency. I realize that still depends on some data sets, and maybe those 
data sets got updated, or maybe the traffic was specifically re-routed due to 
some other kind of transit issue?

This isn’t critical, but its a head scratcher…

Thanks
John Von Essen

Re: all major US carriers received text messages overnight that appear to have been sent around Valentine's Day 2019

[Valdis Klētnieks]

On Fri, 08 Nov 2019 11:23:17 -0800, Jared Geiger said:

> What likely happened is that messages were queued on host to go out, SMPP
> binds go down, queue fills up, host crashes. Then someone realizes the host
> is down and brings it back up and the queue empties when the load is low.

What I've seen happen more often than that:

Server goes partly belly-up, queue fills up.  Backup process runs, backing up 
the
queue. (Optionally here: Reboot the server and lose the queue).  Much later, the
server hits another issue that requires recovering from backups - and they 
restore
a truly ancient copy.

I recently got a replay of a bunch of email messages from 2002.  I admit not at 
all
understanding what procedure failures (multiple) resulted in reloading a mail 
spool
from 2002.


pgpksv4F8soAg.pgp
Description: PGP signature

Re: all major US carriers received text messages overnight that appear to have been sent around Valentine's Day 2019

[Sean Donelan]

On Fri, 8 Nov 2019, Jared Mauch wrote:
I run mailing lists.  I’ve had times where I find something stuck in 
the system and instead of just deleting it, I actually try to make sure 
it goes out based on the original intent.  This has resulted in me 
sending out e-mails a year or two later at times.


Ok, you run mailing lists mostly on an amatuer (personal, unpaid) basis.

Every commercial organization delivering customer records should have a 
record retention/archive schedule.  Holding on to customer data longer 
than necessary for business purposes is just increasing your liability 
when something goes wrong.  And it always goes wrong.


Many tech startup companies never think about record retention schedules, 
or their privacy policy says 'indefinitely', which means the lawyer wrote

something down in the policy but no one really thought about it.

Western Union learned that lesson with telegrams a hundred years ago.
Tech firms keep re-learning old lessons, the hard way.

Re: all major US carriers received text messages overnight that appear to have been sent around Valentine's Day 2019

[Ben Cannon]

That’d be an incredibly obtuse, excessive, and horrible order.   And it’d be 
the very first time that’s ever happened...


-Ben Cannon
CEO 6x7 Networks & 6x7 Telecom, LLC 
b...@6by7.net 




> On Nov 8, 2019, at 10:50 AM, David Hubbard  
> wrote:
> 
> Playing devil’s advocate, perhaps they were under emergency court order to 
> not deliver texts for a certain duration, market, who knows what, and that 
> order just ended, but some type of non-disclosure / secrecy directive 
> continues to exist… may have just had to come up with something to say 
> because their other agreements would not have permitted discarding the texts… 
> 
>  
> David
>  
> From: NANOG  on behalf 
> of Mark Stevens 
> Date: Friday, November 8, 2019 at 1:45 PM
> To: "nanog@nanog.org" 
> Subject: Re: all major US carriers received text messages overnight that 
> appear to have been sent around Valentine's Day 2019
>  
> Reading Syniverse's cause of trouble (lame excuse) tells me their data 
> handling processes are poor and seemingly shady since I do not buy reason for 
> the trouble.
> 
> On 11/8/2019 1:34 PM, Kain, Becki (.) wrote:
>> Esp on Valentine’s day.  Of all the days that clear communication is 
>> important.  I’d be very interested in their reasoning for why these messages 
>> were not sent and held.
>>  
>> From: NANOG   On 
>> Behalf Of Oliver O'Boyle
>> Sent: Friday, November 08, 2019 1:31 PM
>> To: Matt Hoppes  
>> 
>> Cc: North American Network Operators' Group  
>> 
>> Subject: Re: all major US carriers received text messages overnight that 
>> appear to have been sent around Valentine's Day 2019
>>  
>> We apologize for finally getting around to our job and doing what we were 
>> paid to do...
>>  
>> On Fri, Nov 8, 2019 at 1:27 PM Matt Hoppes 
>> > > wrote:
>>> “During an internal maintenance cycle last night, 168,149 previously 
>>> undelivered text messages were inadvertently sent to multiple mobile 
>>> operators’ subscribers," Syniverse said in a statement. 
>>>  
>>>  
>>> how do you inadvertently send messages that were supposed to be sent but 
>>> worked and sent? Isn’t that the desired outcome?
>>> 
>>> On Nov 8, 2019, at 12:54 PM, Brandon Svec >> > wrote:
>>> 
 From: 
 https://www.usatoday.com/story/tech/2019/11/08/thousands-people-just-got-text-messages-sent-valentines-day/2527660001/
  
 
  
 It seems there is a company that has everyone's text messages..
  
 "Some mobile carriers rely on a third-party text platform called Syniverse 
 to relay messages. The vendor said in a statement that its IT staff 
 unknowingly caused the texts to be delivered this week."
 -Brandon
 
  
  
  
  
 On Fri, Nov 8, 2019 at 9:47 AM Brian J. Murrell >>> > wrote:
> On Thu, 2019-11-07 at 22:42 +, Chris Kimball via NANOG wrote:
> > Does anyone have any more information on this?
> 
> Yeah, like who (in the private sector -- we all knew the NSA already
> are doing this) has access to and is archiving *everyone*s text
> messages?  And why?
> 
> Cheers,
> b.
> 
>> 
>> 
>>  
>> -- 
>> :o@>

Re: all major US carriers received text messages overnight that appear to have been sent around Valentine's Day 2019

[Trevor Manternach]

I believe Syniverse only comes into play when you text someone on a
different carrier than your own. Syniverse is basically the middle-man for
that message delivery, and a server of theirs just spooled ~150k messages
until someone rebooted/fixed that server.

It sounds like these messages were never originally delivered to begin
with, so "re-sent" is not exactly accurate.

--
Trevor Manternach


On Fri, Nov 8, 2019 at 10:56 AM Brandon Svec 
wrote:

> From:
> https://www.usatoday.com/story/tech/2019/11/08/thousands-people-just-got-text-messages-sent-valentines-day/2527660001/
>
> It seems there is a company that has everyone's text messages..
>
> "Some mobile carriers rely on a third-party text platform called
> Syniverse to relay messages. The vendor said in a statement that its IT
> staff unknowingly caused the texts to be delivered this week."
> -Brandon
>
>
>
>
>
> On Fri, Nov 8, 2019 at 9:47 AM Brian J. Murrell 
> wrote:
>
>> On Thu, 2019-11-07 at 22:42 +, Chris Kimball via NANOG wrote:
>> > Does anyone have any more information on this?
>>
>> Yeah, like who (in the private sector -- we all knew the NSA already
>> are doing this) has access to and is archiving *everyone*s text
>> messages?  And why?
>>
>> Cheers,
>> b.
>>
>>

Spoofer Report for NANOG for Oct 2019

[CAIDA Spoofer Project]

In response to feedback from operational security communities,
CAIDA's source address validation measurement project
(https://spoofer.caida.org) is automatically generating monthly
reports of ASes originating prefixes in BGP for systems from which
we received packets with a spoofed source address.
We are publishing these reports to network and security operations
lists in order to ensure this information reaches operational
contacts in these ASes.

This report summarises tests conducted within usa, can.

Inferred improvements during Oct 2019:
   ASN Name   Fixed-By
 18451 LESNET 2019-10-10
 16787 CHARTER-16787-DC   2019-10-14
 19230 NANOG  2019-10-28
  8047 GCI2019-10-29
  2037 CSUFRESNO  2019-10-30
  3356 LEVEL3 2019-10-30
  7018 ATT-INTERNET4  2019-10-31

Further information for the inferred remediation is available at:
https://spoofer.caida.org/remedy.php

Source Address Validation issues inferred during Oct 2019:
   ASN Name   First-Spoofed Last-Spoofed
 40065 CNSERVERS 2016-05-01   2019-10-09
   209 CENTURYLINK-US-LEGACY-QWEST   2016-08-16   2019-10-30
  6128 CABLE-NET-1   2016-09-03   2019-10-29
 27364 ACS-INTERNET  2016-09-27   2019-10-03
 20412 CLARITY-TELECOM   2016-09-30   2019-10-25
  6181 FUSE-NET  2016-10-10   2019-10-28
 25787 ROWE-NETWORKS 2016-10-21   2019-10-27
 11427 TWC-11427-TEXAS   2016-10-21   2019-10-27
   174 COGENT-1742016-10-21   2019-10-28
 11537 ABILENE   2016-10-24   2019-10-24
 32440 LONI  2016-11-03   2019-10-28
 12083 WOW-INTERNET  2016-11-09   2019-10-29
 22561 CENTURYLINK-LEGACY-LIGHTCORE  2016-11-27   2019-10-08
   701 UUNET 2017-06-14   2019-10-06
 63296 AMARILLO-WIRELESS 2017-09-01   2019-10-28
   546 PARSONS-PGS-1 2017-11-20   2019-10-24
 1 AKAMAI2018-02-14   2019-10-18
  4201 ORST  2018-04-19   2019-10-09
 11827 WSU   2018-05-07   2019-10-25
   225 VIRGINIA  2018-06-18   2019-10-31
 33452 RW2018-09-19   2019-10-30
 20448 VPNTRANET-LLC 2018-09-20   2019-10-28
 14031 SCXY  2018-10-18   2019-10-25
 63275 RADIOWIRE 2019-02-07   2019-10-14
 15290 ALLST-15290   2019-04-09   2019-10-02
  8047 GCI   2019-04-11   2019-10-29
 10745 ARIN-ASH-CHA  2019-04-29   2019-10-28
 54600 PEGTECHINC2019-08-28   2019-10-11
262248 Metro MPLS2019-10-09   2019-10-09
 46375 AS-SONICTELECOM   2019-10-21   2019-10-21
 30136 AD12  2019-10-24   2019-10-24
396073 MAJESTIC-HOSTING-01   2019-10-30   2019-10-30
 46300 HSC-WAP   2019-10-30   2019-10-30

Further information for these tests where we received spoofed
packets is available at:
https://spoofer.caida.org/recent_tests.php?country_include=usa,can_block=1

Please send any feedback or suggestions to spoofer-i...@caida.org

Re: all major US carriers received text messages overnight that appear to have been sent around Valentine's Day 2019

[Clayton Zekelman]

Under emergency court order not to deliver 
texts?  Not delivering tens of thousands of 
messages would appear to be abuse of the legal process if it were true.


Scary

At 01:50 PM 08/11/2019, David Hubbard wrote:
Playing devil’s advocate, perhaps they were 
under emergency court order to not deliver texts 
for a certain duration, market, who knows what, 
and that order just ended, but some type of 
non-disclosure / secrecy directive continues to 
exist… may have just had to come up with 
something to say because their other agreements 
would not have permitted discarding the texts…


David

From: NANOG 
 
on behalf of Mark Stevens 

Date: Friday, November 8, 2019 at 1:45 PM
To: "nanog@nanog.org" 
Subject: Re: all major US carriers received text 
messages overnight that appear to have been sent around Valentine's Day 2019


Reading Syniverse's cause of trouble (lame 
excuse) tells me their data handling processes 
are poor and seemingly shady since I do not buy reason for the trouble.


On 11/8/2019 1:34 PM, Kain, Becki (.) wrote:
Esp on Valentine’s day.  Of all the days that 
clear communication is important.  I’d be very 
interested in their reasoning for why these messages were not sent and held.


From: NANOG 
 
On Behalf Of Oliver O'Boyle

Sent: Friday, November 08, 2019 1:31 PM
To: Matt Hoppes 

Cc: North American Network Operators' Group 

Subject: Re: all major US carriers received text 
messages overnight that appear to have been sent around Valentine's Day 2019


We apologize for finally getting around to our 
job and doing what we were paid to do...


On Fri, Nov 8, 2019 at 1:27 PM Matt Hoppes 
<mattli...@rivervalleyinternet.net> 
wrote:
“During an internal maintenance cycle last 
night, 168,149 previously undelivered text 
messages were inadvertently sent to multiple 
mobile operators’ subscribers," Syniverse said in a statement.



how do you inadvertently send messages that were 
supposed to be sent but worked and sent? Isn’t that the desired outcome?


On Nov 8, 2019, at 12:54 PM, Brandon Svec 
<bs...@teamonesolutions.com> wrote:
From: 
https://www.usatoday.com/story/tech/2019/11/08/thousands-people-just-got-text-messages-sent-valentines-day/2527660001/


It seems there is a company that has everyone's text messages..

"Some mobile carriers rely on a third-party text 
platform called Syniverse to relay messages. The 
vendor said in a statement that its IT staff 
unknowingly caused the texts to be delivered this week."

-Brandon




On Fri, Nov 8, 2019 at 9:47 AM Brian J. Murrell 
<br...@interlinx.bc.ca> wrote:

On Thu, 2019-11-07 at 22:42 +, Chris Kimball via NANOG wrote:
> Does anyone have any more information on this?

Yeah, like who (in the private sector -- we all knew the NSA already
are doing this) has access to and is archiving *everyone*s text
messages?  And why?

Cheers,
b.



--
:o@>





--

Clayton Zekelman
Managed Network Systems Inc. (MNSi)
3363 Tecumseh Rd. E
Windsor, Ontario
N8W 1H4

tel. 519-985-8410
fax. 519-985-8409

RE: all major US carriers received text messages overnight that appear to have been sent around Valentine's Day 2019

[Chris Kimball via NANOG]

AT, Sprint, T-Mobile and Verizon Form Joint Venture to Transform Messaging 
Experience
Oct 24, 2019
The Cross-Carrier Messaging Initiative will help drive the next generation of 
messaging for consumers and businesses.

Looks to be within the last month!

-Original Message-
From: Carsten Bormann 
Sent: Friday, November 8, 2019 2:29 PM
To: Chris Kimball 
Cc: nanog@nanog.org
Subject: Re: all major US carriers received text messages overnight that appear 
to have been sent around Valentine's Day 2019

[EXTERNAL]

OK, I understand the part about text messages from February 2019 being sent on 
now, but…

> On Nov 7, 2019, at 23:42, Chris Kimball via NANOG  wrote:
>
> https://investors.sprint.com/news-and-events/press-releases/press-release-details/2019/ATT-Sprint-T-Mobile-and-Verizon-Form-Joint-Venture-to-Transform-Messaging-Experience/default.aspx

Are we sure this isn’t a press release from 2008?

Grüße, Carsten

- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - 
- - -

The information contained in this electronic message may be confidential, and 
the message is for the use of intended recipients only. If you are not the 
intended recipient, do not disseminate, copy, or disclose this communication or 
its contents. If you have received this communication in error, please 
immediately notify me by replying to the email or call MIS Alliance at 
617-500-1700 and permanently delete this communication.

Re: all major US carriers received text messages overnight that appear to have been sent around Valentine's Day 2019

[Carsten Bormann]

OK, I understand the part about text messages from February 2019 being sent on 
now, but…

> On Nov 7, 2019, at 23:42, Chris Kimball via NANOG  wrote:
> 
> https://investors.sprint.com/news-and-events/press-releases/press-release-details/2019/ATT-Sprint-T-Mobile-and-Verizon-Form-Joint-Venture-to-Transform-Messaging-Experience/default.aspx

Are we sure this isn’t a press release from 2008?

Grüße, Carsten

RE: all major US carriers received text messages overnight that appear to have been sent around Valentine's Day 2019

[Kain, Becki (.)]

If they just realized a server was down, from 2/14, just now, I’d say they have 
bigger support issues


From: NANOG  On Behalf Of Jared Geiger
Sent: Friday, November 08, 2019 2:23 PM
To: nanog@nanog.org
Subject: Re: all major US carriers received text messages overnight that appear 
to have been sent around Valentine's Day 2019

What likely happened is that messages were queued on host to go out, SMPP binds 
go down, queue fills up, host crashes. Then someone realizes the host is down 
and brings it back up and the queue empties when the load is low. Since it 
included many carriers, might have been a message routing server in the middle 
of their platform.

On Fri, Nov 8, 2019 at 10:52 AM David Hubbard 
mailto:dhubb...@dino.hostasaurus.com>> wrote:
Playing devil’s advocate, perhaps they were under emergency court order to not 
deliver texts for a certain duration, market, who knows what, and that order 
just ended, but some type of non-disclosure / secrecy directive continues to 
exist… may have just had to come up with something to say because their other 
agreements would not have permitted discarding the texts… 

David

From: NANOG 
mailto:dino.hostasaurus@nanog.org>>
 on behalf of Mark Stevens mailto:mana...@monmouth.com>>
Date: Friday, November 8, 2019 at 1:45 PM
To: "nanog@nanog.org" 
mailto:nanog@nanog.org>>
Subject: Re: all major US carriers received text messages overnight that appear 
to have been sent around Valentine's Day 2019

Reading Syniverse's cause of trouble (lame excuse) tells me their data handling 
processes are poor and seemingly shady since I do not buy reason for the 
trouble.

On 11/8/2019 1:34 PM, Kain, Becki (.) wrote:
Esp on Valentine’s day.  Of all the days that clear communication is important. 
 I’d be very interested in their reasoning for why these messages were not sent 
and held.

From: NANOG  On Behalf 
Of Oliver O'Boyle
Sent: Friday, November 08, 2019 1:31 PM
To: Matt Hoppes 

Cc: North American Network Operators' Group 

Subject: Re: all major US carriers received text messages overnight that appear 
to have been sent around Valentine's Day 2019

We apologize for finally getting around to our job and doing what we were paid 
to do...

On Fri, Nov 8, 2019 at 1:27 PM Matt Hoppes 
mailto:mattli...@rivervalleyinternet.net>> 
wrote:
“During an internal maintenance cycle last night, 168,149 previously 
undelivered text messages were inadvertently sent to multiple mobile operators’ 
subscribers," Syniverse said in a statement.


how do you inadvertently send messages that were supposed to be sent but worked 
and sent? Isn’t that the desired outcome?

On Nov 8, 2019, at 12:54 PM, Brandon Svec 
mailto:bs...@teamonesolutions.com>> wrote:
From: 
https://www.usatoday.com/story/tech/2019/11/08/thousands-people-just-got-text-messages-sent-valentines-day/2527660001/

It seems there is a company that has everyone's text messages..

"Some mobile carriers rely on a third-party text platform called Syniverse to 
relay messages. The vendor said in a statement that its IT staff unknowingly 
caused the texts to be delivered this week."
-Brandon





On Fri, Nov 8, 2019 at 9:47 AM Brian J. Murrell 
mailto:br...@interlinx.bc.ca>> wrote:
On Thu, 2019-11-07 at 22:42 +, Chris Kimball via NANOG wrote:
> Does anyone have any more information on this?

Yeah, like who (in the private sector -- we all knew the NSA already
are doing this) has access to and is archiving *everyone*s text
messages?  And why?

Cheers,
b.


--
:o@>

Re: all major US carriers received text messages overnight that appear to have been sent around Valentine's Day 2019

[Jared Geiger]

What likely happened is that messages were queued on host to go out, SMPP
binds go down, queue fills up, host crashes. Then someone realizes the host
is down and brings it back up and the queue empties when the load is low.
Since it included many carriers, might have been a message routing server
in the middle of their platform.

On Fri, Nov 8, 2019 at 10:52 AM David Hubbard 
wrote:

> Playing devil’s advocate, perhaps they were under emergency court order to
> not deliver texts for a certain duration, market, who knows what, and that
> order just ended, but some type of non-disclosure / secrecy directive
> continues to exist… may have just had to come up with something to say
> because their other agreements would not have permitted discarding the
> texts… 
>
>
>
> David
>
>
>
> *From: *NANOG  on
> behalf of Mark Stevens 
> *Date: *Friday, November 8, 2019 at 1:45 PM
> *To: *"nanog@nanog.org" 
> *Subject: *Re: all major US carriers received text messages overnight
> that appear to have been sent around Valentine's Day 2019
>
>
>
> Reading Syniverse's cause of trouble (lame excuse) tells me their data
> handling processes are poor and seemingly shady since I do not buy reason
> for the trouble.
>
> On 11/8/2019 1:34 PM, Kain, Becki (.) wrote:
>
> Esp on Valentine’s day.  Of all the days that clear communication is
> important.  I’d be very interested in their reasoning for why these
> messages were not sent and held.
>
>
>
> *From:* NANOG   *On
> Behalf Of *Oliver O'Boyle
> *Sent:* Friday, November 08, 2019 1:31 PM
> *To:* Matt Hoppes 
> 
> *Cc:* North American Network Operators' Group 
> 
> *Subject:* Re: all major US carriers received text messages overnight
> that appear to have been sent around Valentine's Day 2019
>
>
>
> We apologize for finally getting around to our job and doing what we were
> paid to do...
>
>
>
> On Fri, Nov 8, 2019 at 1:27 PM Matt Hoppes <
> mattli...@rivervalleyinternet.net> wrote:
>
> “During an internal maintenance cycle last night, 168,149 previously
> undelivered text messages were inadvertently sent to multiple mobile
> operators’ subscribers," Syniverse said in a statement.
>
>
>
>
>
> how do you inadvertently send messages that were supposed to be sent but
> worked and sent? Isn’t that the desired outcome?
>
>
> On Nov 8, 2019, at 12:54 PM, Brandon Svec 
> wrote:
>
> From:
> https://www.usatoday.com/story/tech/2019/11/08/thousands-people-just-got-text-messages-sent-valentines-day/2527660001/
>
>
>
> It seems there is a company that has everyone's text messages..
>
>
>
> "Some mobile carriers rely on a third-party text platform called
> Syniverse to relay messages. The vendor said in a statement that its IT
> staff unknowingly caused the texts to be delivered this week."
>
> -Brandon
>
>
>
>
>
>
>
>
>
> On Fri, Nov 8, 2019 at 9:47 AM Brian J. Murrell 
> wrote:
>
> On Thu, 2019-11-07 at 22:42 +, Chris Kimball via NANOG wrote:
> > Does anyone have any more information on this?
>
> Yeah, like who (in the private sector -- we all knew the NSA already
> are doing this) has access to and is archiving *everyone*s text
> messages?  And why?
>
> Cheers,
> b.
>
>
>
>
> --
>
> :o@>
>
>
>
>
>
>

Re: all major US carriers received text messages overnight that appear to have been sent around Valentine's Day 2019

[Blake Hudson]

Jared Mauch wrote on 11/8/2019 12:33 PM:



On Nov 8, 2019, at 1:26 PM, Matt Hoppes  
wrote:

“During an internal maintenance cycle last night, 168,149 previously undelivered 
text messages were inadvertently sent to multiple mobile operators’ 
subscribers," Syniverse said in a statement.


how do you inadvertently send messages that were supposed to be sent but worked 
and sent? Isn’t that the desired outcome?

I run mailing lists.  I’ve had times where I find something stuck in the system 
and instead of just deleting it, I actually try to make sure it goes out based 
on the original intent.  This has resulted in me sending out e-mails a year or 
two later at times.

- Jared



Timing can be critical, which is why SMTP servers often expire and 
return queued messages after 12-72hrs (maybe a week at most). Any 
messages that can't be returned are eventually discarded and a message 
is sent to the mail server's administrator. Sounds like none of that 
actually happens within Syniverse's TXT/SMS delivery system. Someone is 
asleep at the wheel if 100-200k messages are stuck in queue for months.

Re: all major US carriers received text messages overnight that appear to have been sent around Valentine's Day 2019

[David Hubbard]

Playing devil’s advocate, perhaps they were under emergency court order to not 
deliver texts for a certain duration, market, who knows what, and that order 
just ended, but some type of non-disclosure / secrecy directive continues to 
exist… may have just had to come up with something to say because their other 
agreements would not have permitted discarding the texts… 

David

From: NANOG  on behalf 
of Mark Stevens 
Date: Friday, November 8, 2019 at 1:45 PM
To: "nanog@nanog.org" 
Subject: Re: all major US carriers received text messages overnight that appear 
to have been sent around Valentine's Day 2019

Reading Syniverse's cause of trouble (lame excuse) tells me their data handling 
processes are poor and seemingly shady since I do not buy reason for the 
trouble.

On 11/8/2019 1:34 PM, Kain, Becki (.) wrote:
Esp on Valentine’s day.  Of all the days that clear communication is important. 
 I’d be very interested in their reasoning for why these messages were not sent 
and held.

From: NANOG  On Behalf 
Of Oliver O'Boyle
Sent: Friday, November 08, 2019 1:31 PM
To: Matt Hoppes 

Cc: North American Network Operators' Group 

Subject: Re: all major US carriers received text messages overnight that appear 
to have been sent around Valentine's Day 2019

We apologize for finally getting around to our job and doing what we were paid 
to do...

On Fri, Nov 8, 2019 at 1:27 PM Matt Hoppes 
mailto:mattli...@rivervalleyinternet.net>> 
wrote:
“During an internal maintenance cycle last night, 168,149 previously 
undelivered text messages were inadvertently sent to multiple mobile operators’ 
subscribers," Syniverse said in a statement.


how do you inadvertently send messages that were supposed to be sent but worked 
and sent? Isn’t that the desired outcome?

On Nov 8, 2019, at 12:54 PM, Brandon Svec 
mailto:bs...@teamonesolutions.com>> wrote:
From: 
https://www.usatoday.com/story/tech/2019/11/08/thousands-people-just-got-text-messages-sent-valentines-day/2527660001/

It seems there is a company that has everyone's text messages..

"Some mobile carriers rely on a third-party text platform called Syniverse to 
relay messages. The vendor said in a statement that its IT staff unknowingly 
caused the texts to be delivered this week."
-Brandon




On Fri, Nov 8, 2019 at 9:47 AM Brian J. Murrell 
mailto:br...@interlinx.bc.ca>> wrote:
On Thu, 2019-11-07 at 22:42 +, Chris Kimball via NANOG wrote:
> Does anyone have any more information on this?

Yeah, like who (in the private sector -- we all knew the NSA already
are doing this) has access to and is archiving *everyone*s text
messages?  And why?

Cheers,
b.


--
:o@>

Re: all major US carriers received text messages overnight that appear to have been sent around Valentine's Day 2019

[Mark Stevens]

Reading Syniverse's cause of trouble (lame excuse) tells me their data 
handling processes are poor and seemingly shady since I do not buy 
reason for the trouble.


On 11/8/2019 1:34 PM, Kain, Becki (.) wrote:


Esp on Valentine’s day.  Of all the days that clear communication is 
important.  I’d be very interested in their reasoning for why these 
messages were not sent and held.


*From:* NANOG  *On Behalf Of *Oliver O'Boyle
*Sent:* Friday, November 08, 2019 1:31 PM
*To:* Matt Hoppes 
*Cc:* North American Network Operators' Group 
*Subject:* Re: all major US carriers received text messages overnight 
that appear to have been sent around Valentine's Day 2019


We apologize for finally getting around to our job and doing what we 
were paid to do...


On Fri, Nov 8, 2019 at 1:27 PM Matt Hoppes 
> wrote:


“During an internal maintenance cycle last night, 168,149
previously undelivered text messages were inadvertently sent to
multiple mobile operators’ subscribers," Syniverse said in a
statement.

how do you inadvertently send messages that were supposed to be
sent but worked and sent? Isn’t that the desired outcome?


On Nov 8, 2019, at 12:54 PM, Brandon Svec
mailto:bs...@teamonesolutions.com>>
wrote:

From:

https://www.usatoday.com/story/tech/2019/11/08/thousands-people-just-got-text-messages-sent-valentines-day/2527660001/

It seems there is a company that has everyone's text messages..

"Some mobile carriers rely on a third-party text platform
called Syniverse to relay messages. The vendor said in a
statement that its IT staff unknowingly caused the texts to be
delivered this week."

-Brandon

On Fri, Nov 8, 2019 at 9:47 AM Brian J. Murrell
mailto:br...@interlinx.bc.ca>> wrote:

On Thu, 2019-11-07 at 22:42 +, Chris Kimball via NANOG
wrote:
> Does anyone have any more information on this?

Yeah, like who (in the private sector -- we all knew the
NSA already
are doing this) has access to and is archiving *everyone*s
text
messages?  And why?

Cheers,
b.


--

:o@>

RE: all major US carriers received text messages overnight that appear to have been sent around Valentine's Day 2019

[Kain, Becki (.)]

Esp on Valentine’s day.  Of all the days that clear communication is important. 
 I’d be very interested in their reasoning for why these messages were not sent 
and held.

From: NANOG  On Behalf Of Oliver O'Boyle
Sent: Friday, November 08, 2019 1:31 PM
To: Matt Hoppes 
Cc: North American Network Operators' Group 
Subject: Re: all major US carriers received text messages overnight that appear 
to have been sent around Valentine's Day 2019

We apologize for finally getting around to our job and doing what we were paid 
to do...

On Fri, Nov 8, 2019 at 1:27 PM Matt Hoppes 
mailto:mattli...@rivervalleyinternet.net>> 
wrote:
“During an internal maintenance cycle last night, 168,149 previously 
undelivered text messages were inadvertently sent to multiple mobile operators’ 
subscribers," Syniverse said in a statement.


how do you inadvertently send messages that were supposed to be sent but worked 
and sent? Isn’t that the desired outcome?

On Nov 8, 2019, at 12:54 PM, Brandon Svec 
mailto:bs...@teamonesolutions.com>> wrote:
From: 
https://www.usatoday.com/story/tech/2019/11/08/thousands-people-just-got-text-messages-sent-valentines-day/2527660001/

It seems there is a company that has everyone's text messages..

"Some mobile carriers rely on a third-party text platform called Syniverse to 
relay messages. The vendor said in a statement that its IT staff unknowingly 
caused the texts to be delivered this week."
-Brandon





On Fri, Nov 8, 2019 at 9:47 AM Brian J. Murrell 
mailto:br...@interlinx.bc.ca>> wrote:
On Thu, 2019-11-07 at 22:42 +, Chris Kimball via NANOG wrote:
> Does anyone have any more information on this?

Yeah, like who (in the private sector -- we all knew the NSA already
are doing this) has access to and is archiving *everyone*s text
messages?  And why?

Cheers,
b.


--
:o@>

Re: all major US carriers received text messages overnight that appear to have been sent around Valentine's Day 2019

[Jared Mauch]

> On Nov 8, 2019, at 1:26 PM, Matt Hoppes  
> wrote:
> 
> “During an internal maintenance cycle last night, 168,149 previously 
> undelivered text messages were inadvertently sent to multiple mobile 
> operators’ subscribers," Syniverse said in a statement. 
> 
> 
> how do you inadvertently send messages that were supposed to be sent but 
> worked and sent? Isn’t that the desired outcome?

I run mailing lists.  I’ve had times where I find something stuck in the system 
and instead of just deleting it, I actually try to make sure it goes out based 
on the original intent.  This has resulted in me sending out e-mails a year or 
two later at times.

- Jared

Re: all major US carriers received text messages overnight that appear to have been sent around Valentine's Day 2019

[Oliver O'Boyle]

We apologize for finally getting around to our job and doing what we were
paid to do...

On Fri, Nov 8, 2019 at 1:27 PM Matt Hoppes <
mattli...@rivervalleyinternet.net> wrote:

> “During an internal maintenance cycle last night, 168,149 previously
> undelivered text messages were inadvertently sent to multiple mobile
> operators’ subscribers," Syniverse said in a statement.
>
>
> how do you inadvertently send messages that were supposed to be sent but
> worked and sent? Isn’t that the desired outcome?
>
> On Nov 8, 2019, at 12:54 PM, Brandon Svec 
> wrote:
>
> From:
> https://www.usatoday.com/story/tech/2019/11/08/thousands-people-just-got-text-messages-sent-valentines-day/2527660001/
>
> It seems there is a company that has everyone's text messages..
>
> "Some mobile carriers rely on a third-party text platform called
> Syniverse to relay messages. The vendor said in a statement that its IT
> staff unknowingly caused the texts to be delivered this week."
> -Brandon
>
>
>
>
>
> On Fri, Nov 8, 2019 at 9:47 AM Brian J. Murrell 
> wrote:
>
>> On Thu, 2019-11-07 at 22:42 +, Chris Kimball via NANOG wrote:
>> > Does anyone have any more information on this?
>>
>> Yeah, like who (in the private sector -- we all knew the NSA already
>> are doing this) has access to and is archiving *everyone*s text
>> messages?  And why?
>>
>> Cheers,
>> b.
>>
>>

-- 
:o@>

Re: all major US carriers received text messages overnight that appear to have been sent around Valentine's Day 2019

[Matt Hoppes]

“During an internal maintenance cycle last night, 168,149 previously 
undelivered text messages were inadvertently sent to multiple mobile operators’ 
subscribers," Syniverse said in a statement. 


how do you inadvertently send messages that were supposed to be sent but worked 
and sent? Isn’t that the desired outcome?

> On Nov 8, 2019, at 12:54 PM, Brandon Svec  wrote:
> 
> From: 
> https://www.usatoday.com/story/tech/2019/11/08/thousands-people-just-got-text-messages-sent-valentines-day/2527660001/
> 
> It seems there is a company that has everyone's text messages..
> 
> "Some mobile carriers rely on a third-party text platform called Syniverse to 
> relay messages. The vendor said in a statement that its IT staff unknowingly 
> caused the texts to be delivered this week."
> -Brandon
> 
> 
> 
> 
> 
>> On Fri, Nov 8, 2019 at 9:47 AM Brian J. Murrell  
>> wrote:
>> On Thu, 2019-11-07 at 22:42 +, Chris Kimball via NANOG wrote:
>> > Does anyone have any more information on this?
>> 
>> Yeah, like who (in the private sector -- we all knew the NSA already
>> are doing this) has access to and is archiving *everyone*s text
>> messages?  And why?
>> 
>> Cheers,
>> b.
>> 

Weekly Routing Table Report

[Routing Analysis Role Account]

This is an automated weekly mailing describing the state of the Internet
Routing Table as seen from APNIC's router in Japan.

The posting is sent to APOPS, NANOG, AfNOG, SANOG, PacNOG, SAFNOG
TZNOG, MENOG, BJNOG, SDNOG, CMNOG, LACNOG and the RIPE Routing WG.

Daily listings are sent to bgp-st...@lists.apnic.net

For historical data, please see http://thyme.rand.apnic.net.

If you have any comments please contact Philip Smith .

Routing Table Report   04:00 +10GMT Sat 09 Nov, 2019

Report Website: http://thyme.rand.apnic.net
Detailed Analysis:  http://thyme.rand.apnic.net/current/

Analysis Summary


BGP routing table entries examined:  781783
Prefixes after maximum aggregation (per Origin AS):  297937
Deaggregation factor:  2.62
Unique aggregates announced (without unneeded subnets):  376869
Total ASes present in the Internet Routing Table: 66078
Prefixes per ASN: 11.83
Origin-only ASes present in the Internet Routing Table:   56797
Origin ASes announcing only one prefix:   24298
Transit ASes present in the Internet Routing Table:9281
Transit-only ASes present in the Internet Routing Table:268
Average AS path length visible in the Internet Routing Table:   4.4
Max AS path length visible:  35
Max AS path prepend of ASN ( 44555)  27
Prefixes from unregistered ASNs in the Routing Table:27
Number of instances of unregistered ASNs:27
Number of 32-bit ASNs allocated by the RIRs:  29439
Number of 32-bit ASNs visible in the Routing Table:   24053
Prefixes from 32-bit ASNs in the Routing Table:  109264
Number of bogon 32-bit ASNs visible in the Routing Table:11
Special use prefixes present in the Routing Table:0
Prefixes being announced from unallocated address space:360
Number of addresses announced to Internet:   2841827200
Equivalent to 169 /8s, 98 /16s and 215 /24s
Percentage of available address space announced:   76.8
Percentage of allocated address space announced:   76.8
Percentage of available address space allocated:  100.0
Percentage of address space in use by end-sites:   99.4
Total number of prefixes smaller than registry allocations:  260296

APNIC Region Analysis Summary
-

Prefixes being announced by APNIC Region ASes:   209880
Total APNIC prefixes after maximum aggregation:   60956
APNIC Deaggregation factor:3.44
Prefixes being announced from the APNIC address blocks:  204135
Unique aggregates announced from the APNIC address blocks:84988
APNIC Region origin ASes present in the Internet Routing Table:   10169
APNIC Prefixes per ASN:   20.07
APNIC Region origin ASes announcing only one prefix:   2827
APNIC Region transit ASes present in the Internet Routing Table:   1512
Average APNIC Region AS path length visible:4.6
Max APNIC Region AS path length visible: 25
Number of APNIC region 32-bit ASNs visible in the Routing Table:   5183
Number of APNIC addresses announced to Internet:  771228032
Equivalent to 45 /8s, 248 /16s and 1 /24s
APNIC AS Blocks4608-4864, 7467-7722, 9216-10239, 17408-18431
(pre-ERX allocations)  23552-24575, 37888-38911, 45056-46079, 55296-56319,
   58368-59391, 63488-64098, 64297-64395, 131072-141625
APNIC Address Blocks 1/8,  14/8,  27/8,  36/8,  39/8,  42/8,  43/8,
49/8,  58/8,  59/8,  60/8,  61/8, 101/8, 103/8,
   106/8, 110/8, 111/8, 112/8, 113/8, 114/8, 115/8,
   116/8, 117/8, 118/8, 119/8, 120/8, 121/8, 122/8,
   123/8, 124/8, 125/8, 126/8, 133/8, 150/8, 153/8,
   163/8, 171/8, 175/8, 180/8, 182/8, 183/8, 202/8,
   203/8, 210/8, 211/8, 218/8, 219/8, 220/8, 221/8,
   222/8, 223/8,

ARIN Region Analysis Summary


Prefixes being announced by ARIN Region ASes:230178
Total ARIN prefixes after maximum aggregation:   106890
ARIN Deaggregation factor: 2.15
Prefixes being announced from the ARIN address blocks:   227726
Unique aggregates announced from the ARIN address blocks:108693
ARIN Region origin ASes present in the Internet Routing Table:18642
ARIN Prefixes per ASN:12.22
ARIN 

Re: all major US carriers received text messages overnight that appear to have been sent around Valentine's Day 2019

[Brandon Svec]

From:
https://www.usatoday.com/story/tech/2019/11/08/thousands-people-just-got-text-messages-sent-valentines-day/2527660001/

It seems there is a company that has everyone's text messages..

"Some mobile carriers rely on a third-party text platform called Syniverse
to relay messages. The vendor said in a statement that its IT staff
unknowingly caused the texts to be delivered this week."
-Brandon





On Fri, Nov 8, 2019 at 9:47 AM Brian J. Murrell 
wrote:

> On Thu, 2019-11-07 at 22:42 +, Chris Kimball via NANOG wrote:
> > Does anyone have any more information on this?
>
> Yeah, like who (in the private sector -- we all knew the NSA already
> are doing this) has access to and is archiving *everyone*s text
> messages?  And why?
>
> Cheers,
> b.
>
>

Re: all major US carriers received text messages overnight that appear to have been sent around Valentine's Day 2019

[Brian J. Murrell]

On Thu, 2019-11-07 at 22:42 +, Chris Kimball via NANOG wrote:
> Does anyone have any more information on this?

Yeah, like who (in the private sector -- we all knew the NSA already
are doing this) has access to and is archiving *everyone*s text
messages?  And why?

Cheers,
b.



signature.asc
Description: This is a digitally signed message part

Re: virginia beach

[Ethan O'Toole]

What about diversity from Ashburn?


I believe Loudon County (the county that Ashburn VA is in) has reeled in 
future datacenter construction, and future datacenters will happen in 
nearby Manassas and othere cities.


I've heard that some of the major data center companies already have 
property in other areas West of Ashburn that are 2 hours or less 
travelling by land. Less natural disaster risk. Virginia Beach has 
hurricanes and is already pretty built out. Not sure how cheap the power 
is, but most companies there are more interested in feeding off the large 
Military presence.


There recently was a colo that was co-funded by the government down there 
that collapsed financially. It was targeted towards Bitcoin, of course.



 - Ethan O'Toole

Re: Any info on devices that are running eBGP on the Internet?

[Erik Sundberg]

Keep in mind that some members on the IX are using a configured mac address 
instead of the burn in MAC Address on the router's NIC Card.

We have done this in the past during for multiple reasons so we don't have to 
call the IX and wait on them to up date the filters.
-IX Port upgrading in bandwidth. I.E. 1G  -> 10G
-Router chassis or card upgrades
-Circuit grooms

This also allows us the flexibility to move the IX port to a difference device 
in the event of an outage, hardware failure, or other event.

-Erik

From: NANOG  on behalf of Eric Kuhnke 

Sent: Thursday, November 7, 2019 4:47 PM
To: Edward Dore ; nanog@nanog.org list 

Subject: Re: Any info on devices that are running eBGP on the Internet?

The OUI prefixes that are Intel, Dell, HP, Supermicro and other x86-64 hardware 
vendors are almost certainly people running BIRD, FRR or similar on commodity 
hardware. In which case the actual routing configuration could be almost 
anything, those just happen to be the PCI-Express NICs in some sort of server 
platform.



On Thu, Nov 7, 2019 at 11:59 AM Edward Dore 
mailto:edward.d...@freethought-internet.co.uk>>
 wrote:
I just grabbed the following from our routers connected to LINX LON1, LINX 
LON2, LINX Manchester and LONAP (so this data is very UK centric):

 557 Cisco Systems, Inc
 553 Juniper Networks
  51 Routerboard.com
  51 Brocade Communications Systems, Inc.
  49 Arista Networks
  40 Unknown
  38 Intel Corporate
  36 HUAWEI TECHNOLOGIES CO.,LTD
  31 Globalscale Technologies, Inc.
  20 Super Micro Computer, Inc.
  20 Alcatel-Lucent IPD
  15 Nokia
  14 Hewlett Packard
  10 VMware, Inc.
  10 Ubiquiti Networks Inc.
  10 Sunrich Technology Limited
  10 Extreme Networks, Inc.
   7 Dell Inc.
   5 IEEE Registration Authority
   4 Intel Corporation
   4 HotLava Systems, Inc.
   3 FireBrick Limited
   2 Raspberry Pi Foundation
   2 Nexcom International Co., Ltd.
   2 Microsoft Corporation
   2 Mellanox Technologies, Inc.
   2 ICP Electronics Inc.
   2 Hewlett Packard Enterprise
   2 BSkyB Ltd
   1 Xensource, Inc.
   1 XEROX CORPORATION
   1 Solarflare Communications Inc.
   1 SILICOM, LTD.
   1 MIX s.r.l.
   1 LANNER ELECTRONICS, INC.
   1 GIGA-BYTE TECHNOLOGY CO.,LTD.
   1 DriveCam Inc
   1 DIGITAL EQUIPMENT CORPORATION
   1 Agile Systems Inc.

That's done using https://github.com/bauerj/mac_vendor_lookup to do the MAC 
lookup against the IEEE OUI list with the "Unknown" entries being anything 
which doesn't appear in http://standards-oui.ieee.org/oui.txt (possibly locally 
administered addresses?).

Hope that's helpful to someone 


Edward Dore

Freethought Internet


From: NANOG mailto:nanog-boun...@nanog.org>> on behalf 
of Sabri Berisha mailto:sa...@cluecentral.net>>
Sent: 07 November 2019 19:08
To: Compton, Rich A mailto:rich.comp...@charter.com>>
Cc: nanog mailto:nanog@nanog.org>>
Subject: Re: Any info on devices that are running eBGP on the Internet?

Hi,

What you could consider is asking a few of the major internet exchanges if 
they'd be so kind to send you a list of MAC addresses seen on their LANs. Based 
on the MAC you can determine the manufacturer. If you have three or four big 
ones, you have a decent sample size as most larger networks are on multiple 
IXes anyway.

If you do compile a list, I'm sure this list would be interested in the results 
:)

Thanks,

Sabri


- On Nov 6, 2019, at 10:39 AM, Compton, Rich A 
mailto:rich.comp...@charter.com>> wrote:

Hi, I am working with MANRS (https://www.manrs.org) on a tool for checking 
router configs for BGP security / spoofing prevention (e.g. uRPF) 
https://github.com/manrs-tools/MANRS-validator

We are wondering if there is any research on the percentages of different types 
of devices running BGP on the Internet.

Something like:

Cisco IOS 30%

Junos 30%

Mikrotik 20%

etc…

We are looking to focus our tool on the most prevalent types of devices doing 
BGP (and the most prevalent with BGP security/spoofing issues) so that we can 
have the greatest impact.  Does anyone have any information on this or know 
where I can obtain this information?  Thanks in advance!

 -Rich

The contents of this e-mail message and
any attachments are intended solely for the
addressee(s) and may contain confidential
and/or legally privileged information. If you
are not the intended recipient of this message
or if this message has been addressed to you
in error, please immediately alert the sender
by reply e-mail and then delete this message
and any attachments. If you are not the
intended recipient, you are notified that
any use, dissemination, distribution, copying,
or storage of this message or any attachment
is strictly prohibited.



CONFIDENTIALITY NOTICE: This e-mail transmission, and any documents, files or 
previous e-mail messages attached to it may contain confidential information 
that is legally privileged. If you are not the intended recipient, or