Re: Texas internet connectivity declining due to blackouts

[Ben Cannon]

You guys build how you want. At 6x7 we are building to prepare for possible 
climactic shifts.  The origin need not be anthropogenic, but that doesn’t look 
good.

“Doing nothing” isn’t really an option, and “doing what republicans want 
because they say so and they’re my dad” isn’t a good argument.


Nor is it a personality.

Ms. Lady Benjamin PD Cannon, ASCE
6x7 Networks & 6x7 Telecom, LLC 
CEO 
b...@6by7.net
"The only fully end-to-end encrypted global telecommunications company in the 
world.”

FCC License KJ6FJJ

Sent from my iPhone via RFC1149.

> On Feb 22, 2021, at 11:35 AM, Mel Beckman  wrote:
> 
> Rich,
> 
> Calling my opposing argument “trash”, and then falsely linking it to 
> unrelated theories on vaccines, evolution, moon landings, and dietary 
> supplements, is intellectually dishonest and professionally rude. Why don’t 
> you respond to the facts raised in the article? Does your religion not permit 
> that?
> 
> Either weather events are getting worse, or they aren’t. I provided solid 
> evidence that they are diminishing. The truth of this issue is important to 
> NANOG, because we build the infrastructure that runs the Internet, and we 
> can’t afford to waste finite resources on alarmist claims. 
> 
> -mel
> 
>> On Feb 22, 2021, at 10:23 AM, Rich Kulawiec  wrote:
>> 
>>> On Mon, Feb 22, 2021 at 05:48:06PM +, Mel Beckman wrote:
>>> Sorry Global Warmists,
>> 
>> Right.  Sure.  Also, the earth is 6,000 years old (and flat), the moon
>> landings were faked, creationism is real, dinosaurs and humans co-existed,
>> vaccines cause autism, Elvis is alive, and...how does that line go?  Oh,
>> right: artificial sweeteners are safe, WMDs were in Iraq, and Anna Nicole
>> married for love. [shout-out to Levon Helm]
>> 
>> This trash doesn't deserve rebuttal: it deserves ridicule.
>> 
>> ---rsk
> 

Re: Famous operational issues

[Ben Cannon]

I’m embarrassed to say, I’ve done this.

Ms. Lady Benjamin PD Cannon, ASCE
6x7 Networks & 6x7 Telecom, LLC 
CEO 
b...@6by7.net
"The only fully end-to-end encrypted global telecommunications company in the 
world.”

FCC License KJ6FJJ

Sent from my iPhone via RFC1149.

> On Feb 19, 2021, at 12:55 AM, Wolfgang Tremmel  
> wrote:
> 
> Do you remember the Cisco HDCI connectors? 
> https://en.wikipedia.org/wiki/HDCI
> 
> I once shipped a Cisco 4500 plus some cables to a remote data center and 
> asked the local guys to cable them for me.
> With Cisco you could check the cable type and if they were properly attached. 
> They were not.
> 
> I asked for a check and the local guy confirmed me three times that the 
> cables were properly plugged. 
> At the end I gave up, and took the 3 hour drive to the datacenter to check 
> myself.
> 
> Problem was that, while the casing of the connector is asymmetrical, the pins 
> inside are symmetrical.
> And the local guy was quite strong.
> 
> Yes, he managed to plug in the cables 180° flipped, bending the case, but he 
> got them in.
> He was quite embarrassed when I fixed the cabling problem in 10 seconds.
> 
> That must have been 1995 or so
> 
> Wolfgang
> 
> 
> 
>> On 16. Feb 2021, at 20:37, John Kristoff  wrote:
>> 
>> Which examples would make up your top three?
> 
> -- 
> Wolfgang Tremmel 
> 
> Phone +49 69 1730902 0  | wolfgang.trem...@de-cix.net
> Executive Directors: Harald A. Summa and Sebastian Seifert | Trade Registry: 
> AG Cologne, HRB 51135
> DE-CIX Management GmbH | Lindleystrasse 12 | 60314 Frankfurt am Main | 
> Germany | www.de-cix.net
> 

Re: Texas internet connectivity declining due to blackouts

[Ben Cannon]

https://www.dallasnews.com/business/energy/2021/02/16/electricity-retailer-griddys-unusual-plea-to-texas-customers-leave-now-before-you-get-a-big-bill/

The power market in Texas has utterly failed.

Ms. Lady Benjamin PD Cannon, ASCE
6x7 Networks & 6x7 Telecom, LLC 
CEO 
b...@6by7.net
"The only fully end-to-end encrypted global telecommunications company in the 
world.”

FCC License KJ6FJJ

Sent from my iPhone via RFC1149.

> On Feb 16, 2021, at 9:15 PM, Peter Beckman  wrote:
> 
> On Tue, 16 Feb 2021, Robert Jacobs wrote:
> 
>> How about letting us Texans have more natural gas power plants or even
>> let the gas be delivered to the plants we have so they can provide more
>> power in an emergency.  Did not help that 20% of our power is now wind
>> which of course in an ice storm like we are having is shut off... Lots of
>> issues and plenty of politics involved here..
> 
> Turns out that you Texans already get a majority of your power from
> Natural Gas.
> 
> So there's already a significant amount of power from natural gas already.
> 
> Things I learned about the most-of-Texas Grid today:
> 
>- Natural Gas plants provide MORE THAN HALF of their total electricity
>generation in 2019 (WOW!)
>- Texas has their own grid to avoid Federal regulation.
>- Texas does have some links to other grids but they don't trigger federal
>regulation for some reason.
>- Texas is the largest energy-producing and energy-consuming state in
>the nation. The industrial sector, including its refineries and
>petrochemical plants, accounts for half of the energy consumed in the
>state.
>- 5 Gigawatts of coal-fired capacity has retired since 2016, and
>supplies 20% of power currently.
>- Wind power provided about 17% of their usage
>- There are two nuclear plants in Texas, only providing 10% of power.
>- One of those nuclear plants are offline due to weather-related issues.
> 
> From the WashPost: "The Texas grid got crushed because its operators didn’t 
> see the need to
> prepare for cold weather"
> https://www.washingtonpost.com/business/2021/02/16/ercot-texas-electric-grid-failure/
> 
> ---
> Peter Beckman  Internet Guy
> beck...@angryox.com http://www.angryox.com/
> ---

Re: Half Fibre Pair

[Ben Cannon]

I’d internet that to be a really weird way to describe a single strand as well, 
but I could see a confused person asserting it’s 44 out of 88 wavelengths? I’ve 
never heard that.

Ms. Lady Benjamin PD Cannon, ASCE
6x7 Networks & 6x7 Telecom, LLC 
CEO 
b...@6by7.net
"The only fully end-to-end encrypted global telecommunications company in the 
world.”

FCC License KJ6FJJ

Sent from my iPhone via RFC1149.

> On Jan 26, 2021, at 12:51 PM, Rod Beck  
> wrote:
> 
> 
> Can someone explain to me what is a half fibre pair? I took it literally to 
> mean a single fibre strand but someone insisted it was a large quantity of 
> spectrum. Please illuminate. On or off list as you please. 
> 
> Regards, 
> 
> Roderick. 
> 
> Roderick Beck
> VP of Business Development
> United Cable Company
> www.unitedcablecompany.com
> New York City & Budapest
> rod.b...@unitedcablecompany.com
> Budapest: 36-70-605-5144
> NJ: 908-452-8183 
> 
> 

Re: Uganda Communications Commission shutdown order

[Ben Cannon]

How much longer before this is declared a crime against humanity?   I give it 
10 yrs 

Ms. Lady Benjamin PD Cannon, ASCE
6x7 Networks & 6x7 Telecom, LLC 
CEO 
b...@6by7.net
"The only fully end-to-end encrypted global telecommunications company in the 
world.”

FCC License KJ6FJJ

Sent from my iPhone via RFC1149.

> On Jan 18, 2021, at 8:24 AM, Sean Donelan  wrote:
> 
> 
> About 5 days later, from January 13, 2021, through January 18, 2021, Uganda 
> begins to restore some internet services in the nation. Most social media 
> sites appear to still be blocked.
> 
> https://www.bbc.com/news/world-africa-55705404
> 
> Ugandan President Yoweri Museveni claimed Saturday that he had been 
> re-elected for a sixth term as president since 1986.
> 
> This is not the longest internet shutdown.  Ethiopia shutdown internet access 
> for nearly two months in 2020.  Belerus had several full and partial internet 
> shutdowns over several months in 2020.

Re: DoNotPay Spam?

[Ben Cannon]

FYI geek team I received it too.

Ms. Lady Benjamin PD Cannon, ASCE
6x7 Networks & 6x7 Telecom, LLC 
CEO 
b...@6by7.net
"The only fully end-to-end encrypted global telecommunications company in the 
world.”

FCC License KJ6FJJ

Sent from my iPhone via RFC1149.

> On Jan 13, 2021, at 4:28 PM, Sabri Berisha  wrote:
> 
> - On Jan 13, 2021, at 2:22 PM, Bryan Fields br...@bryanfields.net wrote:
> 
> Hi Bryan,
> 
>> What you can do is when you notice these, email geeks@nanog with the full
>> email including headers immediately.  We can then cross check it against new
>> signups.  I wish there was a more scientific way to process it.
> 
> The first time I got it, I sent this to supp...@donotpay.com:
> 
>> I received this email in, what appears to be, reply to a post I made on 
>> NANOG.
> 
>> Needless to say, I never signed up for this. I did not even know you existed.
>> Since you do add "supp...@donotpay.com" in your email, I assume this is a
>> honest mistake, and you'll be happy that I'm contacting you and will be 
>> fixing
>> it immediately.
> 
>> Obviously, further unsolicited emails will result in ... a different approach
>> taken.
> 
> A few days later, I got the same again, and contacted their hosting provider,
> Mailgun (while CCing supp...@donotpay.com), with the following:
> 
>> I've received, multiple times, email such as below after posting to the North
>> American Network Operators Group (NANOG) email list. I've tried contacting
>> supp...@donotpay.com (ticket #13202), but they seem oblivious to the issue
>> and asked me to unsubscribe.
> 
>> Please educate your customer. Alternatively, I will contact Amazon, who seem
>> to advertise your IP space.
> 
>> 161.38.200.0/22*[BGP/170] 00:51:18, localpref 150
>>   AS path: 53356 60011 3356 16509 I, validation-state: 
>> unverified
>>> to 195.16.87.249 via ge-0/0/6.0
> 
>> Headers are as follows:
> 
> [snip]
> 
> I did not even get a reply on that. So, as promised, the third time I was
> spammed, I took the liberty of contacting AWS. They responded with:
> 
>> This is a follow up regarding the abusive content or activity report that you
>> submitted to AWS. We have investigated this report, and have taken steps to
>> mitigate the reported abusive content or activity.
> 
> But of course, nothing changed.
> 
> This goes a lot further than someone accidentally subscribing. So, it seems
> that there are few options other than to simply block mail from that /22. 
> 
> Thanks,
> 
> Sabri

Re: Parler

[Ben Cannon]

We’re straying pretty far into OT here but they do run a network - Trump 
banning TikTok because they hurt his feelings would be Stalinist.

Twitter banning Trump for TOD violations is the Free Market speaking.

It’s pretty fundamental to civics, participation society, and sanity in 
general, to get these right.

Ms. Lady Benjamin PD Cannon, ASCE
6x7 Networks & 6x7 Telecom, LLC 
CEO 
b...@6by7.net
"The only fully end-to-end encrypted global telecommunications company in the 
world.”

FCC License KJ6FJJ

Sent from my iPhone via RFC1149.

> On Jan 10, 2021, at 9:33 PM, b...@theworld.com wrote:
> 
> 
> Sometimes it's worth turning the issue around and looking at it right
> up the...um, whatever.
> 
> A friend who is rather right-wing (tho mostly sane) said angrily that
> AWS terminating Parler was "Stalinist" (apparently his metaphor for
> totalitarian.)
> 
> I said no, the government _forcing_ AWS to carry Parler, or Twitter to
> carry Trump (another 'plaint) would be "Stalinist".
> 
> Imagine if a Chinese social media company refused to carry anything
> posted by Xi Jinping (China's president) for similar reasoning.
> 
> Then you'd likely, one can only speculate, see "Stalinist" in action.
> 
> P.S. Does anyone know whether Trump is paid for his Twitter traffic as
> many celebrities are?
> 
> -- 
>-Barry Shein
> 
> Software Tool & Die| b...@theworld.com | 
> http://www.TheWorld.com
> Purveyors to the Trade | Voice: +1 617-STD-WRLD   | 800-THE-WRLD
> The World: Since 1989  | A Public Information Utility | *oo*

Re: Parler

[Ben Cannon]

Yeah that still hits my “fuck directly off” button.

Ms. Lady Benjamin PD Cannon, ASCE
6x7 Networks & 6x7 Telecom, LLC 
CEO 
b...@6by7.net
"The only fully end-to-end encrypted global telecommunications company in the 
world.”

FCC License KJ6FJJ

Sent from my iPhone via RFC1149.

> On Jan 10, 2021, at 9:00 AM, Rich Kulawiec  wrote:
> 
> 
> Given that people on Parler are currently discussing/planning attacks
> against Amazon/Google/Apple/etc.'s facilities and personnel, this seems wise.
> 
> ---rsk

Re: Parler

[Ben Cannon]

I’m not sure either Joe.  I am a staunch proponent of free expression, but I 
remember a time when you could just. Totally trust an e-mail header.



Ms. Lady Benjamin PD Cannon, ASCE
6x7 Networks & 6x7 Telecom, LLC 
CEO 
b...@6by7.net
"The only fully end-to-end encrypted global telecommunications company in the 
world.”

FCC License KJ6FJJ

Sent from my iPhone via RFC1149.

> On Jan 10, 2021, at 8:25 AM, Joe Greco  wrote:
> 
> On Sun, Jan 10, 2021 at 10:03:51AM -0500, sro...@ronan-online.com wrote:
>> Another interesting angle here is that it as ruled President 
>> couldn???t block people, because his Tweets were government 
>> communication. So has Twitter now blocked government communication?
> 
> That's not interesting or even a reasonable comparison.
> 
> Twitter wasn't involved in the former.  There is a huge difference in
> the President being told that he cannot block random citizens from
> reading his tweets (no Twitter involvement), and Twitter declaring that
> they no longer wish to provide service to the President (Twitter's 
> right as it is their private property).  The President is free to
> pursue alternative venues for his messaging.
> 
> Conflating unrelated things and drawing bad conclusions is not useful.
> 
> 
> At some point, it seems likely that the networking community may be
> faced with more choices such as what Cloudflare faced with 8chan.  In 
> an ideal world, people would act responsibly and we could have the nice
> things like libertarian ideals, but the reality as demonstrated by the
> last quarter century seems to indicate otherwise, in many small and not-
> so-small ways.
> 
> I find that distressing, but I am not so libertarian as to insist that
> others pay for this stuff with their lives.  I don't have any idea what
> the correct answer is, though.
> 
> ... JG
> -- 
> Joe Greco - sol.net Network Services - Milwaukee, WI - http://www.sol.net
> "The strain of anti-intellectualism has been a constant thread winding its way
> through our political and cultural life, nurtured by the false notion that
> democracy means that 'my ignorance is just as good as your knowledge.'"-Asimov

Re: Show NOCs: OIG report: Should you charge extra for NOC tours?

[Ben Cannon]

I’m lucky enough to give hundreds of people their literal first look at “the 
internet” - and I can tell you, in many cases, it blows their minds.  

Honestly watching people’s eyes light up when they see all this, or hold a bare 
glass optical fiber in their hand, has got to be one of the very best parts of 
this whole gig.


Lest we grow too accustomed to the technology that profoundly changed my life 
around age 8 or so.

Ms. Lady Benjamin PD Cannon, ASCE
6x7 Networks & 6x7 Telecom, LLC 
CEO 
b...@6by7.net
"The only fully end-to-end encrypted global telecommunications company in the 
world.”

FCC License KJ6FJJ

Sent from my iPhone via RFC1149.

> On Jan 7, 2021, at 10:34 AM, Christopher Morrow  
> wrote:
> 
> NOC tours seem like a very 1990's thing, that and 'datacenter tours'.
> 
> "Oh you like seeing people at computers and you can't get enough of
> that at your home workplace?"
> "Oh, you also like cages? me too!! sometimes we put 'racks' in them...
> or heavens to gertrude! 'computers'!!"
> 
> almost all of this seems like ... really not worth the time for
> external people to bother with.
> which is maybe why: "Sure, you wanna visit? pay me" (Oh, now you dont'
> want to visit? ok, cool!)
> 
>> On Thu, Jan 7, 2021 at 1:09 PM Sean Donelan  wrote:
>> 
>> 
>> Department of Commerce OIG review of FirstNet request to tour AT GNOC
>> 
>> 
>> https://www.oversight.gov/sites/default/files/oig-reports/DOC/OIG-21-016-I.pdf
>> Continued FirstNet Authority Management Attention is Needed to Address
>> Control Environment Weaknesses
>> 
>> [...]
>> FirstNet Authority disagreed that the request for a GNOC tour “constituted
>> a request for ‘additional contract services outside the scope of the
>> contract.’” In its response, FirstNet Authority stated, “GNOC tours are
>> not governed or limited by the [NPSBN] contract as these kinds of tours
>> are commonplace for AT to provide to outside parties.”  However, we
>> found that the contractor only offers a multi-media presentation regarding
>> the GNOC at its Corporate Briefing Center. FirstNet Authority requested a
>> visit and tour of the GNOC, which is neither included in the contract nor
>> offered widely to the public. We reaffirm that the tour was not in the
>> contract and could be viewed as exerting indirect pressure for the
>> contractor to perform unreimbursed services outside the contract.
>> [...]

Re: Are the days of the showpiece NOC office display gone forever?

[Ben Cannon]

It’d be real interesting to open-source this somehow, produce a useable open or 
quasi open (maybe curated somehow) reputation score for email. 

Ms. Lady Benjamin PD Cannon, ASCE
6x7 Networks & 6x7 Telecom, LLC 
CEO 
b...@6by7.net
"The only fully end-to-end encrypted global telecommunications company in the 
world.”

FCC License KJ6FJJ

Sent from my iPhone via RFC1149.

> On Dec 30, 2020, at 3:04 PM, Rich Kulawiec  wrote:
> 
> On Tue, Dec 22, 2020 at 10:41:43PM -0700, Wayne Bouchard wrote:
>> And if the last 15 years has shown us anything, it is that when you
>> can't get past the auto-attendant and talk to a real human, and if
>> that person can't talk to you like a person instead of reading scripts
>> at you, your stress levels go way up as does your desire to break
>> things. Automation in customer service (or excessive emphasis on
>> procedures) is a really nice way of taking a five minute problem and
>> turning it into an hour long ordeal.
> 
> There are some easy methods for service/support organizations to decrease
> the pain that this inflicts on people reporting problems.
> 
> For example, one thing that I've taught people to do is to make liberal
> use of procmail in order to sort incoming traffic to role accounts.
> It requires diligence, but that diligence is repaid many times over by
> how it expedites dealing with problems.  A simple example of this is
> that when a problem report is received at the RFC 2142 security@ role
> address, and it's clueful, well-written, and important, a procmail rule
> gets created for the sending address so that all future messages from
> that address are prioritized...because it obviously came from someone who
> knows what the heck they're doing and did us a favor by telling us that
> we have a problem.  Chances are that any future messages from them will
> be similarly helpful and that if we respond to those quickly we may be
> able to forestall a lot more messages that aren't going to be as clueful.
> 
> The opposite thing is done with clueless/misdirected/etc. reports:
> they're not discarded, but they go into the low-priority queue.
> 
> Everything else goes somewhere in the middle.
> 
> Repeated hundreds or thousands of times over many years, this builds a
> ruleset that pre-sorts messages rather well.  It's not perfect, it's not
> foolproof, but it helps us *and* it helps lower the frustration level of
> people sending clueful messages, because it better positions us to read,
> act on, and respond to those.  Those people are catching our mistakes,
> the least we can do is try to pay attention.
> 
> (Hint: a useful way to begin building such a ruleset is to grab all the
> addresses from NANOG, dnsops, outages, etc. and pre-load the ruleset
> with them...because traffic received at role accounts from participants
> in these mailing lists is probably useful.)
> 
> ---rsk

Re: 10g residential CPE

[Ben Cannon]

> Again, it seems nice to be able to do this but most companies don't have idle 
> resources sitting around to give away things for free. We have zero extra 
> time to work for free. 

We’re a tiny company and I already have a department dedicated to giving - 
really we do have some often highly specific embarrassments of riches as 
telecom companies - and honestly reading between the lines here, Big Telco has 
already paid for the fiber and the trucks have rolled and the guys have half a 
day left, the entire spool’s paid for so why tf not...

It’s easy for the same activity to cost one entity 6 figures, and another, 
literally zero (or more realistically, some extra fuel and a switch and 48 
optics etc.).

Then again it can also cost us $1,000/ft to trench in some downtown metros.

Ms. Lady Benjamin PD Cannon, ASCE
6x7 Networks & 6x7 Telecom, LLC 
CEO 
b...@6by7.net
"The only fully end-to-end encrypted global telecommunications company in the 
world.”

FCC License KJ6FJJ

Sent from my iPhone via RFC1149.

> On Dec 29, 2020, at 5:42 AM, Darin Steffl  wrote:
> 
> 
> Oh they'll get plenty of support calls still, almost all about wifi issues. 
> They'll be connected to 2.4ghz on an old device, run a speedtest and only get 
> 30 mbps and complain they're not getting 950 mbps on their free connection.
> 
> WiFi issues will always cause support calls no matter what isp. The denser 
> the area, the more wifi interference that exists and will drive more calls. 
> 
> I understand wanting to offer free internet to a small number of entities and 
> residential areas, particularly hotspots. What I don't agree with is free 
> service for every residential home or apartment. It absolutely hurts your 
> business to do this. It's a charity, not a business then. You say it doesn't 
> take any additional resources to support but it absolutely does. You have way 
> more than $300 into an install. You'll also have to hire additional staff 
> sooner because of additional tech support calls from the res side. 
> 
>> On Tue, Dec 29, 2020, 1:28 AM Mark Tinka  wrote:
>> 
>> 
>> On 12/29/20 04:41, Keith Medcalf wrote:
>> 
>> > Are you sure that is not related to "residential services" being of a 
>> > generally lower quality than business services?  It has been my experience 
>> > that shoddy service generates higher need for "support" than does 
>> > "non-shoddy" service.  In this regard, the price for "business" services 
>> > should be less than "residential service" by a couple of orders of 
>> > magnitude since it costs orders of magnitude more money to "support" 
>> > shoddy services than non-shoddy services.
>> 
>> Considering that Aaron said 98% of their residential customers are on 
>> the free plan, and that they use Active-E with every 1Gbps customer 
>> getting a proper switch port, I'd hazard the bulk of their support 
>> queries to be non-techie customers needing software support (grandma, et 
>> al), or fibres being cut.
>> 
>> It wouldn't seem like they'd be getting calls about "speed" issues, 
>> which are most annoying ones :-).
>> 
>> Mark.

Re: 10g residential CPE

[Ben Cannon]

We are doing a similar project in Marin county - regardless of ability to pay.  
If I can make it pencil, not only why not, but shouldn’t we all?

Ms. Lady Benjamin PD Cannon, ASCE
6x7 Networks & 6x7 Telecom, LLC 
CEO 
b...@6by7.net
"The only fully end-to-end encrypted global telecommunications company in the 
world.”

FCC License KJ6FJJ

Sent from my iPhone via RFC1149.

> On Dec 28, 2020, at 12:24 PM, Aaron Wendel  
> wrote:
> 
> We still build when needed. We're in the process of building to 700 new 
> apartments so we can provide them with free service.  We're actually pulling 
> 576 strands into the basement of one building to backhaul each apartment to 
> it's own switch port in the new hut we just deployed to service that new 
> development.  (we don't use a PON system.  Everyone has a dedicated switch 
> port.)  Also, keep in mind that this isn't all we do.  This is a very small 
> part of a much bigger pie.  So I agree with you.  If this was it then it 
> would make no sense.  When you look at all the pieces together it makes 
> perfect sense.
> 
> Aaron
> 
> 
>> On 12/28/2020 1:50 PM, Baldur Norddahl wrote:
>> I applaud your commitment to helping your local community. Just want to 
>> point out that this is a charity because it does not scale. Nobody could 
>> build out a FTTH network and make it free as a business case. But there are 
>> plenty of people that made a network for their neighbors and provided that 
>> for free. Maybe a person had a commercial fiber to his home and thought he 
>> could just as well share it. This might be on a bigger scale but it is the 
>> same.
>> 
>> Regards,
>> 
>> Baldur
>> 
>> 
>> On Mon, Dec 28, 2020 at 8:27 PM Aaron Wendel > > wrote:
>> 
>>Darin,
>> 
>>Our business support and residential support is the same
>>department.  I
>>have to pay those people to be in the office either way so it doesn't
>>cost me any "more" to provide support for the residences. Yes,
>>walking
>>Grandma through getting her email can sometimes be a chore but that
>>person is on the payroll whether he/she is helping Grandma or sitting
>>there chatting with his/her co-worker.  If we dumped all the
>>residential
>>customers we would still have the same cost structure we do now.
>> 
>>Again, it's been free for the last 7 years at this point. I've never
>>been one to really do what I "should" anyway.
>> 
>>Aaron
>> 
>> 
>>On 12/28/2020 11:48 AM, Darin Steffl wrote:
>>> Aaron,
>>>
>>> The "Free" service doesn't cover your cost of support which is much
>>> higher for residential than any business customer. Our residential
>>> customers call at least 15x more often compared to business
>>customers
>>> compared on a 1:1 ratio.
>>>
>>> I honestly can't fathom providing free residential service
>>because we
>>> make enough money on the business side of things. You should be
>>> charging something, at least $20-30 per month.
>>>
>>> On Mon, Dec 28, 2020 at 11:15 AM Aaron Wendel
>>> >
>>>>> wrote:
>>>
>>> The $300 covers the equipment and the time to send someone
>>out to a
>>> house to install it.  If $300 is too much you can pay in 12
>>> installments
>>> of $25.
>>>
>>> The TIK alone costs us about $250.
>>>
>>> Aaron
>>>
>>>
>>> On 12/27/2020 5:04 AM, Mark Tinka wrote:
>>> >
>>> >
>>> > On 12/26/20 20:48, Darin Steffl wrote:
>>> >
>>> >> Aaron,
>>> >>
>>> >> One simple question. Why on earth would you offer free
>>internet
>>> >> service? How and why? Your site show 1 Gig symmetrical
>>for free
>>> when
>>> >> you should be a minimum of $65 per month to be competitive.
>>> >
>>> > They also ask for no monthly fee after a single payment of
>>US$300.
>>> >
>>> > Considering the 2Gbps package costs US$49.95, you'd guess
>>they'd
>>> value
>>> > the 1Gbps service at, say US$27/month, give or take.
>>> >
>>> > So that US$300 provides a bit of coverage, perhaps 1 year,
>>in which
>>> > time they'd have likely upgraded the customer.
>>> >
>>> > Mark.
>>>
>>> --
>>>  
>>> Aaron Wendel
>>> Chief Technical Officer
>>> Wholesale Internet, Inc. (AS 32097)
>>> (816)550-9030
>>> http://www.wholesaleinternet.com
>>
>>>
>>>  
>>>
>>>
>>>
>>> --
>>> Darin Steffl
>> 

10g residential CPE

[Ben Cannon]

Anyone else doing it? Do you like your gear? 

Ms. Lady Benjamin PD Cannon, ASCE
6x7 Networks & 6x7 Telecom, LLC 
CEO 
b...@6by7.net
"The only fully end-to-end encrypted global telecommunications company in the 
world.”

FCC License KJ6FJJ

Sent from my iPhone via RFC1149.

Re: Are the days of the showpiece NOC office display gone forever?

[Ben Cannon]

I’ve learned that the secret is automation + intelligent trained and empowered 
staff.

Ms. Lady Benjamin PD Cannon, ASCE
6x7 Networks & 6x7 Telecom, LLC 
CEO 
b...@6by7.net
"The only fully end-to-end encrypted global telecommunications company in the 
world.”

FCC License KJ6FJJ

Sent from my iPhone via RFC1149.

> On Dec 17, 2020, at 3:17 PM, Peter E. Fry  wrote:
> 
> 
> 
>> Subject: Re: Are the days of the showpiece NOC office display gone forever? 
>> From: Tom Beecher  
>> To: Matt Erculiani 
>> Cc: NANOG Operators' Group  
>> Date: Thursday, 12/17/2020 11:59:37
> [...] 
>> Contrary to what salespeople will say, the answer is not 100% automation, or 
>> 100% humans. The proper answer is an often changing combination of the two. 
> I believe the desired combination is automation + button-pushing monkeys.
> 
>> ML is not the magical unicorn solution that solves everything, contrary to 
>> what many papers and salespeople tell you. [...]
> But which will write Shakespeare first?  I'd bet on the monkeys, although 
> both come up with some unique and unanticipated ways to fail.
> 
> Oh well.  Back to pushing buttons.  Someday my masterpiece will be complete...
> 
> Peter E. Fry
> 
> 

Re: The Real AI Threat?

[Ben Cannon]

To follow - Siri couldn’t figure out how to add an entry to my calendar today.  
I am yet to be afraid.

Although the google bot that placed a call to book a haircut was impressive.

Ms. Lady Benjamin PD Cannon, ASCE
6x7 Networks & 6x7 Telecom, LLC 
CEO 
b...@6by7.net
"The only fully end-to-end encrypted global telecommunications company in the 
world.”

FCC License KJ6FJJ

Sent from my iPhone via RFC1149.

> On Dec 9, 2020, at 12:16 PM, Mel Beckman  wrote:
> 
> Miles,
> 
> You realize that “AI” as general artificial intelligence is science fiction, 
> right? There is no general AI, and even ML is not actually learning in the 
> sense that humans or animals learn. “Neural networks”, likewise, have nothing 
> to do at all with the way biological neurons work in cognition (which science 
> doesn’t understand). That’s all mythology, amplified by science fiction and 
> TV fantasies like Star Trek’s character “Data”. It’s just anthropomorphizing 
> technology. 
> 
> We create unnecessary risk when we anthropomorphize technology. The truth is, 
> any kind of automation incurs risk. There is nothing related to intelligence, 
> AI or otherwise. It’s all just automation to varying degrees. ML, for 
> example, simply builds data structures based on prior input, and uses those 
> structures to guide future actions. But that’s not general behavior — it all 
> has to be purpose-designed for specific tasks.
> 
> The Musk-stoked fear that if we build automated systems and then “put them 
> together” in the same network, or whatever, that they will somehow gain new 
> capabilities not originally designed and go on a rampage is just plain silly. 
> Mongering that fear, however, is quite lucrative. It’s up to us, the real 
> technologists, to smack down the fear mongers and tell truth, not hype. 
> 
> Since the academics’  promised general intelligence of AI never materialized, 
> they had to dumb-down their terminology, and came up with “narrow AI”. Or 
> “not AI”, as I prefer to say. But narrow AI is mathematically 
> indistinguishable from any other kind of automation, and it has nothing 
> whatsoever to do with intelligence, which science doesn’t remotely yet 
> understand. It’s all automation, all the time.
> 
> All automated systems require safeguards. If you don’t put safeguards in, 
> things blow up: rockets on launchpads, guns on ships, Ansible on steroids. 
> When things blow up, it’s never because systems unilaterally exploited 
> general intelligence to “hook up” and become self-smarted. It’s because you 
> were stupid.
> 
> For a nice, rational look at why general AI is fiction, and what “narrow AI”, 
> such as ML, can actually do, get Meredith Broussard’s excellent book 
> "Artificial Unintelligence - How computers misunderstand the world". 
> 
> https://www.amazon.com/Artificial-Unintelligence-Computers-Misunderstand-World/dp/026253701X
> 
> Or if you prefer a video summary, she has a quick talk on YouTube, "ERROR – 
> The Art of Imperfection Conference: The Fragile”:
> 
> https://www.youtube.com/watch?v=OuDFhSUwOAQ
> 
> At 2:20 into the video, she puts the kibosh on the mythology of general AI.
> 
> -mel
> 
> 
>> On Dec 9, 2020, at 11:07 AM, Miles Fidelman  
>> wrote:
>> 
>> Hi Folks,
>> It occurs to me that network & systems admins are the the folks who really 
>> have to worry about AI threats.
>> 
>> After watching yet another AI takes over the world show - you know, the 
>> same general theme, AI wipes out humans to preserve its existence - it 
>> occurred to me:
>> 
>> Perhaps the real AI threat is "self-healing systems" gone wild. Consider:
>> 
>> - automated system management
>> - automated load management
>> - automated resource management - spin up more instances of  
>> as necessary
>> - automated threat detection & response
>> - automated vulnerability analysis & response
>> 
>> Put them together, and the nightmare scenario is:
>> - machine learning algorithm detects need for more resources
>> - machine learning algorithm makes use of vulnerability analysis library 
>> to find other systems with resources to spare, and starts attaching 
>> those resources
>> - unbounded demand for more resources
>> 
>> Kind of what spambots have done to the global email system.
>> 
>> "For Homo Sapiens, the telephone bell had tolled."
>> (Dial F for Frankenstein, Arthur C. Clarke)
>> 
>> I think I need to start putting whisky in my morning coffee.  And maybe not 
>> thinking 
>> about NOT replacing third shift with AI tools.
>> 
>> Miles Fidelman
>> -- 
>> In theory, there is no difference between theory and practice.
>> In practice, there is.   Yogi Berra
>> 
>> Theory is when you know everything but nothing works. 
>> Practice is when everything works but no one knows why. 
>> In our lab, theory and practice are combined: 
>> nothing works and no one knows why.  ... unknown
> 

Re: 100G over 100 km of dark fiber

[Ben Cannon]

You could break this into 10x 10g coherent lanes, but you’re going to end up 
back close to coherent 100g prices.

You’re at the threshold distance where you’re past all the short range tech and 
are seriously pushing it - whereas the 100g coherent tech is just taking off.  

How important is this link?

Ms. Benjamin PD Cannon, ASCE
6x7 Networks & 6x7 Telecom, LLC 
CEO 
b...@6by7.net
"The only fully end-to-end encrypted global telecommunications company in the 
world.”

FCC License KJ6FJJ



> On Oct 30, 2020, at 7:19 AM, Jared Brown  wrote:
> 
> Hello NANOG!
> 
> I need to push 100G over 100 km of dark fiber. Since there are no 100G 
> pluggable optics with this reach (~25 dB), I have been offered coherent 
> transport systems to solve my problem. This is all good and well, except 
> total system costs start from high five figures.
> 
> So, my question is, do I have any other options?
> 
> I can't help noticing that you can break out a 100G QSFP into four 25G QSFPs. 
> 25G DWDM systems are relatively inexpensive (low five figures), but can you 
> make 25G DWDM go 100 km?
> 
> I only need the one 100G, so I don't really need a highly scalable DWDM 
> system. I can't put anything midspan, or if I could it would cost more than 
> just going with a coherent system.
> 
> 
> Jared

Re: Centurylink having a bad morning?

[Ben Cannon]

We’re bailing out a customer in exactly this same boat as we speak.  There are 
so many.

Ms. Benjamin PD Cannon, ASCE
6x7 Networks & 6x7 Telecom, LLC 
CEO 
b...@6by7.net
"The only fully end-to-end encrypted global telecommunications company in the 
world.”

FCC License KJ6FJJ



> On Aug 31, 2020, at 12:52 PM, Eric Kuhnke  wrote:
> 
> 
> There's a number of enterprise end user type customers of 3356 that have 
> on-premises server rooms/hosting for their stuff. And they spend a lot of 
> money every month for a 'redundant' metro ethernet circuit that takes diverse 
> fiber paths from their business park office building to the local 
> clink/level3 POP. But all that last mile redundancy and fail over ability 
> doesn't do much for them when 3356 breaks its network at the BGP level.
> 
> 
> 
>> On Mon, Aug 31, 2020 at 9:36 AM Drew Weaver  wrote:
>> I also found the part where they mention that a lot of hosting companies 
>> only have one uplink to be quizzical and also the fact that he goes pretty 
>> close to implying that its Centurylink’s customers fault for not having 
>> multiple paths to Cloudflare that don’t touch Centurylink a bit puzzling. It 
>> could have just been poorly written.
>> 
>>  
>> 
>>  
>> 
>> From: NANOG  On Behalf Of 
>> Tom Beecher
>> Sent: Monday, August 31, 2020 9:26 AM
>> To: Hank Nussbacher 
>> Cc: NANOG 
>> Subject: Re: Centurylink having a bad morning?
>> 
>>  
>> 
>> https://blog.cloudflare.com/analysis-of-todays-centurylink-level-3-outage/
>> 
>>  
>> 
>> I definitely found Mr. Prince's writing about yesterday's events fascinating.
>> 
>>  
>> 
>> Verizon makes a mistake with BGP filters that allows a secondary mistake 
>> from leaked "optimizer" routes to propagate, and Mr. Prince takes every 
>> opportunity to lob large chunks of granite about how terrible they are. 
>> 
>>  
>> 
>> L3 allows an erroneous flowspec announcement to cause massive global 
>> connectivity issues, and Mr. Prince shrugs and says "Incidents happen." 
>> 
>>  
>> 
>>  
>> 
>>  
>> 
>>  
>> 
>>  
>> 
>> On Mon, Aug 31, 2020 at 1:15 AM Hank Nussbacher  wrote:
>> 
>> On 30/08/2020 20:08, Baldur Norddahl wrote:
>> 
>>  
>> 
>> https://blog.cloudflare.com/analysis-of-todays-centurylink-level-3-outage/
>> 
>>  
>> 
>> Sounds like Flowspec possibly blocking tcp/179 might be the cause.
>> 
>>  
>> 
>> But that is Cloudflare speculation.
>> 
>>  
>> 
>> Regards,
>> Hank
>> 
>> Caveat: The views expressed above are solely my own and do not express the 
>> views or opinions of my employer
>> 
>>  
>> 
>> An outage is what it is. I am not worried about outages. We have multiple 
>> transits to deal with that.
>> 
>>  
>> 
>> It is the keep announcing prefixes after withdrawal from peers and customers 
>> that is the huge problem here. That is killing all the effort and money I 
>> put into having redundancy. It is sabotage of my network after I cut the 
>> ties. I do not want to be a customer at an outlet who has a system that will 
>> do that. Luckily we do not currently have a contract and now they will have 
>> to convince me it is safe for me to make a contract with them. If that is 
>> impossible I guess I won't be getting a contract with them.
>> 
>>  
>> 
>> But I disagree in that it would be impossible. They need to make a good 
>> report telling exactly what went wrong and how they changed the design, so 
>> something like this can not happen again. The basic design of BGP is such 
>> that this should not happen easily if at all. They did something unwise. Did 
>> they make a route reflector based on a database or something?
>> 
>>  
>> 
>> Regards,
>> 
>>  
>> 
>> Baldur
>> 
>>  
>> 
>> On Sun, Aug 30, 2020 at 5:13 PM Mike Bolitho  wrote:
>> 
>> Exactly. And asking that they somehow prove this won't happen again is 
>> impossible.
>> 
>> - Mike Bolitho
>> 
>>  
>> 
>> On Sun, Aug 30, 2020, 8:10 AM Drew Weaver  wrote:
>> 
>> I’m not defending them but I am sure it isn’t intentional.
>> 
>>  
>> 
>> From: NANOG  On Behalf Of 
>> Baldur Norddahl
>> Sent: Sunday, August 30, 2020 9:28 AM
>> To: nanog@nanog.org
>> Subject: Re: Centurylink having a bad morning?
>> 
>>  
>> 
>> How is that acceptable behaviour? I shall remember never to make a contract 
>> with these guys until they can prove that they won't advertise my prefixes 
>> after I pull them. Under any circumstances. 
>> 
>>  
>> 
>> søn. 30. aug. 2020 15.14 skrev Joseph Jenkins :
>> 
>> Finally got through on their support line and spoke to level1. The only 
>> thing the tech could say was it was an issue with BGP route reflectors and 
>> it started about 3am(pacific). They were still trying to isolate the issue. 
>> I've tried failing over my circuits and no go, the traffic just dies as L3 
>> won't stop advertising my routes.
>> 
>>  
>> 
>> On Sun, Aug 30, 2020 at 5:21 AM Drew Weaver via NANOG  
>> wrote:
>> 
>> Hello,
>> 
>>  
>> 
>> Woke up this morning to a bunch of reports of issues with connectivity had 
>> to shut down some Level3/CTL 

Re: Telecom billing in 2020

[Ben Cannon]

I’ll just write something in FORTRAN real quick….  :)
-Ben

Ms. Benjamin PD Cannon, ASCE
6x7 Networks & 6x7 Telecom, LLC 
CEO 
b...@6by7.net <mailto:b...@6by7.net>
"The only fully end-to-end encrypted global telecommunications company in the 
world.”
FCC License KJ6FJJ



> On Aug 18, 2020, at 3:57 AM, Large Hadron Collider 
>  wrote:
> 
> What harm can rolling one's own do, especially grafted onto the back of 
> analogue exchanges?
> 
> On Mon, 17 Aug 2020 15:00:18 -0600
> Ben Cannon  wrote:
> 
>> If you had to clean-sheet a CLEC today, what would you base it on? (Must do 
>> telco compliant billing, CRM is a bonus) and why?
>> 
>> Ms. Benjamin PD Cannon, ASCE
>> 6x7 Networks & 6x7 Telecom, LLC
>> CEO
>> b...@6by7.net
>> "The only fully end-to-end encrypted global telecommunications company in 
>> the world.”
>> 
>> FCC License KJ6FJJ
>> 
> 
> 
> --
> Large Hadron Collider 

Telecom billing in 2020

[Ben Cannon]

If you had to clean-sheet a CLEC today, what would you base it on? (Must do 
telco compliant billing, CRM is a bonus) and why?

Ms. Benjamin PD Cannon, ASCE
6x7 Networks & 6x7 Telecom, LLC 
CEO 
b...@6by7.net
"The only fully end-to-end encrypted global telecommunications company in the 
world.”

FCC License KJ6FJJ

GTT contact for ipv6 issue

[Ben Cannon]

We have a service affecting issue and conventional channels are stymied..  
Could a compassionate network engineer reach out off-list re #5339907 please?

Thanks!

-Ben

Ms. Benjamin PD Cannon, ASCE
6x7 Networks & 6x7 Telecom, LLC 
CEO 
b...@6by7.net 
"The only fully end-to-end encrypted global telecommunications company in the 
world.”
FCC License KJ6FJJ

Re: questions asked during network engineer interview

[Ben Cannon]

I come from the “we’ve had SDN for years, it’s called L2VPN” but I guess the 
rest of the world hasn’t been a carrier for 26yrs either.
-Ben

Ms. Benjamin PD Cannon, ASCE
6x7 Networks & 6x7 Telecom, LLC 
CEO 
b...@6by7.net 
"The only fully end-to-end encrypted global telecommunications company in the 
world.”
FCC License KJ6FJJ



> On Jul 20, 2020, at 9:55 PM, Mark Tinka  wrote:
> 
> 
> 
> On 20/Jul/20 23:59, Brandon Martin wrote:
> 
>> Pass given to those who cram them into a "certificates" or "specifics"
>> line or similar in order to get around HR filters, limit them to major
>> certs (or ones your HR dept. specifically demanded), and don't really
>> mention them otherwise.  Bear in mind as well that, even if your
>> hiring process doesn't demand them, others' will, and many people have
>> a standard-ish resume with application-specific cover letter.
> 
> When SDN was all the rage in the middle of the past decade, our HR
> department wanted to hire someone in this field and asked me what type
> of qualifications and certifications they should be looking for. Well, I
> told them to look for someone who had enough will and time to figure out
> what it means to us, and the patience to experiment, fail and experiment
> again, without losing any steam or confidence, and take a pass on any
> SDN certifications recommended by our "recruiting consultants".
> 
> We ended up hiring a regular (but very good) network engineer who had
> recently taken up an interest in understanding and writing software to
> perform repetitive tasks. It was just a shame they chose not join at the
> last minute, but we weren't the worse off for it either.
> 
> At the time, everyone and their arm rest were offering some kind of
> SDN-workshop-certification thingy.
> 
> Suffice it to say, to this day, we still don't know what SDN means to
> us, hehe.
> 
> Mark.
> 

Re: Quality of the internet

[Ben Cannon]

For safety!

Reminds me of bonding channels in an ISDN line.   We had to keep them all 
apart. 

For their own protection.

-Ben

> On Jun 18, 2020, at 6:18 AM, Mark Tinka  wrote:
> 
> 
> 
>> On 18/Jun/20 14:49, Bill Woodcock wrote:
>> 
>> What time was that?
> 
> Back when a 12000 GSR chassis had one line card in slot 0 for the public
> Internet, and another in slot 5 for the MPLS backbone. They had to be
> that far apart, for safety :-)...
> 
> Mark.
> 

... you kicked out the patch cable (or, major global internet outages)

[Ben Cannon]

https://downdetector.com/
...you kicked out a patch cable.  (Nods to BOFH)

In all seriousness, looks major...  Long-haul cut? Did we lose a pie or COs?

-Ben

Re: An appeal for more bandwidth to the Internet Archive

[Ben Cannon]

They are, and I’ve got dark fiber in there.  We’ve reached out...
-Ben

Ms. Benjamin PD Cannon, ASCE
6x7 Networks & 6x7 Telecom, LLC 
CEO 
b...@6by7.net 
"The only fully end-to-end encrypted global telecommunications company in the 
world.”
FCC License KJ6FJJ



> On May 12, 2020, at 9:24 PM, Terrence Koeman  
> wrote:
> 
> Aren't they in a former church or something? I vaguely remember their 
> location to be significant for some reason or another. So location may weigh 
> heavily. 
> 
> -- 
> Regards,
>Terrence Koeman, PhD/MTh/BPsy
>  Darkness Reigns (Holding) B.V.
> 
> Please quote relevant replies.
> Spelling errors courtesy of my 'smart'phone.
> From: David Hubbard  >
> Sent: Wednesday, 13 May 2020 06:02
> To: nanog@nanog.org 
> Subject: Re: An appeal for more bandwidth to the Internet Archive
> 
> Could the operation be moved out of California to achieve dramatically 
> reduced operating costs and perhaps solve some problems via cost savings vs 
> increased donation?  I have to imagine with the storage and processing 
> requirements that the footprint and power usage in SFO is quite costly.  I 
> have equipment in a few California colo's and it's easily 3x what I pay for 
> similar in Nevada, before even getting into tax abatement advantages. 
> 
> 
> 
> On 5/12/20, 1:33 PM, "NANOG on behalf of colin johnston" 
> mailto:nanog-boun...@nanog.org> on behalf of 
> col...@gt86car.org.uk > wrote: 
> 
> Is the increased usage due to more users or more existing users having 
> higher bandwidth at home to request faster ? 
> Would be interested if IPS configured firewall used to block out invalid 
> traffic/spam traffic and if such traffic increased when back end network 
> capacity increased ? 
> What countries are requesting the most data and does this analysis throw 
> up questions as to why ? 
> Are there high network usage hitters which raise question as to why 
> asking for so much data time and time again and is this valid traffic use ? 
> 
> Colin 
> 
> 
> > On 12 May 2020, at 17:33, Tim Požár  > wrote: 
> > 
> > Jared... 
> > 
> > Thanks for sharing this.  I was the first Director of Operations from 
> '96 to '98, at was was then Internet Archive/Alex.  I was the network 
> architect back then got them their ASN and original address space. Folks may 
> also know, I help start SFMIX with Matt Peterson. 
> > 
> > A bit more detail in this...  Some of this I got from Jonah Edwards who 
> is the current Network Architect at IA.  Yes, the bottle neck was the line 
> cards.  They have upgraded and that has certainly helped the bandwidth of 
> late. 
> > 
> > Peering would be a big help for IA. At this point they have two 10Gb 
> LAG interfaces that show up on SFMIX that was turned up last February. 
> Looking at the last couple of weeks the 95th percentile on this 20Gb LAG is 3 
> Gb.  As they just turned up on SFMIX, they are just starting to get peers 
> turned up there. Eyeball networks that show up on SFMIX are highly encouraged 
> to start peering with them.  Alas, they are v4 only at this point. 
> > 
> > Additionally, if folks do have some fat pipes that can donate bandwidth 
> at 200 Paul, I am sure Jonah won't turn it down. 
> > 
> > Tim 
> > 
> > On 5/12/20 4:45 AM, Jared Brown wrote: 
> >> Hello all! 
> >> Last week the Internet Archive upgraded their bandwidth 30% from 47 
> Gbps to 62 Gbps. It was all gobbled up immediately. There's a lovely solid 
> green graph showing how usage grows vertically as each interface comes online 
> until it too is 100% saturated. Looking at the graph legend you can see that 
> their usage for the past 24 hours averages 49.76G on their 50G of transport. 
> >> To see the pretty pictures follow the below link: 
> >> 
> https://blog.archive.org/2020/05/11/thank-you-for-helping-us-increase-our-bandwidth/
>  
> 
>  
> >> Relevant parts from the blog post: 
> >> "A year ago, usage was 30Gbits/sec. At the beginning of this year, we 
> were at 40Gbits/sec, and we were handling it. ... 
> >> Then Covid-19 hit and demand rocketed to 50Gbits/sec and overran our 
> network infrastructure’s ability to handle it.  So much so, our network 
> statistics probes had difficulty collecting data (hence the white spots in 
> the graphs). 
> >> We bought a second router with new line cards, and got it installed 
> and running (and none of this is easy during a pandemic), and increased our 
> capacity from 47Gbits/sec peak to 62Gbits/sec peak.   And we are handling it 
> better, but it is still consumed." 
> >> It is obvious that the Internet Archive needs more bandwidth to power 
> the Wayback machine and to fulfill its mission of being the 

Re: An appeal for more bandwidth to the Internet Archive

[Ben Cannon]

We can absolutely help and will gladly donate.  I’ll reach out to Joah, anyone 
else want to coordinate? 

-Ben

Ms. Benjamin PD Cannon, ASCE
6x7 Networks & 6x7 Telecom, LLC 
CEO 
b...@6by7.net 
"The only fully end-to-end encrypted global telecommunications company in the 
world.”
FCC License KJ6FJJ



> On May 12, 2020, at 4:45 AM, Jared Brown  wrote:
> 
> Hello all!
> 
> Last week the Internet Archive upgraded their bandwidth 30% from 47 Gbps to 
> 62 Gbps. It was all gobbled up immediately. There's a lovely solid green 
> graph showing how usage grows vertically as each interface comes online until 
> it too is 100% saturated. Looking at the graph legend you can see that their 
> usage for the past 24 hours averages 49.76G on their 50G of transport.
> 
> To see the pretty pictures follow the below link:
> https://blog.archive.org/2020/05/11/thank-you-for-helping-us-increase-our-bandwidth/
> 
> Relevant parts from the blog post:
> "A year ago, usage was 30Gbits/sec. At the beginning of this year, we were at 
> 40Gbits/sec, and we were handling it. ... 
> 
> Then Covid-19 hit and demand rocketed to 50Gbits/sec and overran our network 
> infrastructure’s ability to handle it.  So much so, our network statistics 
> probes had difficulty collecting data (hence the white spots in the graphs). 
> 
> We bought a second router with new line cards, and got it installed and 
> running (and none of this is easy during a pandemic), and increased our 
> capacity from 47Gbits/sec peak to 62Gbits/sec peak.   And we are handling it 
> better, but it is still consumed."
> 
> It is obvious that the Internet Archive needs more bandwidth to power the 
> Wayback machine and to fulfill its mission of being the Internet library and 
> the historic archive of our times.
> 
> The Internet Archive is present at Digital Realty SFO (200 Paul) and a member 
> of the San Francisco Metropolitan Internet Exchange (SFMIX). 
> I appeal to all list members present or capable of getting to these 
> facilities to peer with and/or donate bandwidth to the Internet Archive.
> I appeal to all vendors and others with equipment that they can donate to the 
> Internet Archive to contact them so that they can scale their services and 
> sustain their growth.
> 
> The Internet Archive is currently running 10G equipment. If you can help them 
> gain 100G connectivity, 100G routing, 100G switching and/or 100G DWDM 
> capabilities, please reach out to them. They have the infrastructure and dark 
> fiber to transition to 100G, but lack the equipment. You can find the 
> Internet Archive's contact information below or you can contact Jonah at the 
> Archive Org directly either by email or via the contact information available 
> on his Twitter profile @jonahedwards.
> 
> You can also donate at https://archive.org/donate/
> The Internet Archive is a 501(c)(3) non-profit. Donations are  tax-deductible.
> 
> 
> Contact information:
> https://archive.org/about/contact.php
> 
> Volunteering:
> https://archive.org/about/volunteerpositions.php
> 
> 
> Disclaimer: I am not affiliated with the Internet Archive. Nobody asked me to 
> write this post. If something angers you about this post, be angry at me. I 
> merely think that the Internet Archive is a good thing and deserves our 
> support.
> 
> Jared

Fiber across SF Bay

[Ben Cannon]

Does anyone have recommendations for dark fiber or a full 432  across the SF 
bay bridge? 

-Ben

Re: Are underground utility markers essential workers?

[Ben Cannon]

In the scope and performance of their duties includes any work involving 
essential telecommunications expansion or restoration - then yes.

And agreed.  They save lives.  Period. 
Call before you dig. Please.

-Ben

Ms. Benjamin PD Cannon, ASCE
6x7 Networks & 6x7 Telecom, LLC 
CEO 
b...@6by7.net 
"The only fully end-to-end encrypted global telecommunications company in the 
world."



> On Apr 21, 2020, at 11:57 AM, Sean Donelan  wrote:
> 
> 
> Utility markers don't get the recognition they deserve.  If they aren't
> essential workers, they should be and get hazard pay.
> 
> They help protect everyone's fiber and cables and pipes that go boom.
> 
> 

Re: 24x7 vs 24x7x365 Re: Constant Abuse Reports / Borderline Spamming from RiskIQ

[Ben Cannon]

Rich. I am truly sorry.  also this was great thank you.

-Ben

> On Apr 17, 2020, at 6:09 PM, Rich Kulawiec  wrote:
> 
> (since it's Friday and we're all stressed)
> 
> I can't believe that out of everything I wrote that we're going to discuss
> the semantics of this, but then again: yes I can.  I should have known.
> I should have known.  I. Should. Have. Known.  *bangs head on desk*
> *reaches for scotch*  Alrighty then:
> 
> 24x7 means every hour of the week, as in "24 by 7".
> 
> 24x365 means every hour of the year. (modulo those with 366 days
>but please let's not go there because this is bad enough)
>(oh wait, too late, someone upthread already went there)
>(and then leap seconds reared their ugly head, oh good grief)
> 
> 24x7x365 thus means every hour of 7 years.  YES, I know, I know.
> 
> 60x24x7...no.  NO.  I will not go there.  Nor will you.  Just stop.
>I swear I will turn this car around *right now*.
> 
> Yeah, I know it's in common use.  Like any number of other things in
> common use (e.g., "going forward" -- really?  like there's another
> direction to go?) it's...annoying.
> 
> I suspect that someone who just wasn't thinking started this in an
> attempt to out-promote people who merely said 24x7 or 24x365, and it
> propagated outwards.  If that hypothesis is correct and there is thus
> a patient 0 for this epidemic, I very much want to find them and pummel
> them with a bag of Oxford commas.
> 
> rsk

Re: 24x7 vs 24x7x365 Re: Constant Abuse Reports / Borderline Spamming from RiskIQ

[Ben Cannon]

Honestly, sometimes I include the "Three-Hundred Sixty-Five and a Quarter” on 
conference calls.

Side note: What you describe is in-fact part of how languages change and 
evolve.  (over time, sufficiently common incorrect use becomes. well. correct.)

-Ben Cannon
CEO 6x7 Networks & 6x7 Telecom, LLC 
b...@6by7.net <mailto:b...@6by7.net>




> On Apr 16, 2020, at 3:07 AM, Forrest Christian (List Account) 
>  wrote:
> 
> Sorry I can't resist...
> 
> If you're going for accuracy, does 24x365 mean you close one day this year?   
> Or should you actually be saying 24x365.25, or even more accurately 
> 24x365.2425 (but still not exact).
> 
> Oh wait, we missed the leap seconds in there, which there isn't any real way 
> to average out since they occur at semi-random intervals.So I don't know 
> what we should adjust the 24 to...
> 
> I just look at 24x7x365 as shorthand for "24 hours a day, 7 days a week, 365 
> days a year", which is a common saying meaning always open.   It isn't a 
> mathematical formula.   It doesn't have to be exact or make mathematical 
> sense.  
> 
> There are lots of things that if you think about too hard they don't make 
> sense.  The one this week I thought about was "hunger benefit".   Does that 
> mean we're raising money to increase hunger?  One could go on and on trying 
> to correct logical inconsistencies in our use of language.   It's fun on 
> occasion to point them out, but saying that something has to be corrected 
> just because it doesn't make logical or mathematical sense just seems as sill 
> as some of the phrases that we laugh about being logically inconsistent.
> 
> 
> 
> 
> On Thu, Apr 16, 2020 at 2:35 AM Owen DeLong  <mailto:o...@delong.com>> wrote:
> 24x7 is way more common, but does leave ambiguity as to holiday coverage. 
> (there are some 24x7 businesses that close for holidays).
> 
> 24x7x365 is on the rise as a way to specify that you’re open holidays too.
> 
> End of the day, I’m not sure it matters which one you use.
> 
> Likely any Google search for 24x7 would return the superset {24x7,24x7x365} 
> while a search for 24x7x365 would return the subset {24x7x365}.
> 
> IANASEOE, but I suspect that in terms of SEO and general search, you’re 
> probably better off with 24x7x365.
> 
> Owen
> 
> 
>> On Apr 16, 2020, at 01:25 , Mike Hale > <mailto:eyeronic.des...@gmail.com>> wrote:
>> 
>> No.  24x7x365 is fine.  Sheesh.
>> 
>> On Wed, Apr 15, 2020, 10:10 PM Ben Cannon > <mailto:b...@6by7.net>> wrote:
>> So I’m taking this thread for a total test-drive and we’re going down this 
>> random ally...
>> 
>> I call our NOC “24x7x365”  I hear that in my head as “twenty-four (hour) - 
>> BY - Seven (days a week) - BY - 365 (days a year, indicating we don’t close 
>> on any holidays).
>> 
>> Is that really not a thing?  I swear I’ve been hearing it as a term of art 
>> in the industry for 20 years.Google has 1.42m results for 24x7x365 - but 
>> 72mil for 24x7.
>> 
>> Should I change my website or what?
>> 
>> Thanks for indulging me :)
>> 
>> -Ben.
>> 
>> 
>> -Ben Cannon
>> CEO 6x7 Networks & 6x7 Telecom, LLC 
>> b...@6by7.net <mailto:b...@6by7.net>
>> 
>> 
>> 
>> 
>>> On Apr 15, 2020, at 5:45 AM, Rich Kulawiec >> <mailto:r...@gsp.org>> wrote:
>>> 
>>> Your home page says that you have 24x7x365 support.
>>> 
>>> (Which is wrong, by the way.  It's either 24x7 or 24x365
>>> or maybe 24x7x52 depending on what you're trying to express.
>>> There is no such thing as 24x7x365.  But let's press on:)
>> 
>> (Rich’s excellent critique deleted for brevity)
>>> ---rsk
>>> 
>> 
> 
> 
> 
> -- 
> - Forrest

24x7 vs 24x7x365 Re: Constant Abuse Reports / Borderline Spamming from RiskIQ

[Ben Cannon]

So I’m taking this thread for a total test-drive and we’re going down this 
random ally...

I call our NOC “24x7x365”  I hear that in my head as “twenty-four (hour) - BY - 
Seven (days a week) - BY - 365 (days a year, indicating we don’t close on any 
holidays).

Is that really not a thing?  I swear I’ve been hearing it as a term of art in 
the industry for 20 years.Google has 1.42m results for 24x7x365 - but 72mil 
for 24x7.

Should I change my website or what?

Thanks for indulging me :)

-Ben.


-Ben Cannon
CEO 6x7 Networks & 6x7 Telecom, LLC 
b...@6by7.net <mailto:b...@6by7.net>




> On Apr 15, 2020, at 5:45 AM, Rich Kulawiec  wrote:
> 
> Your home page says that you have 24x7x365 support.
> 
>   (Which is wrong, by the way.  It's either 24x7 or 24x365
>   or maybe 24x7x52 depending on what you're trying to express.
>   There is no such thing as 24x7x365.  But let's press on:)

(Rich’s excellent critique deleted for brevity)
> ---rsk
> 

Re: Constant Abuse Reports / Borderline Spamming from RiskIQ

[Ben Cannon]

We’ve got a 24/7 NOC and respond to abuse reports in either real-time in as 
close to real-time as we can, I’d send another message if it went 24 hours 
without a reply too. We also have a ticket system that replies immediately so 
they know the e-mail went through, and we track it like a real company that 
does real things.

-Ben

> On Apr 13, 2020, at 10:46 AM, Kushal R.  wrote:
> 
> 
> All abuse reports that we receive are dealt within 48 business hours. As far 
> as that tweet is concerned, it’s pending for 16 days because they have been 
> blocked from sending us any emails due to the sheer amount of emails they 
> started sending and then our live support chats.
> 
> We send our abuse reports to, but we don’t spam them to every publicly 
> available email address for an organisation, it isn’t difficult to lookup the 
> Abuse POC for an IP or network and just because you do not get a response in 
> 24 hours does not mean you forward the same report to 10 other email 
> addresses. Similarly twitter isn’t a place to report abuse either. 
> 
> 
>> On Apr 13, 2020 at 9:37 PM,  wrote:
>> 
>>   
>>  On Mon, Apr 13, 2020 at 07:55:37PM +0530, Kushal R. wrote:  >  We 
>> understand these reports and deal with them as per our policies and 
>> timelines but this constant spamming by them from various channels is not 
>> appreciated. Quoting from: 
>> https://twitter.com/RiskIQ_IRT/status/1249696689985740800 which is dated 
>> 9:15 AM 4/13/2020: 5 #phishing URLs on admin12.find-textbook[.]com were 
>> reported to @Host4Geeks (Walnut, CA) from as far back as 16 days ago, and 
>> they are all STILL active 16 days is unacceptable. If you can't do better 
>> than that -- MUCH better -- then shut down your entire operation today as 
>> it's unworthy of being any part of the Internet community. ---rsk  
>>  

Re: Command and Control Centres | COVID-19

[Ben Cannon]

We are leaving it at everyone’s discretion where we can. We have a big open 
pair of GNOCs with nobody closer than 6 feet by far, and with one or two people 
in each while everyone else is WFH, it’s essentially the run of the place.  

Anything that can be done at home is generally encouraged - even before this.  

So it’s really only the very sensitive ops that are even noticing.

-Ben

> On Apr 6, 2020, at 7:51 AM, Scott E. MacKenzie  wrote:
> 
> All,
> 
> This question has arisen and I was wondering if I could request some
> feedback from the community.  We operate a 24x7x365 Command and
> Control Centre that provides mission critical services (Security
> Operations, Network Operations, and Enterprise Management) as does
> many on this list.
> 
> How many on the list have sent all personnel home using work from home
> practices and home many have opted to run skeleton crews while
> implementing tight social distancing restrictions?  How many are
> operating status quo?
> 
> We are trying to find a balanced position and I was wondering what is
> the communities position on this topic?
> 
> 
> Scott

Re: New Jersey dark fiber

[Ben Cannon]

Love it, great resource Mehmet! 

-Ben

> On Mar 31, 2020, at 8:29 AM, Mehmet Akcin  wrote:
> 
> 
> hi Ben,
> 
> https://live.infrapedia.com - free & open source platform has more than 3 
> other alternatives in this area, please take a look.
> 
> new beta https://beta.infrapedia.com 
> 
>> On Tue, Mar 31, 2020 at 8:22 AM Ben Cannon  wrote:
>> Zayo and Crown both no-bid it, and crown has the old lighttower network.  
>> Are there any other dependable players for dark in south central NJ?
>> 
>> -Ben

New Jersey dark fiber

[Ben Cannon]

Zayo and Crown both no-bid it, and crown has the old lighttower network.  Are 
there any other dependable players for dark in south central NJ?

-Ben

Re: rack rails

[Ben Cannon]

2-post racks (typically 23" not 19” however 19 is making a dent) are still very 
common in MPOE rooms and OSP plant termination.Minimal space consumption is 
the prime reason.

Frankly most fiber patch panels are a foot deep and DWDM gear has been designed 
to be that profile too.

Many carriers bring their own seismic-rated 2-post solutions (think ILECs and 
some of the bigger CLECs) and continue to specify that to this day.

However all new datacenters we build from the ground up, as much as possible, 
are individual locking 4-post cabs for every application.

-Ben.

-Ben Cannon
CEO 6x7 Networks & 6x7 Telecom, LLC 
b...@6by7.net <mailto:b...@6by7.net>




> On Mar 30, 2020, at 2:31 PM, Coy Hile  wrote:
> 
> 
> 
>> On Mar 30, 2020, at 5:24 PM, Karsten Elfenbein  
>> wrote:
>> 
>> Hi,
>> 
>> something like https://www.opencompute.org/projects/rack-and-power
>> comes into my mind for that.
>> Mounting on 4 posts should be the default. It is insane what some
>> vendors want to mount on 2 posts only.
>> 
> 
> That brings up an interesting question. As I understand it, the penchant for 
> two-post mounts come from what are at least colloquially termed telco racks 
> that are or were common when you had tons of modem banks and such. Are such 
> mounts — much like DC power — still quite common in the service provider 
> space, or do most use more or less normal racks? (That said, the 750mm wide 
> (29.5in) racks that actually have room for high density cables inside the 
> rack seem much more useful for a networking application than the 600mm wide 
> version.)
> 
> 
> 
> --
> Coy Hile
> coy.h...@coyhile.com
> 
> 
> 
> 

Re: CISA critical infrastructure letters

[Ben Cannon]

Disaster Service Workers are different - see this link for information on DSWs, 
which are typically Government employees that have had special training and 
swearing-in.  They are not (necessarily) telecom workers but telecom workers 
may be DSWs.

Information on current status of DSWs in CA during this emergency:  
https://www.caloes.ca.gov/cal-oes-divisions/administrative-services/disaster-service-worker-volunteer-program


-Ben Cannon
CEO 6x7 Networks & 6x7 Telecom, LLC 
b...@6by7.net <mailto:b...@6by7.net>




> On Mar 25, 2020, at 11:36 AM, Tim Požár  wrote:
> 
> They are so open ended, they are really useless.  Not sure why they didn't 
> issue this with a company affiliation, etc to nail it down to say credentials 
> that the person may have with them.
> 
> Back in my Broadcast Engineering days, I would get passes issued by the local 
> LE such as the SF Police department or as a "Registered Disaster Service 
> Worker" issued by the State of California.  Each of these would have my name, 
> photo etc.  These were respected and got me through numerous police lines in 
> the past.
> 
> https://www.lns.com/house/pozar/laminates/
> 
> On 3/25/20 11:20 AM, Sean Donelan wrote:
>> The CISA critical infrastructure letters are a courtesy request letter. If 
>> people abuse its purpose, local officials do not need to extend any courtesy 
>> and can deny access.
>> The CISA letter is only for "providing emergency communications sustainment 
>> and restoration support to critical communications infrastructure 
>> facilities."
>> It is NOT a general purpose, ignore anything or go anywhere letter.
>> Do NOT abuse the courtesy or no one will extend the courtesy.

California full facilities CLEC

[Ben Cannon]

Need a small yet large COVID traffic load related favor from a California 
Full-Facilities CLEC/CLC, pls contact me off list if you can help.   Connecting 
at-risk citizens.

-Ben

Re: DHS letters for fuel and facility access

[Ben Cannon]

It flabbergasts me to no end that nobody simulated the actual incident they are 
guarding against.

But I guess that’s why we run telecom companies.

Diesel piston generators need to be run for 30min every 30 (absent engineer 
calcs permitting lower, but, why).

You should also consider a pull and re-strike on that breaker 3 times.

Most transmission level circuit breakers will auto-retry 3x then quit if they 
trip each time. 

Your ATS should smooth this, but that function needs to get tested too.

Things you learn in heavy civil construction that you don’t necessarily learn 
in telecom even.

-Ben

> On Mar 18, 2020, at 9:58 AM, Paul Nash  wrote:
> 
> You just have to make sure that you test the right thing.
> 
> In a former life I was an electrical engineer. My first job was with a 
> consulting engineering firm; out biggest customer was the biggest supermarket 
> chain in South Africa.  One of my tasks was to travel to one of their stores 
> each Saturday after closing (those were the days when they closed at noon on 
> a Saturday until Monday morning) and test their stand generators.
> 
> The manager’s idea was usually to press the start button, check that the big 
> diesel started, then shut down and go home.  My idea was to pull the main 
> incoming breaker.  9 times out of 10 on first visit, the diesel would start, 
> and then die as soon as the load kicked in because of carbon buildup in the 
> cylinders.
> 
> After discussions with the supermarket management, they decided to (a) have 
> all the diesels serviced ASAP, and (b) adopt my protocol of start diesel, 
> wait for it to come under load, run for at least 30 minutes to get up to heat 
> and clear the carbon deposits.
> 
> I use a similar technique for failover tests on servers, routers, firewalls — 
> pull the power cord and see what happens, pull the incoming network and see 
> what happens.
> 
> This was stymied by a recent network outage where the ISP network was up and 
> running, connected back to their local PoP and thence to their backbone, but 
> connectivity from that network to the critical servers was down.  So now we 
> test end-to-end that the server is reachable, and let the network fail over 
> if not.
> 
>paul
> 
>> On Mar 18, 2020, at 11:56 AM, Karl Auer  wrote:
>> 
>> An untested emergency system has to be regarded as a non-existent
>> emergency system.
>> 
>> No matter how painful it is to test, no matter how expensive it is to
>> test, the pain and the expense are nothing compared to the pain and
>> expense of having an actual emergency and discovering that the
>> emergency system doesn't work...
>> 
>> Multiplied by infinity if it costs lives.
>> 
>> Regards, K.
>> 
>> -- 
>> ~~~
>> Karl Auer (ka...@biplane.com.au)
>> http://www.biplane.com.au/kauer
>> http://twitter.com/kauer389
>> 
>> GPG fingerprint: 2561 E9EC D868 E73C 8AF1 49CF EE50 4B1D CCA1 5170
>> Old fingerprint: 8D08 9CAA 649A AFEF E862 062A 2E97 42D4 A2A0 616D
>> 
>> 
> 

Re: DHS letters for fuel and facility access

[Ben Cannon]

It’s true, we’re all here, and we’re standing by.  Also if anyone on NANOG 
needs something we can do, please reach out to me via email and I will make it 
happen.  You’re not alone during times of crisis.
-Ben.

-Ben Cannon
CEO 6x7 Networks & 6x7 Telecom, LLC 
b...@6by7.net <mailto:b...@6by7.net>




> On Mar 16, 2020, at 4:24 PM, George Herbert  wrote:
> 
> 
> The SF Bay Area shelter in place rules specifically exempt news media, 
> telecommunications and internet including infrastructure services thereof 
> (presumably large internet companies, network and security vendors, etc), 
> fuel deliveries.
> 
> I could use infrastructure vendors excuse but $current_client_company is on 
> mandatory WFH for next five weeks and team had filtered out doing it 
> informally before it became official.  
> 
> I’d name the company but someone might contact me for an emergency and I have 
> nothing to do with the customer incidents team.  I don’t even know who to 
> forward stuff to.  Suffice it to say that everyone doing network security 
> infra at all the vendors is being as safe as possible under the 
> circumstances.  We’re trying to keep all the lights on for you.
> 
> 
> -George 
> 
> Sent from my iPhone
> 
>> On Mar 16, 2020, at 1:21 PM, Sean Donelan  wrote:
>> 
>> 
>> On some other mailing lists, FCC licensed operators are reporting they have 
>> received letters from the Department of Homeland Security authorizing 
>> "access" and "fuel" priority.
>> 
>> Occasionally, DHS issues these letters after natural disasters such as 
>> hurricanes for hospitals and critical facilities.  I haven't heard of them 
>> issued for pandemics.
>> 

Re: DHS letters for fuel and facility access

[Ben Cannon]

We (Verizon not me) lost a central office during 9/11 because it ran out of 
fuel - the tankers were staged but we’re not allowed to enter Manhattan.  

This clears that pathway for us now, and it’s fairly standard protocol since.

-Ben

> On Mar 16, 2020, at 1:20 PM, Sean Donelan  wrote:
> 
> 
> On some other mailing lists, FCC licensed operators are reporting they have 
> received letters from the Department of Homeland Security authorizing 
> "access" and "fuel" priority.
> 
> Occasionally, DHS issues these letters after natural disasters such as 
> hurricanes for hospitals and critical facilities.  I haven't heard of them 
> issued for pandemics.
> 

Re: China’s Slow Transnational Network

[Ben Cannon]

oops. missed a spot.

-Ben Cannon
CEO 6x7 Networks & 6x7 Telecom, LLC 
b...@6by7.net <mailto:b...@6by7.net>




> On Mar 2, 2020, at 2:36 PM, David Burns  wrote:
> 
> Did you compare CERNET with commodity networks?  (My anecdotal observations 
> from a couple years ago suggest that Internet2 to CERNET is very good when 
> other paths are poor to unusable.)
> 
> --David Burns

Re: COVID-19 vs. our Networks

[Ben Cannon]

Oh they do, we just don’t like having to explain to our customers anything 
other than “we’ve fixed it before you called.”  I hate downtime.


-Ben Cannon
CEO 6x7 Networks & 6x7 Telecom, LLC 
b...@6by7.net <mailto:b...@6by7.net>




> On Mar 12, 2020, at 12:04 PM, Fletcher Kittredge  wrote:
> 
> 
> Ben;
> 
> I am sure your SLA's have force majeure clauses. I mean, they must, right?
> 
> 
> On Thu, Mar 12, 2020 at 2:57 PM Ben Cannon  <mailto:b...@6by7.net>> wrote:
> We’ve already had 1 building delay us access pushing us into an SLA breach 
> due to COVID-19 fuckups. I mean “procedures".
> -Ben.
> 
> -Ben Cannon
> CEO 6x7 Networks & 6x7 Telecom, LLC 
> b...@6by7.net <mailto:b...@6by7.net>
> 
> 
> 
> 
>> On Mar 12, 2020, at 10:22 AM, g...@1337.io <mailto:g...@1337.io> 
>> mailto:li...@1337.io>> wrote:
>> 
>> With talk of there being an involuntary statewide (WA) and then national 
>> quarantines (house arrest) for multiple weeks, has anyone put thought into 
>> the impacts of this on your networks if/when this comes to fruition? 
>> 
>> We're already pushing the limits with telecommuters / those that are WFH, 
>> but I can only imagine what things will look like with everyone stuck at 
>> home for any duration of time.
> 
> 
> 
> -- 
> Fletcher Kittredge
> GWI
> 207-602-1134
> www.gwi.net <http://www.gwi.net/>

Re: AT is suspending broadband data caps for home internet customers due to coronavirus

[Ben Cannon]

Effing. This.

-Ben

> On Mar 12, 2020, at 11:16 PM, Mark Tinka  wrote:
> 
> 
> 
>> On 13/Mar/20 02:02, Clayton Zekelman wrote:
>> 
>> 
>> 
>> No they didn't do the right thing.   The right thing would have been
>> to eliminate the caps a decade ago.
> 
> Don't get me started on this :-).
> 
> Mark.

Re: COVID-19 vs. our Networks

[Ben Cannon]

We’ve already had 1 building delay us access pushing us into an SLA breach due 
to COVID-19 fuckups. I mean “procedures".
-Ben.

-Ben Cannon
CEO 6x7 Networks & 6x7 Telecom, LLC 
b...@6by7.net <mailto:b...@6by7.net>




> On Mar 12, 2020, at 10:22 AM, g...@1337.io  wrote:
> 
> With talk of there being an involuntary statewide (WA) and then national 
> quarantines (house arrest) for multiple weeks, has anyone put thought into 
> the impacts of this on your networks if/when this comes to fruition? 
> 
> We're already pushing the limits with telecommuters / those that are WFH, but 
> I can only imagine what things will look like with everyone stuck at home for 
> any duration of time.

Re: akamai yesterday - what in the world was that

[Ben Cannon]

Akamai and it’s customers do not have all content at all locations, nor is 
their routing always consistent, however you may be able to reach out to them 
to level this.


-Ben Cannon
CEO 6x7 Networks & 6x7 Telecom, LLC 
b...@6by7.net <mailto:b...@6by7.net>




> On Mar 10, 2020, at 3:14 PM, Bryan Holloway  wrote:
> 
> We hit over 40G on one of our PNIs.
> 
> Currently, however, I'm trying to figure out why we're still seeing a 
> significant amount of traffic over transit when we have PNIs at the same 
> locations ...
> 
> I've reached out to Akamai, but I haven't heard anything back yet. I'm sure 
> they're busy ...
> 
> 
> On 3/10/20 10:14 PM, Aaron Gould wrote:
>> Wow, yeah, my Akamai servers are again, hitting all time highs… one cache 
>> hit up to ~30 gig… been ramping up and down since this morning around 9 or 
>> 10 a.m. central time.
>> Here’s a strange thing though, around 14:45 – 15:30, I got massive outbound 
>> on my internet connection (~20 gbps), and I never send that much out to the 
>> internet
>> -Aaron

Re: China’s Slow Transnational Network

[Ben Cannon]

It’s the Government doing mandatory content filtering at the border.  Their 
hardware is either deliberately or accidentally poor-performing.

I believe providing limited and throttled external connectivity may be 
deliberate; think of how that curtails for one thing; streaming video? 

-Ben.

-Ben Cannon
CEO 6x7 Networks & 6x7 Telecom, LLC 
b...@6by7.net <mailto:b...@6by7.net>




> On Mar 1, 2020, at 9:00 PM, Pengxiong Zhu  wrote:
> 
> Hi all,
> 
> We are a group of researchers at University of California, Riverside who have 
> been working on measuring the transnational network performance (and have 
> previously asked questions on the mailing list). Our work has now led to a 
> publication in Sigmetrics 2020 and we are eager to share some
> interesting findings. 
> 
> We find China's transnational networks have extremely poor performance when 
> accessing foreign sites, where the throughput is often persistently
> low (e.g., for the majority of the daytime). Compared to other countries we 
> measured including both developed and developing, China's transnational 
> network performance is among the worst (comparable and even worse than some 
> African countries).
> 
> Measuring from more than 400 pairs of mainland China and foreign nodes over 
> more than 53 days, our result shows when data transferring from foreign nodes 
> to China, 79% of measured connections has throughput lower than the 1Mbps, 
> sometimes it is even much lower. The slow speed occurs only during certain 
> times and forms a diurnal pattern that resembles congestion (irrespective of 
> network protocol and content), please see the following figure. The diurnal 
> pattern is fairly stable, 80% to 95% of the transnational connections have a 
> less than 3 hours standard deviation of the slowdown hours each day over the 
> entire duration. However, the speed rises up from 1Mbps to 4Mbps in about 
> half an hour.
> 
> 
> 
> We are able to confirm that high packet loss rates and delays are incurred in 
> the foreign-to-China direction only. Moreover, the end-to-end loss rate could 
> rise up to 40% during the slow period, with ~15% on average.
> 
> There are a few things noteworthy regarding the phenomenon. First of all, all 
> traffic types are treated equally, HTTP(S), VPN, etc., which means it is 
> discriminating or differentiating any specific kinds of traffic. Second, we 
> found for 71% of connections, the bottleneck is located inside China (the 
> second hop after entering China or further), which means that it is mostly 
> unrelated to the transnational link itself (e.g., submarine cable). Yet we 
> never observed any such domestic traffic slowdowns within China.
> Assuming this is due to congestion, it is unclear why the infrastructures 
> within China that handles transnational traffic is not even capable to handle 
> the capacity of transnational links, e.g., submarine cable, which maybe the 
> most expensive investment themselves.
> 
> Here is the link to our paper:
> https://www.cs.ucr.edu/~zhiyunq/pub/sigmetrics20_slowdown.pdf 
> <https://www.cs.ucr.edu/~zhiyunq/pub/sigmetrics20_slowdown.pdf>
> 
> We appreciate any comments or feedback. 
> -- 
> 
> Best,
> Pengxiong Zhu
> Department of Computer Science and Engineering
> University of California, Riverside

Re: ATT Microcell in Austin, TX

[Ben Cannon]

Most of the small or micro cells are there to add data capacity not necessary 
device count, which are two different things.  

However, where they are added to augment device count we will have problems if 
they are not backed up.

As the tech shrinks and battery tech improves this will become solvable, but we 
are a ways out still.

-Ben

> On Feb 18, 2020, at 8:45 AM, sro...@ronan-online.com wrote:
> 
> The feasibility of back hauling power from a central location is almost 
> zero. Conduit can be direct buried and then fiber shot through it, this would 
> be almost impossible with DC power cables.
> 
> Keep in mind that WPS already provides priority to “priority” traffic.
> 
> Shane
> 
> Sent from my iPhone
> 
>>> On Feb 18, 2020, at 11:09 AM, Darin Steffl  wrote:
>>> 
>> 
>> Matt, 
>> 
>> You're correct that if most of these small cells goes offline during a power 
>> outage, the remaining macro cells would not be able to handle the load well. 
>> 
>> Data would be nearly useless and phone/texts may be sporadic. 
>> 
>> I believe that when this happens, they should proactively block or limit 
>> video and file download/upload traffic as much as possible to make sure 
>> communications like calls and texts can go through with the highest success 
>> rate possible. Netflix and YouTube should never hinder more important 
>> communications in my opinion. Maybe it's as simple as putting a rate limit 
>> for each cellphone connected to these now overloaded sectors so no one can 
>> hog the cell capacity.
>> 
>> It would be pretty sweet though if small cells all had a linked power source 
>> following the same fiber paths that all hook back into a large battery 
>> backup or generator somewhere. Maybe 30-40 small cells can have backup power 
>> from one macro cell generator. I'm not sure if they're installed that way or 
>> not but it would ideal. Otherwise, you're losing 10 to 100x of the capacity 
>> of a cell network during power outages if the small cells go down. 
>> 
>>> On Tue, Feb 18, 2020, 9:46 AM Matt Erculiani  wrote:
>>> It will be interesting to see how this plays out as reliance on these small 
>>> cells for capacity grows. I'd imagine demand for cellular bandwidth goes up 
>>> during a power outage and not down. 
>>> 
>>> Is it reasonable to think that there could be a situation where cell 
>>> capacity is not available during a time of need because these sites will 
>>> simply go down and significantly reduce coverage/quality in dense 
>>> metropolitan areas?
>>> 
>>> -Matt
>>> 
 On Sun, Feb 16, 2020, 19:15 Shane Ronan  wrote:
 This is a small cell. They are very common across all of the carriers.
 
 It is NOT intended to provide primary coverage for the area.
 
 It IS intended to provide additional capacity to the immediate area.
 
 Think of the large cell towers as providing blanket coverage, while small 
 cells provide hot spots of increased capacity.
 
 Most small cells have no battery backup or generator at all, as it's not 
 feasible given the real estate available.
 
> On Sun, Feb 16, 2020, 5:58 PM Chris Boyd  wrote:
> Since people on here like to talk about the generatorn run time on cell 
> towers, I thought y’all might like to see an ATT microcell in downtown 
> Austin, TX.  No apparent generator or battery on it.
> 
> https://imgur.com/a/RY9Tg7h
> 
> —Chris

Re: Reminiscing our first internet connections (WAS) Re: akamai yesterday - what in the world was that

[Ben Cannon]

First non-POTS was an Ascend Pipeline 50.  I may even still have it somewhere.

-Ben Cannon
CEO 6x7 Networks & 6x7 Telecom, LLC 
b...@6by7.net <mailto:b...@6by7.net>




> On Feb 17, 2020, at 12:07 PM, Brian  wrote:
> 
>> On Feb 17, 2020, at 10:38 AM, Gene LeDuc  wrote:
> 
> Does this thread make me not only think about the days of old, but also
> makes me feel older! Not going back as far as some here but around
> 1993ish...
> 
> My first connection back in the day was a shell account I was given as
> consultant and reseller for what was TIAC (then became PSI). I was also
> at the time running a 6 line MajorBBS system (prior to WorldGroup). TIAC
> allowed multiple concurrent logins to the shell so I purchased the
> MajorBBS dialout module and had it login to my shell account which my
> cosysop crafted a nice menu for basic feature usage such as
> ftp/lynx/irc/etc. Users could then use my dialout feature into my shell
> and do what they were looking to do. 
> 
> Being somewhat out in the sticks and having a decent dial area coverage
> it in a sense allowed me to become my local region's first ISP of sorts.
> It was a hack but it worked and users were more than happy since for
> many even dialing up to AOL or Compuserve was a toll call then.
> 
> -- 
> If Confucius were alive today:
> "A computing device left in the OFF power state never crashes" 
> -
> 73 de Brian N1URO
> IPv6 Certified
> SMTP: n1uro-at-n1uro.ampr.org
> 
> 

Re: Reminiscing our first internet connections (WAS) Re: akamai yesterday - what in the world was that

[Ben Cannon]

Right??  That’s in a customer’s office building too… I’ve got the same 
connection on my workstation of course.

I actually have another test that I don’t normally share.  It’s NOT fake.  I 
found out that the speedtest algorithm rounds to the nearest whole millisecond. 
 And that it will round DOWN below 400ns… 

A friend, being kind of sassy, said recently “Hey Ben, so like when you got the 
10g, did you just like, download all of Netflix?”  And I had to pause and give 
a semi serious reply, where I said “Actually no… Because we’ve got a Netflix 
Openconnect in SF2 that has like 80g into the fabric, and we’ve got 100g into 
there, and even over the 10g to my desktop, that’s still faster than my SSD.  
So no, I’m not going to be downloading all of Netflix.  The internet is my LAN, 
I already have…"

(It’s honestly all so cool that I wake up every day without an alarm clock, and 
*run* downstairs to do what I do.   Best job in the world.)

-Ben Cannon
CEO 6x7 Networks & 6x7 Telecom, LLC 
b...@6by7.net <mailto:b...@6by7.net>




> On Jan 25, 2020, at 8:29 PM, Aaron Gould  wrote:
> 
> I love the symmetric ~10 gig speed test to put it into perspective for how 
> far we’ve come….also the 3 ms ping result.  Ain’t it great
>  
> -Aaron
>  
> From: Ben Cannon [mailto:b...@6by7.net <mailto:b...@6by7.net>] 
> Sent: Friday, January 24, 2020 5:27 PM
> To: b...@theworld.com <mailto:b...@theworld.com>
> Cc: Aaron Gould; NANOG Operators' Group
> Subject: Reminiscing our first internet connections (WAS) Re: akamai 
> yesterday - what in the world was that
>  
> I started what became 6x7 with a 64k ISDN line.   And 9600 baud modems…   
>  
> in ’93 or so.  (I was a child, in Jr High…)
>  
> -Ben.
>  
>  
> -Ben Cannon
> CEO 6x7 Networks & 6x7 Telecom, LLC 
> b...@6by7.net <mailto:b...@6by7.net>
>  
> 
> 
>  
>> On Jan 24, 2020, at 3:21 PM, b...@theworld.com <mailto:b...@theworld.com> 
>> wrote:
>>  
>> 
>> On January 24, 2020 at 08:55 aar...@gvtc.com <mailto:aar...@gvtc.com> (Aaron 
>> Gould) wrote:
>> 
>> Thanks Jared, When I reminisce with my boss he reminds me that this 
>> telco/ISP here initially started with a 56kbps internet uplink , lol
>> 
>> Point of History:
>> 
>> When we, The World, first began allowing the general public onto the
>> internet in October 1989 we actually had a (mildly shared*) T1
>> (1.544mbps) UUNET link. So not so bad for the time. Dial-up customers
>> shared a handful of 2400bps modems, we still have them.
>> 
>> * It was also fanned out of our office to a handful of Boston-area
>> customers who had 56kbps or 9600bps leased lines, not many.
>> 
>> -- 
>>-Barry Shein
>> 
>> Software Tool & Die| b...@theworld.com <mailto:b...@theworld.com>
>>  | http://www.TheWorld.com <http://www.theworld.com/>
>> Purveyors to the Trade | Voice: +1 617-STD-WRLD   | 800-THE-WRLD
>> The World: Since 1989  | A Public Information Utility | *oo*
> 
>  

Re: Backup over 4G/LTE

[Ben Cannon]

New player in this space is Ubiquiti: https://unifi-lte.ui.com - more suited 
for branch office applications IMO, but the setup couldn’t be easier.Expect 
this space to grow dramatically.


-Ben Cannon
CEO 6x7 Networks & 6x7 Telecom, LLC 
b...@6by7.net <mailto:b...@6by7.net>




> On Jan 28, 2020, at 3:41 PM, Brandon Svec  wrote:
> 
> All Cisco Meraki MX and Z units.  Some via USB and some with SIM slot.
> 
> https://meraki.cisco.com/products/appliances 
> <https://meraki.cisco.com/products/appliances>
> Security Made Simple with Cisco Meraki: http://bit.ly/MerakiSecure 
> <http://bit.ly/MerakiSecure>
> 
> Brandon Svec 
> CA C-7 Lic. #822064 
> <https://www.cslb.ca.gov/OnlineServices/CheckLicenseII/LicenseDetail.aspx?LicNum=822064>
> .ılı.ılı. Cisco Meraki CMNA
> 15106862204  voice | sms
> teamonesolutions.com <http://teamonesolutions.com/> 
> 14729 Catalina St. San Leandro, CA 94577
> 
> 
> 
> 
> 
> On Tue, Jan 28, 2020 at 3:31 PM K MEKKAOUI  <mailto:amekka...@mektel.ca>> wrote:
> Dear NANOG Community,
> 
>  
> 
> Can anyone help with any device information that provides redundancy for 
> business internet access? In other words when the internet provided through 
> the cable modem fails the 4G/LTE takes over automatically to provide internet 
> access to the client.
> 
>  
> 
> Thank you
> 
>  
> 
> KARIM M.
> 
>  
> 

Re: akamai yesterday - what in the world was that (now old guy stuff)

[Ben Cannon]

The Civil Engineering version of this is SWER electrical distribution.  
Single-Wire, Earth-Return. And it’s as crazy in implementation as it sounds now.




-Ben Cannon
CEO 6x7 Networks & 6x7 Telecom, LLC 
b...@6by7.net <mailto:b...@6by7.net>




> On Jan 25, 2020, at 8:24 AM, Allen McKinley Kitchen (gmail) 
>  wrote:
> 
> On Jan 25, 2020, at 08:52, Paul Nash  wrote:
>> 
>> 
>>> 
>>> So, I grew up in South Africa, and one of the more fascinating /
>>> cooler things I saw was a modem which would get you ~50bps (bps, not
>>> Kbps) over a single strand of barbed wire -- you'd hammer a largish
>>> nail into the ground, and clip one alligator[0] clip onto that, and
>>> another alligator clip onto the barbed wire. Repeat the process on the
>>> other side (up to ~5km away), plug the modems in, and bits would
>>> flow... I only saw these used a few times, but always thought they
>>> were cool….
>> 
>> Do you remember anything about the actual type of modem?  Or where you 
>> deployed them?
>> 
> Decades ago, I cobbled together a 20mA current loop interface that may have 
> been an early version of this .. ran a set of Baudot machines (pre-ASCII, 
> upper case & figs only) mostly just to have fun with a set of old ASR 32 
> teletypes.  I used a couple of 500’ spools of zip cord lying on the ground 
> from end to end. Never mind backhoes - it was lawn-mower vulnerable. 
> (However, being flat on the ground seemingly made it less vulnerable to 
> lightning strikes.)
> 
> Of course, this was hardly critical infrastructure!
> 
> Blessings..
> 
> Allen

Re: Reaching out to Sony NOC, resolving DDoS Issues - Need POC

[Ben Cannon]

Transit carriers could work the flows backwards.

-Ben Cannon
CEO 6x7 Networks & 6x7 Telecom, LLC 
b...@6by7.net <mailto:b...@6by7.net>




> On Jan 27, 2020, at 4:39 PM, Mike Hammett  wrote:
> 
> If someone is being spoofed, they aren't receiving the spoofed packets. How 
> are they supposed to collect anything on the attack?
> 
> Offending host pretending to be Octolus -> Sony -> Real Octolus.
> 
> 
> 
> 
> -
> Mike Hammett
> Intelligent Computing Solutions
> http://www.ics-il.com <http://www.ics-il.com/>
> 
> Midwest-IX
> http://www.midwest-ix.com <http://www.midwest-ix.com/>
> 
> From: "Roland Dobbins"  <mailto:roland.dobb...@netscout.com>>
> To: "Octolus Development" mailto:ad...@octolus.net>>
> Cc: "Heather Schiller via NANOG" mailto:nanog@nanog.org>>
> Sent: Monday, January 27, 2020 6:29:16 PM
> Subject: Re: Reaching out to Sony NOC, resolving DDoS Issues - Need POC
> 
> 
> 
> On Jan 28, 2020, at 04:12, Octolus Development  <mailto:ad...@octolus.net>> wrote:
> 
> It is impossible to find the true origin of where the spoofed attacks are 
> coming from.
> 
> This is demonstrably untrue. 
> 
> If you provide the requisite information to operators, they can look through 
> their flow telemetry collection/analysis systems in order to determine 
> whether the spoofed traffic traversed their network; if it did so, they will 
> see where it ingressed their network. 
> 
> With enough participants who have this capability, it's possible to trace the 
> spoofed traffic back to its origin network, or at least some network or 
> networks topologically proximate to the origin network. 
> 
> That's what Damian is suggesting. 
> 
> 
> Roland Dobbins  <mailto:roland.dobb...@netscout.com>>

Re: akamai yesterday - what in the world was that

[Ben Cannon]

I mean I blame it on the inadequate capacity of Windstream to handle modern TCP 
traffic loads - but hey. You know. 

-Ben Cannon
CEO 6x7 Networks & 6x7 Telecom, LLC 
b...@6by7.net <mailto:b...@6by7.net>




> On Jan 25, 2020, at 11:35 AM, Darin Steffl  wrote:
> 
> Shouldn't game patches like this be released overnight during off-peak hours? 
> Fortnite releases their updates around 3 or 4am when most ISP's networks are 
> at their lowest utilization. It seems somewhat reckless to release such a 
> large patch during awake hours. 
> 
> On Sat, Jan 25, 2020, 12:08 PM Brandon Jackson via NANOG  <mailto:nanog@nanog.org>> wrote:
> "Call of Duty: Modern Warfare fragged our business VOIP: US ISP blames outage 
> on smash-hit video game rush
> This is Windstream, going dark..."
> https://www.theregister.co.uk/2020/01/23/windstream_fvoip_outage/ 
> <https://www.theregister.co.uk/2020/01/23/windstream_fvoip_outage/> 
> 
> Apparently not everyone came out unscathed.
> 
> --
> Brandon Jackson
> bjack...@napshome.net <mailto:bjack...@napshome.net>
> 
> On Thu, Jan 23, 2020 at 10:14 AM Aaron Gould  <mailto:aar...@gvtc.com>> wrote:
> My gosh, what in the word was that coming out of my local Akamai aanp servers 
> yesterday !?  starting at about 12:00 noon central time lasting several hours 
> ?
> 
>  
> 
> -Aaron
> 

Reminiscing our first internet connections (WAS) Re: akamai yesterday - what in the world was that

[Ben Cannon]

I started what became 6x7 with a 64k ISDN line.   And 9600 baud modems…   

in ’93 or so.  (I was a child, in Jr High…)

-Ben.


-Ben Cannon
CEO 6x7 Networks & 6x7 Telecom, LLC 
b...@6by7.net <mailto:b...@6by7.net>




> On Jan 24, 2020, at 3:21 PM, b...@theworld.com wrote:
> 
> 
> On January 24, 2020 at 08:55 aar...@gvtc.com (Aaron Gould) wrote:
>> Thanks Jared, When I reminisce with my boss he reminds me that this 
>> telco/ISP here initially started with a 56kbps internet uplink , lol
> 
> Point of History:
> 
> When we, The World, first began allowing the general public onto the
> internet in October 1989 we actually had a (mildly shared*) T1
> (1.544mbps) UUNET link. So not so bad for the time. Dial-up customers
> shared a handful of 2400bps modems, we still have them.
> 
> * It was also fanned out of our office to a handful of Boston-area
> customers who had 56kbps or 9600bps leased lines, not many.
> 
> -- 
>-Barry Shein
> 
> Software Tool & Die| b...@theworld.com | 
> http://www.TheWorld.com
> Purveyors to the Trade | Voice: +1 617-STD-WRLD   | 800-THE-WRLD
> The World: Since 1989  | A Public Information Utility | *oo*

Re: Dual Homed BGP

[Ben Cannon]

Honestly, this.  Your only real choice is what of 2 pipes to chuck it out of.

Full tables vs partial and a default don’t make the process much more 
intelligent for 1 site dual homed, and as mentioned routing policy will have 
more influence.

-Ben

> On Jan 24, 2020, at 8:47 AM, Mel Beckman  wrote:
> 
> It’s pretty pointless for a small ISP to get full routes, because the BGP 
> tables are so highly manipulated. It’s better to just get “company” routes 
> for each upstream, and then use your own traffic engineering via prepending 
> and static or policy routes to balance the outbound traffic the way you like. 
> 
> -mel 
> 
>> On Jan 24, 2020, at 8:40 AM, Brian  wrote:
>> 
>> 
>> Hello all. I am having a hard time trying to articulate why a Dual Home ISP 
>> should have full tables. My understanding has always been that full tables 
>> when dual homed allow much more control. Especially in helping to prevent 
>> Async routes.
>> 
>> 
>> Am I crazy? 

Re: 5G roadblock: labor

[Ben Cannon]

> 
> Why on earth would I want to send it anywhere at all over the Internet?
> 
> One already has to disassemble and inspect very closely almost all electronic 
> gadgets so that the internal embeded spyware microphone and camera and 
> wireless can be removed with pliers.  This is just another thing to inspect 
> for and forcibly disable.
> 

You realize that eventually your neighbors houses will all be wired and they’ll 
be able to get yours by differentiating the signals.

I’m not even half kidding.

-Ben Cannon
CEO 6x7 Networks & 6x7 Telecom, LLC 
b...@6by7.net <mailto:b...@6by7.net>

Re: breakout

[Ben Cannon]

This is another good way to go, make sure you have a single mode handoff from 
the IX (you should, but double check this, orange fiber and yellow fiber are 
very different physically in size and generally not compatible.

-Ben Cannon
CEO 6x7 Networks & 6x7 Telecom, LLC 
b...@6by7.net <mailto:b...@6by7.net>




> On Jan 8, 2020, at 11:20 AM, Matt Erculiani  wrote:
> 
> I think you're looking for an MTP breakout cable, rather than a QSFP28 
> breakout.
> 
> The MTP breakout requires separate optics, whereas the active breakout can 
> plug directly into a device's SFP+ ports.
> 
> Something like...
> 
> https://www.fs.com/products/24422.html 
> <https://www.fs.com/products/24422.html>
> And
> https://www.fs.com/products/41426.html 
> <https://www.fs.com/products/41426.html>
> 
> You'll also need to tell your device to break out it's 40 g into the 
> component 10g channels. Then they'll each get a distinct port number. 
> (Usually just a number appended to the parent port)
> 
> -Matt
> 
> On Wed, Jan 8, 2020, 12:10 Randy Bush mailto:ra...@psg.com>> 
> wrote:
> i am not a fiber/sfp/... geek, so clue bat please
> 
> on my left, i have a delta 9020SL running arcos, female 40g qsfp
> 
> on my right, i have incoming 10g 1310nm single mode from the seattle
> internet exchange.  it is currently into a redstone 10g sfp
> 
> NAMEVALUE
> -
> SwPort  1
> Status  PRESENT
> Valid   True
> Vendor  FiberStore
> Model   SFP-10GLR-31
> Serial-Number   G1804021292
> TypeSFP
> Module-Type 10G_BASE_SX
> Media-Type  FIBER
> Module-Capability   F_10G
> Length  255
> Length-Description
> 
> which i am swapping out for the delta 9020
> 
> so i am look at something such as https://www.fs.com/products/30900.html 
> <https://www.fs.com/products/30900.html>
> except i do not understand active/passive, AOC1M, etc
> 
> thanks in advance
> 
> randy

Re: breakout

[Ben Cannon]

AOC stands for Active Optical Cable, which means it’s really 4 SFP+ and a qsfp 
plus intermediate fiber all permanently attached.   1M is the length, 1 meter.

This is distinct from DAC (Direct Attach Cable) which is all copper (you don’t 
want these, fiber for one thing isolates ground/emi)

This cable won’t work for you without an intermediate switch (bad) because they 
both end in male SFP plug interface.

However, if you just need to use 10g of the 40g port, you can do it much 
cheaper and easier with just this part:

https://www.fs.com/products/72582.html

-Ben Cannon
CEO 6x7 Networks & 6x7 Telecom, LLC 
b...@6by7.net <mailto:b...@6by7.net>




> On Jan 8, 2020, at 11:09 AM, Randy Bush  wrote:
> 
> i am not a fiber/sfp/... geek, so clue bat please
> 
> on my left, i have a delta 9020SL running arcos, female 40g qsfp
> 
> on my right, i have incoming 10g 1310nm single mode from the seattle
> internet exchange.  it is currently into a redstone 10g sfp
> 
>NAMEVALUE
>-
>SwPort  1
>Status  PRESENT
>Valid   True
>Vendor  FiberStore
>Model   SFP-10GLR-31
>Serial-Number   G1804021292
>TypeSFP
>Module-Type 10G_BASE_SX
>Media-Type  FIBER
>Module-Capability   F_10G
>Length  255
>Length-Description
> 
> which i am swapping out for the delta 9020
> 
> so i am look at something such as https://www.fs.com/products/30900.html
> except i do not understand active/passive, AOC1M, etc
> 
> thanks in advance
> 
> randy

Re: 5G roadblock: labor

[Ben Cannon]

> The primary purpose seems to be barriers to entry and competition.

I could have told you that when I started a pirate FM radio station at 10.  
About limiting reach.   There are valid RF safety concerns, but that could be 
solved via other less draconian regulatory procedures.

That said, 10 watts vs 100mw.  It’s laughable.  5G/LTE is in another class from 
WiFi, not so much technically (but yes technically speaking as well) but from a 
regulatory perspective alone it’s a no brainer.   

A future hypothetical protocol could solve a lot of WiFi’s roaming capacity 
dead spot and penetration issues.  However the laws of physics will make even 
2.4 and especially 5Ghz behave more like light than “radio” we are familiar 
with from lower frequency transmission.

-Ben Cannon
CEO 6x7 Networks & 6x7 Telecom, LLC 
b...@6by7.net <mailto:b...@6by7.net>




> On Jan 2, 2020, at 2:32 AM, William Allen Simpson 
>  wrote:
> 
> On 1/1/20 10:35 AM, Brandon Butterworth wrote:
>> On Wed Jan 01, 2020 at 09:29:20AM -0500, jdambro...@gmail.com wrote:
>>> Given the deployment of Wi-Fi into so many different applications
>>> - your statement that 5G is to "replace" WiFi seems overly ambitious
>> We might think that but it is serious. They want to own it all
>> and there is a small cabal of operators owning the spectrum so
>> little room for new competitors.
> Deployed WiFi '5' (ac) and WiFi '6' (ax) already outperform mobile 5G.
> 
> If this were actually about performance, the standards would have
> converged.  And there wouldn't need to be so many additional patents.
> The primary purpose seems to be barriers to entry and competition.
> 
> 
>> [...]
>>> Perhaps preventing WiFi from further penetration is a better way
>>> to look at it?
>> If the mobile companies are providing the WiFi routers they can
>> control it (see LTE WiFi attempt) and one day replace it with
>> 5G or 6G in all the things. If they make a better job of it than
>> everyones devices fighting for 5GHz then they may succeed.
> Agreed.  In my previous job, having spent considerable time talking to
> various standards' body participants, "replace" was the word used.

Re: 5G roadblock: labor

[Ben Cannon]

I tend to agree, we’re putting our own compute under 1ms from every cell tower 
in every metro. 

What that means is 3 or 6 DCs in a big metro area, but not usually compute in 
towers.Other edge compute is interesting tho.  And the towers themselves 
are changing.  

We still have macro sites, but we will more than double the cell site count 
(400k to 1.2m) in the next 5 years and it will be small cells/DAS mostly.   
Those aren’t towers in the conventional sense.

-Ben.

-Ben Cannon
CEO 6x7 Networks & 6x7 Telecom, LLC 
b...@6by7.net <mailto:b...@6by7.net>




> On Jan 2, 2020, at 6:09 AM, Mike Hammett  wrote:
> 
> I know there are a couple companies doing it, but compute at the tower isn't 
> going to go anywhere. It makes very little sense to put it at the tower when 
> you can put it in one location per metro area.
> 
> 
> 
> -
> Mike Hammett
> Intelligent Computing Solutions
> http://www.ics-il.com <http://www.ics-il.com/>
> 
> Midwest-IX
> http://www.midwest-ix.com <http://www.midwest-ix.com/>
> 
> From: "Brandon Butterworth" 
> To: jdambro...@gmail.com
> Cc: "North American Network Operators Group" 
> Sent: Wednesday, January 1, 2020 9:35:15 AM
> Subject: Re: 5G roadblock: labor
> 
> On Wed Jan 01, 2020 at 09:29:20AM -0500, jdambro...@gmail.com wrote:
> > Given the deployment of Wi-Fi into so many different applications
> > - your statement that 5G is to "replace" WiFi seems overly ambitious
> 
> We might think that but it is serious. They want to own it all
> and there is a small cabal of operators owning the spectrum so
> little room for new competitors.
> 
> Here's a project we did exploring some of the ambition
> https://www.bbc.co.uk/rd/blog/2019-02-5g-mobile-augmented-reality-bath
> 
> Previously we avoided the old Telco CDNs by sticking to regular
> Internet CDNs and building our own but edge compute (mobile CDN
> but a better name to compete with AWS) is more insidious as you
> may not be able to get the same result from CDNs out on the net.
> 
> Either the content providers or the external CDNs they use will
> have to pay to use the mobile CDN. How they will scale that at all
> those sites will be interesting to see.
> 
> > Perhaps preventing WiFi from further penetration is a better way
> > to look at it?
> 
> If the mobile companies are providing the WiFi routers they can
> control it (see LTE WiFi attempt) and one day replace it with
> 5G or 6G in all the things. If they make a better job of it than
> everyones devices fighting for 5GHz then they may succeed.
> 
> brandon

Re: 5G roadblock: labor

[Ben Cannon]

5g protocol will of course eventually replace LTE simply because it makes 
better use of the real asset, spectrum.

5G is just a protocol it changes dramatically depending on spectrum.

-Ben

> On Dec 30, 2019, at 12:54 PM, Mike Hammett  wrote:
> 
> 
> I mean it's inevitable that 5G replaces 4G. It just comes down to the 
> spectrum the given carrier uses that dictates speed and range. In the US, 
> AT and Verizon are deploying in the millimeter bands. They'll do a gig at a 
> few hundred feet. T-Mobile is using 600 MHz, so it'll probably only do 100 
> megabit (based on the small channels they have), but it'll go 10+ miles 
> through nearly anything. Sprint is in the middle. They'll be able to do 
> hundreds of megs at miles of range.
> 
> 
> Lower latency is another advantage of 5G.
> 
> 
> 
> -
> Mike Hammett
> Intelligent Computing Solutions
> http://www.ics-il.com
> 
> Midwest-IX
> http://www.midwest-ix.com
> 
> From: "Matt Hoppes" 
> To: "Shane Ronan" , "Mark Tinka" 
> 
> Cc: "North American Network Operators' Group" 
> Sent: Monday, December 30, 2019 2:12:13 PM
> Subject: Re: 5G roadblock: labor
> 
> What are the other benefits of 5G?   My 4G/LTE works when I go behind 
> things, miles from the tower, and delivers between 5 and 20 megabits 
> which is more than enough for anything I'm doing on a mobile device.
> 
> On 12/30/19 3:10 PM, Shane Ronan wrote:
> > If you are looking at speed as the only benefit to 5G, you are missing 
> > out on many of the other benefits.
> > 
> > And as far as WiFi goes, let me know when we have seamless national WiFi 
> > roaming and handoffs, because only at that point will it beat 5G.
> > 
> > Shane
> 

Re: power to the internet

[Ben Cannon]

-48VDC is extremely reliable, we have also never had a power incursion on our 
DC plant. Any of them. 

I’m not sure I’d consider it cheap, but it’s not horrifying expensive and it 
*works* when you deploy enough of it in a 2 or 3N fashion.

-Ben

> On Dec 28, 2019, at 9:04 AM, Baldur Norddahl  
> wrote:
> 
> 
> What is wrong with lead acid battery backup? Seems to be exceedingly stable 
> from my experience. We have all our equipment on -48V DC and have never had a 
> power interruption at any site.
> 
> The requirements here are 48 hours of backup by law. Telecom is declared to 
> be part of emergency and defense, so they put in a requirement for 
> resilience. 
> 
> Regards 
> 
> Baldur 
> 
> 
> tor. 26. dec. 2019 11.33 skrev Joe Maimon :
>> Unless telecom infrastructure has been diligently changing out the lead 
>> acid battery approach at all their remote terminals, powered gpon, hfc 
>> and antennae plants will never last more than minutes. If at all.
>> 
>> A traditional car has between a 100-200amp alternator @12volts
>> 
>> How much generating capacity can you get out of a typical hybrid?
>> 
>> Self-isolating and re-tieing inverters. Economic household ATS systems. 
>> Do those exist?
>> 
>> Enough independent distributed capacity and now comes the ability to 
>> create grid islands. How might that look?
>> 
>> Electric grid shortage is likely coming to NYC, courtesy of folk of 
>> certain political persuasion and their love of stone age era living. IP 
>> decommissioning.
>> 
>> If you have CO loop copper, keep it.
>> 
>> Joe
>> 
>> Don Gould wrote:
>> > This is a very short term problem.
>> >
>> > The market is going to fill with battery storage sooner rather than 
>> > later.
>> >
>> > Solar is just exploding.
>> >
>> > Your car will "house tie".
>> >
>> > 6G will solve your data problem.
>> >
>> > D
>> >
>> >
>> >
>> > -- 
>> > Don Gould
>> > 5 Cargill Place
>> > Richmond
>> > Christchurch, New Zealand
>> > Mobile/Telegram: + 64 21 114 0699
>> > www. bowenvale.co.nz
>> >
>> >
>> >
>> >  Original message 
>> > From: Michael Thomas 
>> > Date: 26/12/19 2:33 PM (GMT+12:00)
>> > To: nanog@nanog.org
>> > Subject: power to the internet
>> >
>> >
>> > https://www.politico.com/news/2019/12/25/california-power-shutoffs-089678
>> >
>> >
>> > This article details some of the issues with California's "new reality"
>> > of planned blackouts. One of the big things that came to light with
>> > these blackouts is that our network infrastructure's resilience is
>> > pretty lacking. While I was (surprisingly to me) ok with my DSL
>> > connection out in the boonies, lots and lots of people with cable
>> > weren't so lucky. And I'm not sure how bad the situation is with
>> > cellular infrastructure, but I assume it's not much better than cable.
>> > And I wouldn't doubt that other DSL deployments go dark when power is
>> > down. I have no clue with fiber.
>> >
>> > So I guess what I'm wondering is what can we do about this? What should
>> > we do about this? These days IP access is not just convenience, it's the
>> > way we go about our lives, just like electricity itself. At base, it
>> > seems to me that network operators should be required to keep the lights
>> > on in blackouts just like POTS operators do now. If I have power to
>> > light my modem or charge in my phone, I should be able to get onto the
>> > net. That seems like table stakes.
>> >
>> > One of the things we learned also is that the blackouts seem to last
>> > between 2-3 days apiece. I happen to have a generator since I'm out in
>> > the boonies and our power gets cut regularly because of snow, but not
>> > everyone has that luxury. I kind of want to think that my router+modem
>> > use about 20 watts, so powering it up would take about 1.5kwh for 3
>> > days. a quick google look shows that I'd probably need to shell out $500
>> > or so for a battery of that capacity, and that's doesn't include your
>> > phones, laptops, tv's, etc power needs. What does that mean? That is a
>> > major expense for a lot of people.
>> >
>> > On the bright side, I hear that power generator companies stocks have
>> > gone through the roof.
>> >
>> > On the dark side, this is probably coming to a lot more states and
>> > countries due to climate change. Australia. Sigh.
>> >
>> > Mike
>> >
>> 

Re: power to the internet

[Ben Cannon]

> How much generating capacity can you get out of a typical hybrid?

You’re joking right?  A lot… Enough to run an entire neighborhood…   The Prius 
makes 50,000watts alone.

With the right circuitry, there is no need for power plants in the United 
States (save that they’re more efficient than internal combustion gas engines 
in the 76hp range) - existing hybrid car stock’s generating capacity exceeds 
the entire US supply.  And it’s entirely untapped. 

Nissan just tested it for giggles, and found the Leaf (which has NO engine at 
all) can power a house for an entire week.  The batteries alone are a game 
changer, utterly transforming grids.

> Self-isolating and re-tieing inverters. Economic household ATS systems. Do 
> those exist?

Yes I have a patent in one type of this this; it exists in numerous variants.

ATS-es for partial loads of up to 6,000watts are like $400.

You sound smart, but did you research any of this or just post?

-Ben.

-Ben Cannon
CEO 6x7 Networks & 6x7 Telecom, LLC 
b...@6by7.net <mailto:b...@6by7.net>




> On Dec 26, 2019, at 2:31 AM, Joe Maimon  wrote:
> 
> Unless telecom infrastructure has been diligently changing out the lead acid 
> battery approach at all their remote terminals, powered gpon, hfc and 
> antennae plants will never last more than minutes. If at all.
> 
> A traditional car has between a 100-200amp alternator @12volts
> 
> How much generating capacity can you get out of a typical hybrid?
> 
> Self-isolating and re-tieing inverters. Economic household ATS systems. Do 
> those exist?
> 
> Enough independent distributed capacity and now comes the ability to create 
> grid islands. How might that look?
> 
> Electric grid shortage is likely coming to NYC, courtesy of folk of certain 
> political persuasion and their love of stone age era living. IP 
> decommissioning.
> 
> If you have CO loop copper, keep it.
> 
> Joe
> 
> Don Gould wrote:
>> This is a very short term problem.
>> 
>> The market is going to fill with battery storage sooner rather than later.
>> 
>> Solar is just exploding.
>> 
>> Your car will "house tie".
>> 
>> 6G will solve your data problem.
>> 
>> D
>> 
>> 
>> 
>> -- 
>> Don Gould
>> 5 Cargill Place
>> Richmond
>> Christchurch, New Zealand
>> Mobile/Telegram: + 64 21 114 0699
>> www. <http://www.tusker.net.au/>bowenvale.co.nz
>> 
>> 
>> 
>>  Original message 
>> From: Michael Thomas 
>> Date: 26/12/19 2:33 PM (GMT+12:00)
>> To: nanog@nanog.org
>> Subject: power to the internet
>> 
>> 
>> https://www.politico.com/news/2019/12/25/california-power-shutoffs-089678
>> 
>> 
>> This article details some of the issues with California's "new reality"
>> of planned blackouts. One of the big things that came to light with
>> these blackouts is that our network infrastructure's resilience is
>> pretty lacking. While I was (surprisingly to me) ok with my DSL
>> connection out in the boonies, lots and lots of people with cable
>> weren't so lucky. And I'm not sure how bad the situation is with
>> cellular infrastructure, but I assume it's not much better than cable.
>> And I wouldn't doubt that other DSL deployments go dark when power is
>> down. I have no clue with fiber.
>> 
>> So I guess what I'm wondering is what can we do about this? What should
>> we do about this? These days IP access is not just convenience, it's the
>> way we go about our lives, just like electricity itself. At base, it
>> seems to me that network operators should be required to keep the lights
>> on in blackouts just like POTS operators do now. If I have power to
>> light my modem or charge in my phone, I should be able to get onto the
>> net. That seems like table stakes.
>> 
>> One of the things we learned also is that the blackouts seem to last
>> between 2-3 days apiece. I happen to have a generator since I'm out in
>> the boonies and our power gets cut regularly because of snow, but not
>> everyone has that luxury. I kind of want to think that my router+modem
>> use about 20 watts, so powering it up would take about 1.5kwh for 3
>> days. a quick google look shows that I'd probably need to shell out $500
>> or so for a battery of that capacity, and that's doesn't include your
>> phones, laptops, tv's, etc power needs. What does that mean? That is a
>> major expense for a lot of people.
>> 
>> On the bright side, I hear that power generator companies stocks have
>> gone through the roof.
>> 
>> On the dark side, this is probably coming to a lot more states and
>> countries due to climate change. Australia. Sigh.
>> 
>> Mike
>> 
> 

Re: power to the internet

[Ben Cannon]

Exactly. And we will build it all.

The power stuff is serious people.  We’ve gotten letters from the FCC over it.  
There is additional regulation coming down when people can’t call 911!  

You need at minimum 8 hours (or your CRT response time with a generator 
trailer, or a standby generator or two) of battery on your telecom equipment. 
All of it. Everywhere.  

Comcast is the worst about this, they never replace and often don’t even place 
batteries in their RTs at all - and they are going to get fined over it mark my 
words.

-Ben Cannon
CEO 6x7 Networks & 6x7 Telecom, LLC 
b...@6by7.net <mailto:b...@6by7.net>




> On Dec 25, 2019, at 8:41 PM, Don Gould  wrote:
> 
> This is a very short term problem. 
> 
> The market is going to fill with battery storage sooner rather than later. 
> 
> Solar is just exploding. 
> 
> Your car will "house tie".
> 
> 6G will solve your data problem. 
> 
> D
> 
> 
> 
> -- 
> Don Gould
> 5 Cargill Place
> Richmond
> Christchurch, New Zealand
> Mobile/Telegram: + 64 21 114 0699
> www. <http://www.tusker.net.au/>bowenvale.co.nz
> 
> 
> 
>  Original message 
> From: Michael Thomas 
> Date: 26/12/19 2:33 PM (GMT+12:00)
> To: nanog@nanog.org
> Subject: power to the internet
> 
> 
> https://www.politico.com/news/2019/12/25/california-power-shutoffs-089678
> 
> 
> This article details some of the issues with California's "new reality" 
> of planned blackouts. One of the big things that came to light with 
> these blackouts is that our network infrastructure's resilience is 
> pretty lacking. While I was (surprisingly to me) ok with my DSL 
> connection out in the boonies, lots and lots of people with cable 
> weren't so lucky. And I'm not sure how bad the situation is with 
> cellular infrastructure, but I assume it's not much better than cable. 
> And I wouldn't doubt that other DSL deployments go dark when power is 
> down. I have no clue with fiber.
> 
> So I guess what I'm wondering is what can we do about this? What should 
> we do about this? These days IP access is not just convenience, it's the 
> way we go about our lives, just like electricity itself. At base, it 
> seems to me that network operators should be required to keep the lights 
> on in blackouts just like POTS operators do now. If I have power to 
> light my modem or charge in my phone, I should be able to get onto the 
> net. That seems like table stakes.
> 
> One of the things we learned also is that the blackouts seem to last 
> between 2-3 days apiece. I happen to have a generator since I'm out in 
> the boonies and our power gets cut regularly because of snow, but not 
> everyone has that luxury. I kind of want to think that my router+modem 
> use about 20 watts, so powering it up would take about 1.5kwh for 3 
> days. a quick google look shows that I'd probably need to shell out $500 
> or so for a battery of that capacity, and that's doesn't include your 
> phones, laptops, tv's, etc power needs. What does that mean? That is a 
> major expense for a lot of people.
> 
> On the bright side, I hear that power generator companies stocks have 
> gone through the roof.
> 
> On the dark side, this is probably coming to a lot more states and 
> countries due to climate change. Australia. Sigh.
> 
> Mike
> 

Re: BGP/dDos gift from NIST

[Ben Cannon]

I’m not getting my AS number tattooed on my wrist for a “little” i in Internet. 
Lol.

-Ben

> On Dec 25, 2019, at 10:34 AM, Royce Williams  wrote:
> 
> 
>> On Wed, Dec 25, 2019 at 1:15 AM william manning  
>> wrote:
> 
>> https://nvlpubs.nist.gov/nistpubs/SpecialPublications/NIST.SP.800-189.pdf
> 
> I can't speak to the technical content, but this put a curdle in my morning 
> coffee:
> 
> "... that comprise the internet [sic]" .
> 
> Et tu, NIST?
> 
> I will die on this  "capital "I" in *the* Internet" hill. ;)
> 
> (And no, I don't care what the AP Stylebook decided to pull out of thin air, 
> with no understanding of how the Internet works or what it means; the 
> argument that "there are many possible internets" is specious, because that's 
> not what "the Internet" means; to the extent that various other "internets" 
> get balkanized out of the Internet, to the extent that they interconnect, 
> *that* will always and forever be "the Internet".)
> 
> What's next - geology textbooks calling our single, unique planet "the earth" 
> ? (Which brings to mind a great illustration of why "the Internet" matters: 
> if, by some happenstance of etymology, we referred to our planet solely as 
> "the Planet", then there could be many other planets, but only one Planet.)
> 
> (And regardless of what you call it ... thanks to each of you for operating 
> your piece of it!)
> 
> Royce

Re: Energy Efficiency - Data Centers

[Ben Cannon]

It is overwhelmingly disposed of as heat, even all useful work.  The amount of 
energy leaving a DC in fiber cables, etc is perhaps a millionth of one percent.

Even in your lightbulb example, if the light is used inside a room, it gets 
turned back into heat once it hits the walls. 

So in a closed system, it’s all heat.   

Now, power is lost before it can be used for compute/routing, mostly in power 
conversions.  Of which there are many in most DCs.  Companies like Facebook and 
Amazon have done a lot of work to remove excess power conversion steps, to 
chase better PUE (Power Unit Efficiency) and get more electricity to the 
computers before losing it as excess heat in voltage conversions.  There’s 
still room for improvement here, and the power wasted here goes directly to 
heat before doing any other useful work.

Source: I have a C-20 HVAC license and own and operate 2 datacenters.

-Ben.


-Ben Cannon
CEO 6x7 Networks & 6x7 Telecom, LLC 
b...@6by7.net <mailto:b...@6by7.net>




> On Dec 18, 2019, at 11:06 AM, Rod Beck  
> wrote:
> 
> I was reasoning from the analogy that an incandescent bulb is less efficient 
> than a LED bulb because more it generates more heat - more of the electricity 
> goes into the infrared spectrum than the useful visible spectrum. Similar to 
> the way that an electric motor is more efficient than a combustion engine. 
> 
> 
> 
> From: Thomas Bellman
> Sent: Wednesday, December 18, 2019 7:47 PM
> To: Nanog@nanog.org <mailto:Nanog@nanog.org>
> Cc: Rod Beck
> Subject: Re: Energy Efficiency - Data Centers
> 
> On 2019-12-18 15:57, Rod Beck wrote:
> 
> > This led me to wonder what is the inefficiency of these servers in data> 
> > centers. Every time I am in a data center I am impressed by how much> heat 
> > comes off these semiconductor chips. Looks to me may be 60% of the> 
> > electricity ends up as heat.
> What are you expecting the remaining 40% of the electricity ends up as?
> 
> In reality, at least 99% of the electricity input to a datacenter ends up
> as heat within the DC.  The remaining <1% turns into things like:
> 
>  - electricity and light leaving the DC in network cables (but will
>turn into heat in the cable and at the receiving end)
>  - sound energy (noise) that escapes the DC building (but will turn
>into heat later on as the sound attenuates)
>  - electric and magnetic potential energy in the form of stored bits
>on flash memory, hard disks and tapes (but that will turn into heat
>as you store new bits over the old bits)
> 
> (I'm saying <1%, but I'm actually expecting it to be *much* less than
> one percent.)
> 
> This is basic physics.  First law of thermodynamics: you can't destroy
> (or create) energy, just convert it.  Second law: all energy turns into
> heat energy in the end. :-)
> 
> 
> You are really asking the wrong question.  Efficiency is not measured
> in how little of the input energy is turned into heat, but in how much
> *utility* you get out of a certain amount of input energy.  In case of
> a datacenter, utility might be measured in number of database transac-
> tions performed, floating point operations executed, scientific articles
> published in Nature (by academic researchers using your HPC datacenter),
> or advertisments pushed to the users of your search engine.
> 
> 
> There is another efficiency number that many datacenters look at, which
> is PUE, Power Usage Effectiveness.  That is a measure of the total energy
> used by the DC compared to the energy used for "IT load".  The differece
> being in cooling/ventilation, UPS:es, lighting, and similar stuff.
> However, there are several deficiencies with this metric, for example:
> 
>  - IT load is just watts (or joules) pushed into your servers, and does
>not account for if you are using old, inefficient Cray 1 machines or
>modern AMD EPYC / Intel Skylake PCs.
> 
>  - Replace fans in servers with larger, more efficient fans in the rack
>doors, and the IT load decreases while the DC "losses" increase,
>leading to higher (worse) PUE, even though you might have lowered your
>total energy usage.
> 
>  - Get your cooling water as district cooling instead of running your own
>chillers, and you are no longer using electricity for the chillers,
>improving your PUE.  There are still chillers run, using energy, but
>that energy does not show up on your DC's electricity bill...
> 
> This doesn't mean that the PUE value is *entirely* worthless.  It did
> help in putting efficiency into focus.  There used to be datacenters
> that had PUE numbers close to, or even over, 2.0, due to having horribly
> inefficient cooling systems, UPS:es and so on.  But once you get down
> to the 1.2-1.3 range or below, you really need to look at the details
> of *how* the DC achieved the PUE number; a single number doesn't capture
> the nuances.
> 
> 
> /Bellman

Re: Elephant in the room - Akamai

[Ben Cannon]

+100, and thanks to Jared.

-Ben

> On Dec 7, 2019, at 10:08 PM, Mark Tinka  wrote:
> 
> 
> 
>> On 8/Dec/19 02:19, Jared Mauch wrote:
>> 
>> I’ve been working hard to provide value to our AANP partners as well.  I’ll 
>> try to stop responding to the list at this point but don’t hesitate to 
>> contact me here or via other means if you’re seeing something weird.  I know 
>> I resolved a problem a few days ago for someone quickly as there was a 
>> misconfiguration left around.. We all make mistakes and can all do better.
> 
> Problems are part of the gig - otherwise we'd have no reason to get up
> in the morning.
> 
> What matters is that there is someone you can find to help you fix them.
> That's what makes all the difference.
> 
> So kudos to you, Jared, and the entire team out there at Akamai.
> 
> Mark.

Re: virginia beach

[Ben Cannon]

1 more repeater usually buys you 100km these days and thats negligible in terms 
of wet plant repeater count, and entire countries in some cases on dry land.  

So ‘no’, broadly.

-Ben

> On Dec 4, 2019, at 7:54 PM, Mehmet Akcin  wrote:
> 
> 
> is there any limitation of where an SLTE can be placed in terms of distance 
> from PFE?
> 
> I have looked in to usual palaces and i was unable to confirm there is any 
> requirements for any distance. Any cons can you guys think of that you want 
> to share would be appreciated.
> 
> here are places I have looked at
> 
> http://opticalcloudinfra.com/index.php/2018/03/28/whys-hows-open-subsea-cable-systems/
> 
> https://www.osa.org/osaorg/media/osa.media/OSAF/Banners/Cable_Powering.pdf
> 
> http://opticalcloudinfra.com/index.php/2016/02/27/why-open-subsea-cable-systems/
> 
> thank you
> 
>> On Tue, Nov 26, 2019 at 1:03 PM Mark Tinka  wrote:
>> 
>> 
>> On 26/Nov/19 18:47, Ben Cannon wrote:
>> 
>> > Nowadays however, the CLS is looked at more like an ILA shelter, or
>> > when feasible cable landings are going directly into metro CNDCs as
>> > the physical gear is getting smaller and smaller and more suitable for
>> > colocation.
>> 
>> Nowadays, the SLTE sits in a proper data centre.
>> 
>> 
>> >
>> > There’s still the small matter of 11,000volts of power or more…
>> >  That’s usually kept out towards the sea.
>> 
>> Yes, PFE's will generally live at the CLS.
>> 
>> Mark.

Re: Comcast & NTT packet loss today

[Ben Cannon]

I’ll Just pop in here to echo Randy’s comments - we have great experiences with 
NTT across the board and they did reach out and resolve the issue.

-Ben

> On Dec 4, 2019, at 1:26 PM, Randy Bush  wrote:
> 
> 
>> 
>>> just to say that they are awesome
>> so, uh, you don't recommend them to your competitors then?
> 
> no way.  my competitors should buy from comcast, he, ...

Comcast & NTT packet loss today

[Ben Cannon]

We’re trying to figure out wether this is an isolated or wider incident, 
looking like one of our customer’s flows is fragging between NTT and Comcast.

 5  ae-0.a02.snjsca04.us.bb.gin.ntt.net (129.250.2.3)  5.571 ms  13.026 ms  
9.514 ms
 6  ae-0.comcast.snjsca04.us.bb.gin.ntt.net (129.250.66.34)  119.688 ms  
117.368 ms  111.902 ms
 7  be-12578-cr01.9greatoaks.ca.ibone.comcast.net (68.86.88.17)  118.845 ms  
117.035 ms  114.762 ms
 8  * be-7922-ar01.hayward.ca.sfba.comcast.net (68.86.94.154)  120.025 ms  
114.310 ms
 9  * be-397-rar01.fairfield.ca.sfba.comcast.net (96.108.99.10)  119.178 ms *
10  162.151.79.66 (162.151.79.66)  123.215 ms  121.184 ms  124.125 ms

If anyone from either entity would like to contact me off list for 
troubleshooting please feel free.


-Ben Cannon
CEO 6x7 Networks & 6x7 Telecom, LLC 
b...@6by7.net <mailto:b...@6by7.net>

Re: AWS re:Invent

[Ben Cannon]

Not to belabor a point, but this (perhaps just the OP and not a follow-up) but 
this is EXACTLY what I love about NANOG and why I’ve been a member for. Uh. 
Ever.

This little community of people that get together with a united purpose of 
connecting the world. 

BGP requires us in a way to trust and care for each other, and I think this 
post exemplified those principles.

-Ben.

-Ben Cannon
CEO 6x7 Networks & 6x7 Telecom, LLC 
b...@6by7.net <mailto:b...@6by7.net>




> On Nov 28, 2019, at 4:24 PM, Tom Beecher  wrote:
> 
> Oliver-
> 
> Although I'm sure many appreciate the offer, this is not appropriate content 
> for the NANOG mailing list. 
> 
> 
> On Thu, Nov 28, 2019 at 5:46 PM Oliver O'Boyle  <mailto:oliver.obo...@gmail.com>> wrote:
> Just a reminder. The ticket remains unclaimed. If it makes you feel better, 
> I'll raise the price from free to $10 :)
> 
> $1800 USD value and the conference is excellent.
> 
> Reply off-list if you're interested.
> 
> Oliver
> 
> On Wed, Nov 27, 2019, 22:39 Oliver O'Boyle,  <mailto:oliver.obo...@gmail.com>> wrote:
> Nanog:
> 
> I have a free AWS re:Invent full access pass for any community member who can 
> reasonably demonstrate regular knowledge transfer or contributions of useful 
> help to other community members in the past year+. Reply off list with your 
> evidence if that's you. Conference starts Monday in Las Vegas. $1800 USD 
> value.
> 
> Caveat: let's make sure the pass transfers successfully to you before you buy 
> air or hotel tickets. Only the pass is free and you must cover all other 
> expenses.
> 
> Thanks for being you, Nanog.
> 
> Oliver

Re: virginia beach

[Ben Cannon]

Remember that a CLS serves 2 purposes simultaneously.

1. Convert the wet plant to dry plant and provide 11kv power for ILAs.
2. Act as an OTN node and CO to distribute connectivity into the 
Territory/Nation.

Historically, you put a CLS on the beach itself, and it’s somewhat remote.

Then you backhaul to a dozen COs/CNDCs.

Nowadays however, the CLS is looked at more like an ILA shelter, or when 
feasible cable landings are going directly into metro CNDCs as the physical 
gear is getting smaller and smaller and more suitable for colocation.

There’s still the small matter of 11,000volts of power or more…  That’s usually 
kept out towards the sea.



-Ben Cannon
CEO 6x7 Networks & 6x7 Telecom, LLC 
b...@6by7.net <mailto:b...@6by7.net>




> On Nov 4, 2019, at 1:50 PM, Ethan O'Toole  wrote:
> 
>> hey there,
>> we've put together a blog post about Virginia beach developments and how it 
>> can reshape some of the ways we
>> have been designing our networks.
>> https://www.infrapedia.com/post/virginia-beach-a-new-hub-is-born
>> Mehmet
> 
> Ex-757'er (757 = Virginia Beach.)
> 
> Dead area tech wise. Bad job prospects led the geeks to flee the area. Small 
> lights out data centers to support a few undersea cables aren't going to 
> change that. Those cables landing in VaBeach will have their traffic hauled 
> to Northern Virginia -- where all the action is. It will do little to benefit 
> the locals once the build out is done.
> 
>   - Ethan O'Toole
> 
> 

Re: all major US carriers received text messages overnight that appear to have been sent around Valentine's Day 2019

[Ben Cannon]

That’d be an incredibly obtuse, excessive, and horrible order.   And it’d be 
the very first time that’s ever happened...


-Ben Cannon
CEO 6x7 Networks & 6x7 Telecom, LLC 
b...@6by7.net <mailto:b...@6by7.net>




> On Nov 8, 2019, at 10:50 AM, David Hubbard  
> wrote:
> 
> Playing devil’s advocate, perhaps they were under emergency court order to 
> not deliver texts for a certain duration, market, who knows what, and that 
> order just ended, but some type of non-disclosure / secrecy directive 
> continues to exist… may have just had to come up with something to say 
> because their other agreements would not have permitted discarding the texts… 
> 
>  
> David
>  
> From: NANOG  on behalf 
> of Mark Stevens 
> Date: Friday, November 8, 2019 at 1:45 PM
> To: "nanog@nanog.org" 
> Subject: Re: all major US carriers received text messages overnight that 
> appear to have been sent around Valentine's Day 2019
>  
> Reading Syniverse's cause of trouble (lame excuse) tells me their data 
> handling processes are poor and seemingly shady since I do not buy reason for 
> the trouble.
> 
> On 11/8/2019 1:34 PM, Kain, Becki (.) wrote:
>> Esp on Valentine’s day.  Of all the days that clear communication is 
>> important.  I’d be very interested in their reasoning for why these messages 
>> were not sent and held.
>>  
>> From: NANOG  <mailto:nanog-boun...@nanog.org> On 
>> Behalf Of Oliver O'Boyle
>> Sent: Friday, November 08, 2019 1:31 PM
>> To: Matt Hoppes  
>> <mailto:mattli...@rivervalleyinternet.net>
>> Cc: North American Network Operators' Group  
>> <mailto:nanog@nanog.org>
>> Subject: Re: all major US carriers received text messages overnight that 
>> appear to have been sent around Valentine's Day 2019
>>  
>> We apologize for finally getting around to our job and doing what we were 
>> paid to do...
>>  
>> On Fri, Nov 8, 2019 at 1:27 PM Matt Hoppes 
>> > <mailto:mattli...@rivervalleyinternet.net>> wrote:
>>> “During an internal maintenance cycle last night, 168,149 previously 
>>> undelivered text messages were inadvertently sent to multiple mobile 
>>> operators’ subscribers," Syniverse said in a statement. 
>>>  
>>>  
>>> how do you inadvertently send messages that were supposed to be sent but 
>>> worked and sent? Isn’t that the desired outcome?
>>> 
>>> On Nov 8, 2019, at 12:54 PM, Brandon Svec >> <mailto:bs...@teamonesolutions.com>> wrote:
>>> 
>>>> From: 
>>>> https://www.usatoday.com/story/tech/2019/11/08/thousands-people-just-got-text-messages-sent-valentines-day/2527660001/
>>>>  
>>>> <https://www.usatoday.com/story/tech/2019/11/08/thousands-people-just-got-text-messages-sent-valentines-day/2527660001/>
>>>>  
>>>> It seems there is a company that has everyone's text messages..
>>>>  
>>>> "Some mobile carriers rely on a third-party text platform called Syniverse 
>>>> to relay messages. The vendor said in a statement that its IT staff 
>>>> unknowingly caused the texts to be delivered this week."
>>>> -Brandon
>>>> 
>>>>  
>>>>  
>>>>  
>>>>  
>>>> On Fri, Nov 8, 2019 at 9:47 AM Brian J. Murrell >>> <mailto:br...@interlinx.bc.ca>> wrote:
>>>>> On Thu, 2019-11-07 at 22:42 +, Chris Kimball via NANOG wrote:
>>>>> > Does anyone have any more information on this?
>>>>> 
>>>>> Yeah, like who (in the private sector -- we all knew the NSA already
>>>>> are doing this) has access to and is archiving *everyone*s text
>>>>> messages?  And why?
>>>>> 
>>>>> Cheers,
>>>>> b.
>>>>> 
>> 
>> 
>>  
>> -- 
>> :o@>

Re: Geyserville fire

[Ben Cannon]

Geyser Peak is on fire and will likely soon lose all mobile telecommunications.

-Ben

> On Oct 24, 2019, at 12:13 AM, Ben Cannon  wrote:
> 
> 
> 
> 
> 
> -Ben

Re: lots of traffic starting at 3 a.m. central time

[Ben Cannon]

Somebody release a software update?

-Ben

> On Oct 15, 2019, at 9:08 AM, Dan White  wrote:
> 
> Here's a graph of our eyeball network traffic (CDT):
> 
> https://ibb.co/kJQYKMq
> 
> This is an unprecedented increase in traffic for us, day or night, outside
> of DDOS traffic.
> 
> Our traffic monitoring system identifies this a Akamai traffic.
> 
>> On 10/15/19 15:54 +, Luke Guillory wrote:
>> That’s what I’m seeing as well, went  from 2.2G around 2:50AM CST to a peak
> +of 16G.
>> 
>> https://i.imgur.com/en89kyO.png
>> 
>> Luke Guillory
>> Vice President – Technology and Innovation
>> 
>> From: NANOG [mailto:nanog-boun...@nanog.org] On Behalf Of Phil Lavin
>> Sent: Tuesday, October 15, 2019 10:48 AM
>> To: Aaron Gould; Nanog@nanog.org
>> Subject: RE: lots of traffic starting at 3 a.m. central time
>> 
>> > Anyone else see lots of traffic coming down starting at 3 a.m. central
>> > time ?  all of my internet connections showed strangely larger load for a
>> > few early morning hours.
>> >
>> > Someone, on another list, mentioned a 70% increase in traffic to Akamai
>> > which seems to correlate with a new Fortnite release
> 
> 
> -- 
> Dan White
> BTC Broadband
> Network Admin Lead
> Ph  918.366.0248 (direct)   main: (918)366-8000
> Fax 918.366.6610email: dwh...@mybtc.com
> http://www.btcbroadband.com

Re: IP Geolocation

[Ben Cannon]

Agreed, I’ve seen this before across wider boundaries. Even /22s.

-Ben

> On Oct 14, 2019, at 8:38 AM, Jared Mauch  wrote:
> 
> 
> 
>> On Oct 14, 2019, at 9:14 AM, Travis Garrison  wrote:
>> 
>> Anyone else have issues where their IP block gets randomly set to China? We 
>> have been trying to track down this issue for months and our customers are 
>> starting to get upset. We get a /29 from our upstream provider that we CGNAT 
>> (yeah I know, working on implementing IPV6) to all of our customers at 1 
>> particular site. No other sites have any issues. We had our upstream 
>> provider allocate us a new IP block from a different subnet which fixed the 
>> issue for a while but now it's back. The state and town are correct but the 
>> country states China. This is having issues with Speedtests, NetFlix and 
>> others. The upstream is claiming that we are purposely using a proxy or VPN 
>> to china which causes this. We have checked all our configurations and even 
>> replaced all hardware in case something was hacked. Any ideas?
> 
> I’ve seen some people do their geolocation on a /24 boundary, so if someone 
> else in that same /24 is located there, it might be an issue.  I know in a 
> prior life I had that issue with some CDNs and we eventually worked with them 
> to resolve the issue.
> 
> - Jared

Re: Twilio

[Ben Cannon]

You’re right or course.

SIP team please :)

-Ben

> On Oct 2, 2019, at 5:02 PM, Ross Tajvar  wrote:
> 
> They do a lot of things. It might help to specify what you're having issues 
> with.
> 
>> On Wed, Oct 2, 2019, 7:51 PM Ben Cannon  wrote:
>> Can an engineer for Twilio please reach out to me off-list if possible? 
>> Thanks.
>> -Ben.
>> 
>> -Ben Cannon
>> CEO 6x7 Networks & 6x7 Telecom, LLC 
>> b...@6by7.net
>> 
>> 
>> 
>> 

Twilio

[Ben Cannon]

Can an engineer for Twilio please reach out to me off-list if possible? Thanks.
-Ben.

-Ben Cannon
CEO 6x7 Networks & 6x7 Telecom, LLC 
b...@6by7.net <mailto:b...@6by7.net>

Re: Elad Cohen (was: Re: Cogent sales reps who actually respond)

[Ben Cannon]

With the difficulty of getting IPs off SPAM RBLs being what they are, I’m not 
sure I like the bone-chilling idea of accepting null-routing entire ranges as 
standard practice.

Same reasons, no central repository, no easy/quick/objective/cheap way to 
remove an illegitimate entry - and then the real problem, there’s just 6 
billion of them now and 
they’re all over the place and you’re listed in one of them probably no matter 
who you are.

-Ben.

-Ben Cannon
CEO 6x7 Networks & 6x7 Telecom, LLC 
b...@6by7.net <mailto:b...@6by7.net>




> On Sep 18, 2019, at 6:57 PM, Christopher Morrow  
> wrote:
> 
> I tried to ask this earlier, I think, but...
> 
> "who cares about the sale?"
> 
> I ask this because I think getting wrapped around that axle is the
> wrong place to spend resources.
> If the outcome of 'someone' controlling IP space is that there is
> abusive activity coming from that space and either no actions are
> taken to correct that, OR the problem is endemic and there is no
> change over time, then the action the community should take is not
> accepting routes to these prefixes. Once everyone (or enough
> everyones) stop accepting packets/paths the address space isn't
> important anymore.
> 
> If the 'rightful owners' of the space need/want it back there's clear
> redress for them via their RIR and the various networks which are /
> were offering transit to these prefixes.
> 
> -chris
> 
> On Wed, Sep 18, 2019 at 6:02 PM Job Snijders  wrote:
>> 
>> It would be good to see some receipts, offered by the selling party.

Re: Cogent sales reps who actually respond

[Ben Cannon]

“They also run their links hot which create latency for anything flowing 
through it.”

Mike, I’d have agreed with you - 15 years ago. Is this current at all?  My 
views on Cogent have evolved dramatically over the years.  How recent is your 
data?

-Ben

> On Sep 16, 2019, at 4:21 PM, Mike Lyon  wrote:
> 
> The argument has been listed numerous times so i didn’t want to bore people:
> 
> 1. Sprint peering battle. Google it
> 2. He.net peering battle. Google it.
> 3. Google IPv6 peering battle. Google it.
> 
> All of which point to them being pompous assholes.
> 
> They also run their links hot which create latency for anything flowing 
> through it.
> 
> Cheers,
> Mike
> 
>> On Sep 16, 2019, at 15:59, Stephen M.  wrote:
>> 
>> Please don’t praise or complain like we’re supposed to take it at a total 
>> face value. If you don’t like them so much - we are you’re audience. 
>> Explain. 
>> 
>> If you like Cogent - explain.
>> If you don’t like Cogent - explain.
>> 
>> Cheers,
>> Stephen
>> 
>> //please pardon any brevities - sent from mobile//
>> 
>>> On Sep 16, 2019, at 10:01 PM, Mike Lyon  wrote:
>>> 
>>> Whenever asked about Cogent, i just say, “Friends don’t let friends use 
>>> Cogent.”
>>> 
>>> I’ve told two of their reps over the past two years that even if the 
>>> service was free, i wouldn’t use it. And yet, they still call.
>>> 
>>> -Mike
>>> 
> On Sep 16, 2019, at 13:53, Ronald F. Guilmette  
> wrote:
> 
> In message , 
> Owen DeLong  wrote:
> 
> Given their practice of harvesting whois updates in order to spam newly
> acquired AS contacts, any time it is my decision, Cogent is ineligible
> as a vendor.
 
 So I guess then that their aiding and abetting of fraud and IP block
 theft, as I documented here recently, is an entirely secondary concern...
 as long as they don't spam you, yes?
 
 
 Regards,
 rfg

Re: Cogent sales reps who actually respond

[Ben Cannon]

Actually yes, I have a few great contacts over there these days.   Very 
different company from years back.

-Ben.

-Ben Cannon
CEO 6x7 Networks & 6x7 Telecom, LLC 
b...@6by7.net <mailto:b...@6by7.net>




> On Sep 15, 2019, at 1:13 PM, n...@as37662.com n...@as37662.com 
>  wrote:
> 
> Hi fellow network operators,
> 
> Do any orgs here have experience with a good Cogent rep? The rep we got via 
> Cogent's website is unresponsive to even basic questions. It feels like we 
> are dealing with a bot and copy-pasted replies.
> 
> Thanks
> Ruldu
> 

Re: Cogent & FDCServers: Knowingly aiding and abetting fraud and theft?

[Ben Cannon]

Important realization: Things don’t always work there like they work here 
(wherever “here” is for you).

-Ben

> On Sep 6, 2019, at 6:57 AM, Carlos Friaças via NANOG  wrote:
> 
> 
> Hi,
> 
> (Also never been in Australia, unfortunately...)
> 
> Netname is "PMANET":
> ...isn't it OK to assume it could stand for "Port of Melbourne Authority 
> Network"?
> 
> * pma.vic.gov.au is not operational
> (i wonder what can be found with passive dns)
> 
> * vic.gov.au is still operational.
> 
> 
> Quick googling also allowed me to find this:
> 
> https://www.portofmelbourne.com/about-us/port-history/timeline/
> 
> "1996Melbourne Port Corporation established as successor to Port of
> Melbourne Authority."
> 
> 
> Regards,
> Carlos
> 
> 
> 
>> On Fri, 6 Sep 2019, Mel Beckman wrote:
>> 
>> A quick check of one of your facts produces unexpected results, so you might 
>> want to perform more research. According the APNIC,
>> 139.44.0.0/16  does not ?belong unambiguously to the Port Authority of 
>> Melbourne?. It belongs to an individual, with an office address
>> at a building called ?Port Authority of Melbourne?:
>> person:
>> Rob Shute
>> address:
>> Port of Melbourne Authority
>> Level 47 South
>> 525 Collins St
>> country:
>> AU
>> phone:
>> +61 3 9628 7613
>> e-mail:
>> d...@pma.vic.gov.au
>> nic-hdl:
>> RS54-AP
>> remarks:
>> --
>> remarks:
>> imported from ARIN object:
>> remarks:
>> remarks:
>> poc-handle: RS546-ARIN
>> remarks:
>> is-role: N
>> remarks:
>> last-name: Shute
>> remarks:
>> first-name: Rob
>> remarks:
>> street: Port of Melbourne Authority
>> Level 47 South
>> 525 Collins St
>> remarks:
>> country: AU
>> remarks:
>> mailbox: d...@pma.vic.gov.au
>> remarks:
>> bus-phone: +61 3 9628 7613
>> remarks:
>> reg-date: 1970-01-01
>> remarks:
>> changed: hostmas...@arin.poc 20001127
>> remarks:
>> source: ARIN
>> remarks:
>> remarks:
>> --
>> notify:
>> d...@pma.vic.gov.au
>> mnt-by:
>> MNT-ERX-PRTMELAUTH-NON-AU
>> last-modified:
>> 2008-09-04T07:31:33Z
>> source:
>> APNIC
>> The building called the Port Authority of Melbourne is not, by all accounts, 
>> a government agency. It?s just the name of a 54-story
>> office building, like the World Trade Center in NYC. In fact, World Trade 
>> Centre (Melbourne) is another name for the building, and
>> although it houses the Port of Melbourne Authority agency (on Level 4, not 
>> Level 47), it appears to be largely just a toney address
>> for business offices. Some, perhaps, not unlike American ?Mail Boxes Etc? 
>> (although I haven?t confirmed this). But the following Wikipedia
>> excerpt says this unambiguously:
>> The building currently houses some offices of the headquarters of Victoria 
>> Police, and the Victoria Police Museum , a collection of
>> exhibits and memorabilia from over 150 years of policing in Victoria.[3] It 
>> also houses offices for companies, including Thales
>> Australia.
>> https://en.m.wikipedia.org/wiki/Port_of_Melbourne_Authority
>> Now, I?m not an Ossie, and in fact have never been down under, but it seems 
>> likely that the address in the registration is akin to a
>> US business having a World Trade Center address in NYC. It means nothing as 
>> far as APNIC asset ownership is concerned. It?s just an
>> address.
>> I could be wrong. However, it seems a simple fact to verify by calling 
>> management at that building. I tried sending email to the
>> registered ?.gov.au? address:
>> d...@pma.vic.gov.au
>> But the domain does not exist. 
>>  -mel beckman
>> On Sep 6, 2019, at 1:30 AM, Ronald F. Guilmette  
>> wrote:
>> 
>>  Few of you here probably know about this, but nearly a week ago now
>>  an article appeared in South Africa's largest and most popular online
>>  tech publication, MyBroadband.co.za.  It detailed many, but certainly 
>> not
>>  all of the results of my multi-month investigation of a massive and
>>  ongoing fraud involving the theft of large numbers of large (generally
>>  /16 or larger) abandoned legacy blocks, taken from the AFRINIC region
>>  and beyond:
>> https://mybroadband.co.za/news/internet/318205-the-big-south-african-ip-address-heist-how-millions-are-made-on-the-grey-market.html
>> 
>>  For various editorial reasons, the article that was published actually
>>  downplayed the magnitude of the of the thefts quite dramatically.  The
>>  totality of the IPv4 space that has been stolen or squatted, primarily
>>  but not exclusively, from South African companies and South African 
>> national
>>  goverment agencies and departments is actually at least 5x bigger than 
>> what
>>  was reported in the MyBroadband.co.za article.
>> 
>>  The overwhelming majority of this stolen and squatted IPv4 space has
>>  been helpfully routed by Cogent (AS174), to their customer, FDCServers
>>  of Chicago, and then on to the prefered destinations of a certain Mr.
>>  Elad Cohen of Israel, and his company Netstyle Atarim, Ltd.  (I have
>> 

Re: IPAM recommendations

[Ben Cannon]

I’ve both been exposed to newer and better tools - and been annoyed at the 
noise - in NANOG for almost 2 decades now.

So far phpipam has suited our needs.  However it takes quite a few clicks to 
get things done, and anytime you can remove friction you have an opportunity 
for a better product.

-Ben

> On Sep 5, 2019, at 8:06 AM, David Hubbard  
> wrote:
> 
> I wish Digital Ocean would put as much effort into policing their network; at 
> least two thirds of the malicious traffic hitting our customers comes from an 
> even split between them and OVH.
>  
> From: NANOG  on behalf of Mel Beckman 
> 
> Date: Thursday, September 5, 2019 at 10:48 AM
> To: Phillip Carroll 
> Cc: nanog 
> Subject: Re: IPAM recommendations
>  
> I agree with Phil, Netbox is a great opens source IPAM project. We currently 
> use ManageEngine, but I plan to switch to Netbox when our current license is 
> up for renewal. NetBox. The project is supported by Digital Ocean, which is 
> the kind of corporate sponsorship that keeps open source project from dying 
> out.
>  
> It’s one of the few IPAM products that recognizes that IP addresses can be 
> assigned to interfaces on a device, not necessarily the device itself. It 
> also supports interfaces having multiple IP addresses. Netbox uses Postgres 
> under the covers, which has IP addresses as a native data type. That means 
> you can also build your own SQL queries to interface with other systems.
>  
> The tool is not frilly, but has all the features an IPAM should have for 
> accurate and timely resource management. Plus the code looks clean.
> 
>  -mel 
> 
> On Sep 5, 2019, at 6:48 AM, Phillip Carroll  wrote:
> 
>  
> https://github.com/netbox-community/netbox 
> 
>  
>  
> From: NANOG  On Behalf Of Andrew 
> Latham
> Sent: Thursday, September 5, 2019 8:20 AM
> Cc: nanog 
> Subject: Re: IPAM recommendations
>  
>  [EXTERNAL EMAIL]
>  
> Please check the mailing list archives as a resource. I made a short list 
> last time https://lathama.net/DCIM which looks to be June 20th 2018
>  
> On Thu, Sep 5, 2019 at 3:37 AM Mehmet Akcin  wrote:
> Looking for IPAM recommendations, preferably open source, API is a plus 
> (almost must, almost..). 40-50K IPs to be managed.
>  
> thanks in advance.
> 
>  
> --
> - Andrew "lathama" Latham -

Re: Colo in Africa

[Ben Cannon]

Have you priced F1 solutions?  

-Ben Cannon
CEO 6x7 Networks & 6x7 Telecom, LLC 
b...@6by7.net <mailto:b...@6by7.net>




> On Jul 16, 2019, at 9:33 AM, Akshay Kumar via NANOG  wrote:
> 
> Go look at the actual specifications for one of the metal boxes - you are not 
> going to come close to maxing anything out with the workload you describe. 
> FSB hasn't been a thing in over a decade. If you really wanted to go crazy 
> you could do some build a custom solution in FPGA on the F1s.
> 
> It's a moot point since none of this is going to be available in time but 
> perf is a bogus reason and a lot of the times price is too.
> 
> On Tue, Jul 16, 2019 at 5:12 PM Ken Gilmour  <mailto:ken.gilm...@gmail.com>> wrote:
> Speed is not the issue, it's IO. Also streaming 100Gbps of video is very 
> different to streaming 100Gbps of files smaller than 100kb (average of about 
> 30kb) the issue on the network level is the number of connections and CPU, on 
> the server side it's IO and FSB
> 
> On Tue, 16 Jul 2019 at 08:55, Akshay Kumar  <mailto:aks...@mongodb.com>> wrote:
> The 2nd requirement seems artificial. The new hypervisors have come a long 
> way and the overhead is minimal. Also you can run bare metal instances in AWS 
> if you really need them with 100Gbps.
> 
> Just just use the South Africa AWS region.
> 
> On Tue, Jul 16, 2019 at 3:35 PM Ken Gilmour  <mailto:ken.gilm...@gmail.com>> wrote:
> Hi Folks,
> 
> I work for a Security Analytics org and we're looking to build a small POP in 
> Africa. I am pretty clueless about the region so I was wondering if you could 
> help guide me in the right direction for research?
> 
> The challenges:
> Network needs to be able to receive millions of small PPS (as opposed to 
> serving smaller numbers of larger files).
> Can't be cloud (need bare metal servers / colo). We use the full capacity of 
> each server, all the time.
> Must have good connectivity to most of the rest of Africa
> We can initially only have one POP
> This is not like a normal website that we can just host on "any old 
> provider", the requirements are very different.
> 
> Is there a good location where we could either rent bare metal servers 
> (something like Internap - preferred) or colocate servers within Africa that 
> can serve most of the region?
> 
> "Good" is defined as an area with stable connectivity and power, no legal 
> restrictions on things like encryption, and good latency (sub 100ms) to the 
> rest of Africa.
> 
> Our two closest POPs are in Singapore and The Netherlands, so I'd like 
> something closer to the middle that can serve the rest of Africa. Middle East 
> will be deployed after Africa.
> 
> I hope this is the right place to ask.
> 
> Thanks!
> 
> Ken

Re: PSA: change your fedex.com account logins

[Ben Cannon]

You’d be surprised how often nation-states use essentially phishing scams.

-Ben Cannon
CEO 6x7 Networks & 6x7 Telecom, LLC 
b...@6by7.net <mailto:b...@6by7.net>




> On May 31, 2019, at 5:04 AM, Jason Kuehl  wrote:
> 
> Is it possible, yes. I've seen it several times now at my place of work. 
> Targeted attacks are a thing.
> 
> On Fri, May 31, 2019 at 2:53 AM Mike Hale  <mailto:eyeronic.des...@gmail.com>> wrote:
> Oh for fucks sake.
> 
> Really?
> 
> You two are questioning someone who subscribes to Nanog over Fedex?
> You really think it's more likely that someone is targeting Dan Hollis
> (whoever he is) instead of Fedex leaving something else exposed?
> 
> On Thu, May 30, 2019 at 11:39 PM Scott Christopher  <mailto:s...@ottie.org>> wrote:
> >
> > Dan Hollis wrote:
> >
> > Phishing scheme didn't happen.
> >
> > fedex has had a number of major compromises so it's not a stretch that
> > their user database was stolen and sold to spammers.
> >
> >
> > The other possibility is that your one-off email scheme is predictable, and 
> > someone knows you use FedEx, and that someone is targeting specifically 
> > you, and this obvious phishing email is a red herring for the exploit you 
> > didn't see.
> >
> > Be concerned.
> >
> > -- S.C.
> 
> 
> 
> -- 
> 09 F9 11 02 9D 74 E3 5B D8 41 56 C5 63 56 88 C0
> 
> 
> -- 
> Sincerely,
>  
> Jason W Kuehl
> Cell 920-419-8983
> jason.w.ku...@gmail.com <mailto:jason.w.ku...@gmail.com>

Re: modeling residential subscriber bandwidth demand

[Ben Cannon]

A 100/100 enterprise connection can easily support hundreds of desktop users if 
not more.  It’s a lot of bandwidth even today. 

-Ben

> On Apr 2, 2019, at 10:35 PM, Mikael Abrahamsson  wrote:
> 
>> On Tue, 2 Apr 2019, Paul Nash wrote:
>> 
>> FWIW, I have a 250 subscribers sitting on a 100M fiber into Torix.  I have 
>> had no complains about speed in 4 1/2 years.  I have been planning to bump 
>> them to 1G for the last 4 years, but there is currently no economic 
>> justification.
> 
> I know FTTH footprints where peak evening average per customer is 3-5 
> megabit/s. I know others who claim their customers only average equivalent 
> 5-10% of that.
> 
> It all depends on what services you offer. Considering my household has 
> 250/100 for 40 USD a month I'd say your above solution wouldn't even be 
> enough to deliver an acceptable service to even 10 households.
> 
> -- 
> Mikael Abrahamssonemail: swm...@swm.pp.se

Re: modeling residential subscriber bandwidth demand

[Ben Cannon]

Residential whatnow?

Sorry, to be honest, there really isn’t any.   

I suppose if one is buying lit services, this is important to model.  

But an *incredibly* huge residential network can be served by a single basic 
10/40g backbone connection or two. And if you own the glass it’s trivial to 
spin up very many of those.   Aggregate in metro cores, put the Netflix OC 
there, done.

Then again, we don’t even do DNS anymore, we’re <1ms from Cloudflare, so in 
2019 why bother?

I don’t miss the days of ISDN backhaul, but those days are long gone. And I 
won’t go back.


-Ben Cannon
CEO 6x7 Networks & 6x7 Telecom, LLC 
b...@6by7.net <mailto:b...@6by7.net>




> On Apr 2, 2019, at 9:54 AM, Tom Ammon  wrote:
> 
> How do people model and try to project residential subscriber bandwidth 
> demands into the future? Do you base it primarily on historical data? Are 
> there more sophisticated approaches that you use to figure out how much 
> backbone bandwidth you need to build to keep your eyeballs happy? 
> 
> Netflow for historical data is great, but I guess what I am really asking is 
> - how do you anticipate the load that your eyeballs are going to bring to 
> your network, especially in the face of transport tweaks such as QUIC and TCP 
> BBR?
> 
> Tom
> -- 
> -
> Tom Ammon
> M: (801) 784-2628
> thomasam...@gmail.com <mailto:thomasam...@gmail.com>
> -

Re: Question about ISP billing procedures

[Ben Cannon]

You have to zero it.

-Ben

> On Feb 27, 2019, at 8:10 PM, Michael Gehrmann  wrote:
> 
> From my provider days if you miss data you can't bill it or assume zero.
> 
> Mike
> 
> 
>> On Thu, 28 Feb 2019 at 15:06, Steve Meuse  wrote:
>> I can say that missing samples weren’t back filled when we billed. Never had 
>> any complaints.
>> 
>> -Steve
>> 
>>> On Wed, Feb 27, 2019 at 10:31 PM Daniel Rohan  wrote:
>>> Can anyone shed light on how ISPs handle missing samples when calculating 
>>> p95s for monthly billing cycles? Do they fill null samples with zeros or 
>>> leave them as null? 
>>> 
>>> I’m working on a billing sanity tool and want to make sure to cover my 
>>> corner cases well. 
>>> 
>>> Thanks!
>>> 
>>> Dan
>>> -- 
>>> Thanks, Dan

Amazon contact off-list

[Ben Cannon]

Can someone from Amazon (preferably SF Bay area) contact me off-list please?
-Ben.

-Ben Cannon
CEO 6x7 Networks & 6x7 Telecom, LLC 
b...@6by7.net <mailto:b...@6by7.net>

Re: Last Mile Design

[Ben Cannon]

I should probably have mentioned that in this sense I view “urban” as exclusive 
to “single family homes” - meaning I’m talking about high density modern urban 
with under grounding requirements - and high rise residential towers.

We are the opposite, we are presently enterprise, midsize, and exotic-small 
business only, and have no residential arm or support structure (or SLA 
expectations, or standards or lack thereof) of a residential connection.

-Ben.

-Ben Cannon
CEO 6x7 Networks & 6x7 Telecom, LLC 
b...@6by7.net <mailto:b...@6by7.net>




> On Feb 9, 2019, at 2:54 AM, Baldur Norddahl  wrote:
> 
> PON in urban areas absolutely makes sense. Maybe less in a high rise area, 
> where each building can have a small building wide network of its own. But it 
> in areas with single family homes PON is king.
> 
> Our POPs can have up to 10 000 customers each. All on a single 96 fiber 
> strand cable leading into the POP building. We have extra ducts, but nothing 
> that would allow us to change that to a point to point network. That would 
> require 100x that 96 fiber cable.
> 
> With extra ducts it would be possible to rebuild from PON to point to point. 
> But it would require massive investments. Basically you would have to invest 
> all that we saved by building PON. For starters, you would have to have many 
> more POPs.
> 
> And yes, there are splitters in the hand holes. This is not what stops you 
> from rebuilding from PON. It is the fact that we never paid for extra fiber. 
> The backbone in a sub area is typically build with a 24 fiber strand cable. 
> Because fibers are not free and are actually quite expensive as the number of 
> fibers grow and the distances get longer. We can do a few point to point 
> connections, for example if we need to deliver a commercial service or for 
> our own needs (to connect POPs etc).
> 
> We are not big on commercial services. But if we were, I would use WDM 
> splitters for that. Or the long awaited 10G PON if that ever arrives and 
> turns out at a price point that works.
> 
> Regards,
> 
> Baldur
>  

Re: Last Mile Design

[Ben Cannon]

PON in my view is well suited for residential distribution and use profiles.  
10G/XG-PON at 10gig/2.5gig is a pretty serious residential connection and even 
2.5/1 is pretty great for residential 1/1 symmetric service.

That said, I would in urban environments not recommend designing for GPON 
physical cable plan - go AE on your cabling.  Play with PON if you want more 
headaches here with little redeeming features IMO.   Instead, design 
rings/meshes, and think redundant/diverse path and entry/distro.  There’s a 
reason telco standards work. These days there’s little reason to separate 
residential vs commercial traffic, it’s all packets at our scale.  Our core is 
agnostic and switches anything we throw it at hardware speed, and it’s HA (min 
2 core routers in every POP - even some customer buildings have 
diverse/redundant fiber entry from us now, back to multiple $alldayallnightjob 
POPs no less, in some cases to meet regulatory minimum standards compliance.  
All of our DCs are built this way.Fact is, if you want a network to be fast 
as hell, and never ever go down, think redundant everything with diversity.  

That said, for rural distribution, especially cheap aerial residential services 
in far flung locations - there’s literally nothing finer and faster and more 
cost effective than GPON - which is HUGELY important for reaching the final 15 
MILLION Americans that do not have broadband internet connections at all.

For those people, GPON can be nothing short of utterly life transforming.

-Ben Cannon
CEO 6x7 Networks & 6x7 Telecom, LLC 
b...@6by7.net <mailto:b...@6by7.net>




> On Feb 8, 2019, at 10:22 PM, Mikael Abrahamsson  wrote:
> 
> On Fri, 8 Feb 2019, Chris Gross wrote:
> 
>> For a lot of us, PONs are a way of life and may not even have any 100G 
>> capable devices in our network, muchless enough to make our money on. While 
>> you may be so "lucky" to "never really take it seriously", it is supporting 
>> hundreds of thousands, if not millions, of homes in the US.
>> 
>> PON is the lifeblood if many rural communities. I'm luckily to have a 
>> healthy mix of PON and AE operations since I'm located next to cities. But 
>> I've met cooperatives in the middle of no where with super low density where 
>> it's 6 people + 2 donkeys on staff. AE would never work there, but PONs 
>> allow them cheap and available broadband options.
>> 
>> Unless someone wants to give enough funding to run AE to people's homes, 
>> PONs will continue to allow many communities to have more than cellular 
>> internet access options, if that.
> 
> PON and AE both have their strengths and weakness and make sense for 
> different deployment scenarios. My biggest problem with PON is that it seems 
> some operators build their fiber plant for PON for all deployment cases and 
> then it's extremely hard to back out of it and switch to AE. If you have AE 
> you can switch to PON fairly easily, but not the other way around if you've 
> put splitters in the manholes.
> 
> -- 
> Mikael Abrahamssonemail: swm...@swm.pp.se

Re: Contact for BART

[Ben Cannon]

I mean, it’s the first hit in this thing we have at work called Google. 
http://bfy.tw/JYgG :)

-Ben

> On Jan 20, 2019, at 10:38 AM, Owen DeLong  wrote:
> 
> agree

Re: Contact for BART

[Ben Cannon]

HAH. Apologies for copying the list.  But I think we all needed a good Friday 
laugh.   

Making it relevant again, also looking for a good contact within CALDOT 
(California Dept of Transportation) and the joint bridge authority for the Bay 
Bridge in San Francisco.

Have a good weekend all :)

-Ben Cannon

> On Jan 18, 2019, at 5:25 PM, William Herrin  wrote:
> 
> On Fri, Jan 18, 2019 at 5:18 PM Ben Cannon  <mailto:b...@6by7.net>> wrote:
> > I’m speaking of the san francisco based Bay Area Rapid Transit department 
> > about Rights Of Way for fiber…
> 
> Now you've said enough that if the person you're looking for is here he'll 
> have some idea you mean him.
> 
> 
> > What are you talking about?
> 
> Inappropriate abbreviation. I mean sure, why not a NANOG Friday Fight Club, 
> but why would you want to get in a ROW (noisy argument) with BART Simpson?
> 
> Regards,
> Bill Herrin
> 
> -- 
> William Herrin  her...@dirtside.com 
> <mailto:her...@dirtside.com>  b...@herrin.us <mailto:b...@herrin.us>
> Dirtside Systems . Web: <http://www.dirtside.com/ 
> <http://www.dirtside.com/>>
> <6x7_speedTest.JPG>

Re: Contact for BART

[Ben Cannon]

I’m speaking of the san francisco based Bay Area Rapid Transit department about 
Rights Of Way for fiber…

What are you talking about?

-Ben Cannon
CEO 6x7 Networks & 6x7 Telecom, LLC 
b...@6by7.net <mailto:b...@6by7.net>





> On Jan 18, 2019, at 5:16 PM, William Herrin  wrote:
> 
> On Fri, Jan 18, 2019 at 3:41 PM Ben Cannon  wrote:
>> Could someone from BART get ahold of me off list? Netops/security/ROW team.
> 
> Matt Groening is unavailable. And why do you want to get in to a fight with 
> him?
> 
> (unless you think BART and ROW have other well understood meanings
> within the networking world?)
> 
> 
> -- 
> William Herrin  her...@dirtside.com  b...@herrin.us
> Dirtside Systems . Web: <http://www.dirtside.com/>

Contact for BART

[Ben Cannon]

Could someone from BART get ahold of me off list? Netops/security/ROW team.

-Ben

Re: Changing upstream providers, opinions/thoughts on 123.net and cogent

[Ben Cannon]

Run BGP and use multiple upstream providers as soon as you can.

-Ben

> On Jan 4, 2019, at 4:57 AM, Aaron Henderson  wrote:
> 
> I work for a rural ISP and the powers that be have been thinking about 
> changing our upstream providers. The big names on the table right now are 
> 123.net and Cogent.
> 
> I, along with the people in my circle, do not have any experience with these 
> providers and all we are getting is what sales are dishing us.
> 
> I was hoping some of you here might have experience with these providers and 
> could share your experiences and opinions.
> 
> Thanks,
> 
> A
> 

Re: Cellular backup connections

[Ben Cannon]

> leave them on an old router where they’ve been for years.

I can’t name names obviously, but you’d be astonished how often I see this and 
who the big names are.




- Ben Cannon, AS15206

Re: How to choose a transport(terrestrial/subsea)

[Ben Cannon]

More likely everyone bought IRUs out of the same ILEC’s single cable.

Or they just all go through the same single raceway to enter the building, etc.

-Ben.

- Ben Cannon, AS15206

> On Dec 19, 2018, at 9:41 AM, Rod Beck  wrote:
> 
> Some of it is due to lazy buyers purchasing two IP ports from distinct 
> companies without considring that two ports both located at the site are 
> vulnerable to shared risers or entrance facilities. 
> 
> - R. 
> 
> 
> From: NANOG mailto:nanog-boun...@nanog.org>> on 
> behalf of Mike Hammett mailto:na...@ics-il.net>>
> Sent: Wednesday, December 19, 2018 3:12 PM
> To: Mehmet Akcin
> Cc: nanog@nanog.org <mailto:nanog@nanog.org>
> Subject: Re: How to choose a transport(terrestrial/subsea)
>  
> If people start spot-checking this stuff more regularly, perhaps the 
> companies being verified will take delivering the correct product the first 
> time more seriously.
> 
> Some of it boils down to a lack of data quality about what they actually have.
> 
> 
> 
> -
> Mike Hammett
> Intelligent Computing Solutions <http://www.ics-il.com/>
>  <https://www.facebook.com/ICSIL> 
> <https://plus.google.com/+IntelligentComputingSolutionsDeKalb> 
> <https://www.linkedin.com/company/intelligent-computing-solutions> 
> <https://twitter.com/ICSIL>
> Midwest Internet Exchange <http://www.midwest-ix.com/>
>  <https://www.facebook.com/mdwestix> 
> <https://www.linkedin.com/company/midwest-internet-exchange> 
> <https://twitter.com/mdwestix>
> The Brothers WISP <http://www.thebrotherswisp.com/>
>  <https://www.facebook.com/thebrotherswisp> 
> <https://www.youtube.com/channel/UCXSdfxQv7SpoRQYNyLwntZg>
> From: "Mehmet Akcin" mailto:meh...@akcin.net>>
> To: "James Breeden" mailto:ja...@arenalgroup.co>>
> Cc: nanog@nanog.org <mailto:nanog@nanog.org>
> Sent: Tuesday, December 18, 2018 12:17:42 PM
> Subject: Re: How to choose a transport(terrestrial/subsea)
> 
> That's a great example. Thank you James for sharing. I have done so many 
> "GROUND TRUTH" visits where randomly selected certain physical points to 
> validate physical diversity. Have seen several places where dual risers in 
> the building were present or multiple building entries were available but not 
> used. Ground truth events are certainly important and can be eye opening. It 
> does not necessarily scale as you can't really walk all the fiber A-Z 
> everywhere.. i know.
> 
> On Tue, Dec 18, 2018 at 6:49 AM James Breeden  <mailto:ja...@arenalgroup.co>> wrote:
> I can't stress enough the importance of controlling your own route and even 
> cable diversity. Require KMZs of the routes for any services you take 
> (especially single path Wave type services). Put them in the contracts if you 
> can.
> 
> I've had at least 1 situation where we had vendor diversity and what was 
> supposed to be route diversity- 3 separate waves coming south and southeast 
> out of a datacenter to 3 separate cities. Imagine my surprise when we took a 
> outage one day that severed all 3 circuits. Yes all 3 circuits, going to 3 
> separate cities, on 3 separate carrier/s DWDM platforms, all happened to show 
> up in the same sheath of cable at one location that happened to experience 
> backhoe fade. Was not a good day 
> 
> 
> James W. Breeden
> Managing Partner
>  
> 
> Arenal Group: Arenal Consulting Group | Acilis Telecom | Pines Media
> PO Box 1063 | Smithville, TX 78957
> Email: ja...@arenalgroup.co <mailto:ja...@arenalgroup.co> | office 
> 512.360. | cell 512.304.0745 | www.arenalgroup.co 
> <http://www.arenalgroup.co/>
> From: NANOG mailto:nanog-boun...@nanog.org>> on 
> behalf of Brandon Martin  <mailto:lists.na...@monmotha.net>>
> Sent: Monday, December 17, 2018 4:59:44 PM
> To: nanog@nanog.org <mailto:nanog@nanog.org>
> Subject: Re: How to choose a transport(terrestrial/subsea)
>  
> On 12/17/18 3:51 PM, Mehmet Akcin wrote:
> > 
> > One question, how much people care about vendor diversity? I do and did 
> > care. I don’t want to put all my eggs in one basket. Do you care? Thank you
> 
> There are advantages and disadvantages to vendor diversity.
> 
> As advantages, you won't be subject to complete loss of connection 
> because of a single dispute or provisioning/control plane issue with 
> that one vendor.  You can also more easily pit vendors against each 
> other for pricing if you are already vendor-diverse.
> 
> As a disadvantage, not only does vendor diversity obviously not imply 
> route diversity, but it will completely put the onus on you to ensure 
> route diversity if you want it.  With a single vendor, you can demand 
> that your circuits have route diversity and, assuming you trust them, 
> they have all the information they need to make that happen for you.
> -- 
> Brandon Martin

Re: How to choose a transport(terrestrial/subsea)

[Ben Cannon]

Mike have you looked at Packetlight?   Long-haul is mostly jumping to 100 or 
even 400g coherent. 

-Ben

> On Dec 15, 2018, at 8:53 AM, Mike Hammett  wrote:
> 
> FS had one, but it's not on their site anymore.
> 
> 
> 
> -
> Mike Hammett
> Intelligent Computing Solutions
> 
> Midwest Internet Exchange
> 
> The Brothers WISP
> 
> From: "Luke Guillory" 
> To: "Mike Hammett" 
> Cc: "Eric Dugas" , "nanog" 
> Sent: Saturday, December 15, 2018 10:52:19 AM
> Subject: Re: How to choose a transport(terrestrial/subsea)
> 
> No cost affective 10x10G to 100G muxponder?
> 
> 
> 
> Sent from my iPad
> 
> On Dec 15, 2018, at 4:46 AM, Mike Hammett  wrote:
> 
> heh, cross connects are indeed a major issue. I have a need for > 10G 
> transport. My equipment supports 40G. The carriers aren't terribly interested 
> in doing 40G transport (at least not at a reasonable price, one quote was 
> over 4x a 10G). 100G-capable switches cost too much. Equinix charges as much 
> for a pair of cross connects as a 10G wave. Carriers aren't likely to be 
> interested in using bidi optics or passive WDM to overcome the ridiculous 
> cross connect charges.
> 
> This all complicates how one chooses transport. There's no easy path forward.
> 
> 
> 
> -
> Mike Hammett
> Intelligent Computing Solutions
> 
> Midwest Internet Exchange
> 
> The Brothers WISP
> 
> From: "Eric Dugas" 
> To: "Mehmet Akcin" 
> Cc: "nanog" 
> Sent: Friday, December 14, 2018 11:42:53 AM
> Subject: Re: How to choose a transport(terrestrial/subsea)
> 
> I also look at hand-off locations (as long as it doesn't compromise the 
> overall robustness of the design).
> 
> Most providers will be able to hand-off in the BMMR of a carrier hotel and 
> some will have the flexibility to hand-off in particular suites within the 
> same building or other locations near where the cross-connects fees are 
> lower. I've seen cross-connect fees between $50 up to $750 MRC so if you need 
> multiple wavelengths (for capacity), the cross-connect fees are going to make 
> a huge difference on the total MRC.
> 
> Eric
>  
> Luke Guillory
> Vice President – Technology and Innovation
>  
> 
> Tel:  985.536.1212
> Fax:  985.536.0300
> Email:lguill...@reservetele.com
> Web:  www.rtconline.com
> 
> Reserve Telecommunications 
> 100 RTC Dr
> Reserve, LA 70084
>  
>  
> 
> Disclaimer:
> The information transmitted, including attachments, is intended only for the 
> person(s) or entity to which it is addressed and may contain confidential 
> and/or privileged material which should not disseminate, distribute or be 
> copied. Please notify Luke Guillory immediately by e-mail if you have 
> received this e-mail by mistake and delete this e-mail from your system. 
> E-mail transmission cannot be guaranteed to be secure or error-free as 
> information could be intercepted, corrupted, lost, destroyed, arrive late or 
> incomplete, or contain viruses. Luke Guillory therefore does not accept 
> liability for any errors or omissions in the contents of this message, which 
> arise as a result of e-mail transmission. 
> 
> On Dec 14 2018, at 12:17 pm, Mehmet Akcin  wrote:
> Thank you everyone incredible amounts of responses for my how to choose a 
> transit provider smail earlier.
> 
> How do you choose transport & backbone?
> 
> Looking at key aspects like route information, diversity, aerial vs under 
> ground fiber, age of fiber, outage history, length, but what else?
> 
> I will get both transport and transit as two seperate blogs.
> 
> I will also submit as a nanog paper for the meeting after next, or maybe 
> next? I am probably too late by now.
> 
> Thank you for all your help. I will add your names to the thank you line ;-)
> --
> Mehmet
> +1-424-298-1903
> 
>