Re: Network Speed Testing and Monitoring Platform

[Joel Jaeggli]

> On Jan 16, 2019, at 08:52, Colton Conor  wrote:
> 
> As an internet service provider with many small business and residential 
> customers, our most common tech support calls are speed related. Customers 
> complaining on slow speeds, slowdowns, etc.
> 
> We have a SNMP and ping monitoring platform today, but that mainly tells us 
> up-time and if data is flowing across the interface. We can of course see the 
> link speed, but customer call in saying the are not getting that speed. 
> 
> We are looking for a way to remotely test customers internet connections 
> besides telling the customer to go to speedtest.net, or worse sending a tech 
> out with a laptop to do the same thing.

So one of the properties of customer experience of internet performance is that 
their first hop is not going to be exposed in testing from the CPE. This is one 
of the enduring motivations of internet speed tests run inside clients.

Setting aside claims about buffer bloat. Radio interfaces can have dramatic 
impact on the first hop latency that propagate to everything upstream.

> 
> What opensource and commercial options are out there? 
> 

Re: Network Speed Testing and Monitoring Platform

[Mark Tinka]

On 19/Feb/19 04:56, Colton Conor wrote:
> Mark,
>
> What does this Viavi's QT-600 platform cost? Does it test 10G or only 1G?

They have units that will test up to 1Gbps and 10Gbps.

You're looking at several thousand US$ per unit, under US$10,000.

Mark.

Re: Network Speed Testing and Monitoring Platform

[Colton Conor]

Mark,

What does this Viavi's QT-600 platform cost? Does it test 10G or only 1G?

On Tue, Jan 22, 2019 at 3:26 AM Mark Tinka  wrote:

> After faffing about for quite some time with Ookla and iPerf, we have now
> settled on Viavi's QT-600 platform:
>
>
> https://www.viavisolutions.com/en-us/products/qt-600-ethernet-probe-portfolio
>
> We shall use it as a private system, primarily to activate and handover
> customer services, and on rare occasions, perform post-delivery testing.
>
> We are no longer interested in indulging endless speed tests that are
> practically meaningless and leave ISP's with the burden of explaining
> things they can't control.
>
> Mark.
>
> On 16/Jan/19 18:52, Colton Conor wrote:
>
> As an internet service provider with many small business and residential
> customers, our most common tech support calls are speed related. Customers
> complaining on slow speeds, slowdowns, etc.
>
> We have a SNMP and ping monitoring platform today, but that mainly tells
> us up-time and if data is flowing across the interface. We can of course
> see the link speed, but customer call in saying the are not getting that
> speed.
>
> We are looking for a way to remotely test customers internet connections
> besides telling the customer to go to speedtest.net, or worse sending a
> tech out with a laptop to do the same thing.
>
> What opensource and commercial options are out there?
>
>
>

Re: Network Speed Testing and Monitoring Platform

[Mark Tinka]

After faffing about for quite some time with Ookla and iPerf, we have
now settled on Viavi's QT-600 platform:

   
https://www.viavisolutions.com/en-us/products/qt-600-ethernet-probe-portfolio

We shall use it as a private system, primarily to activate and handover
customer services, and on rare occasions, perform post-delivery testing.

We are no longer interested in indulging endless speed tests that are
practically meaningless and leave ISP's with the burden of explaining
things they can't control.

Mark.

On 16/Jan/19 18:52, Colton Conor wrote:
> As an internet service provider with many small business and
> residential customers, our most common tech support calls are speed
> related. Customers complaining on slow speeds, slowdowns, etc.
>
> We have a SNMP and ping monitoring platform today, but that mainly
> tells us up-time and if data is flowing across the interface. We can
> of course see the link speed, but customer call in saying the are not
> getting that speed. 
>
> We are looking for a way to remotely test customers internet
> connections besides telling the customer to go to speedtest.net
> , or worse sending a tech out with a laptop to
> do the same thing.
>
> What opensource and commercial options are out there? 
>

RE: Network Speed Testing and Monitoring Platform

[Philip Loenneker]

Hi Colton,

Sorry for getting your name switched around last time, I only just noticed that!

A specific TR-069 implementation that I know has the speed test function is UMP 
Cloud, however I’m not sure exactly how it does it. You can see their spiel 
here:
https://www.avsystem.com/products/cloud-ump/

That said, TR-143 includes a time-based throughput test, so that you can test 
for defined number of seconds instead of a particular file size. That should 
allow you to suitably test any speed service. Refer to section 4.3 in the 
following document:
https://www.broadband-forum.org/technical/download/TR-143.pdf

Regards,
Philip Loenneker | Network Engineer | TasmaNet


From: Colton Conor 
Sent: Saturday, 19 January 2019 1:34 AM
To: Philip Loenneker 
Cc: NANOG 
Subject: Re: Network Speed Testing and Monitoring Platform

Philip,

Which TR-069 tools are you referring to? I looked at TR-143, but its my 
understanding it downloads a small file (like 50MB) from the TR-069 server to 
the CPE's ram. Then uploads the file back. Unfortunately I couldn't see how 
this would reliability test 1Gbps connections. Can you increase the file size? 
Most of these modems have like 128MB ram right now?

On Thu, Jan 17, 2019 at 5:07 PM Philip Loenneker 
mailto:philip.loenne...@tasmanet.com.au>> 
wrote:
Connor,

If you use the Traffic Generator tool instead of the Bandwidth Test tool built 
into MikroTik, you can definitely flood a 1Gbps link. However it requires the 
device to receive the packets that it has sent out, so it’s only viable for 
links with the same up/down speed.

We have been investigating some TR-069 platforms, and several of those offer 
speed test functionality built in. This means our helpdesk guys can just click 
a few buttons to trigger it, it only talks to the CPE (nothing on customer 
LAN), and people don’t need to know how to configure the test other than “click 
here”. TR-069 also has a lot of other advantages which you can easily discover 
with a quick search.

Regards,
Philip Loenneker | Network Engineer | TasmaNet

From: NANOG mailto:nanog-boun...@nanog.org>> On Behalf 
Of Colton Conor
Sent: Friday, 18 January 2019 12:17 AM
To: James Bensley mailto:jwbens...@gmail.com>>
Cc: NANOG mailto:nanog@nanog.org>>
Subject: Re: Network Speed Testing and Monitoring Platform

All, thanks for the recommendations both on and off list.

It has been brought to my attention that a Mikrotik has a bandwidth speed test 
tool built into their operating system. Someone recommended a 
https://mikrotik.com/product/hap_ac2 for MSRP of $69. The release notes of the 
newest version say:

!) speedtest - added "/tool speed-test" for ping latency, jitter, loss and TCP 
and UDP download, upload speed measurements (CLI only);
*) btest - added multithreading support for both UDP and TCP tests;

Do you think this device can push a full 1Gbps connection? It does have a quad 
core qualcom processor.

Besides mikrotik, I haven't found anything that doesn't require me to build a 
solution. Like OpenWRT with ipef3, or something like that.

Seems like a commercial solution would exist for this.  I though CAF providers 
have to test bandwidth for the FCC randomly to get funding?

On Thu, Jan 17, 2019 at 2:59 AM James Bensley 
mailto:jwbens...@gmail.com>> wrote:
On Wed, 16 Jan 2019 at 16:54, Colton Conor 
mailto:colton.co...@gmail.com>> wrote:
>
> As an internet service provider with many small business and residential 
> customers, our most common tech support calls are speed related. Customers 
> complaining on slow speeds, slowdowns, etc.
>
> We have a SNMP and ping monitoring platform today, but that mainly tells us 
> up-time and if data is flowing across the interface. We can of course see the 
> link speed, but customer call in saying the are not getting that speed.
>
> We are looking for a way to remotely test customers internet connections 
> besides telling the customer to go to speedtest.net<http://speedtest.net>, or 
> worse sending a tech out with a laptop to do the same thing.
>
> What opensource and commercial options are out there?

Hi Colton,

In the past I have used CPEs which support remote loopback. When the
customer complains we enable remote loopback, send the traffic to that
customers connection (rather than requiring a CPE that can generate
the traffic or having an on site device) and measuring what comes
back.

Cheers,
James.

RE: Network Speed Testing and Monitoring Platform

[Aaron Gould]

Yes that too, thanks for the reminder, the linux sys eng I work with here 
showed me our internal stats the other day when I was asking him about this…

 

-Aaron

 

From: Luke Guillory [mailto:lguill...@reservetele.com] 
Sent: Friday, January 18, 2019 11:22 AM
To: Aaron Gould; 'Colton Conor'
Cc: 'NANOG'
Subject: RE: Network Speed Testing and Monitoring Platform

 

The paid version gives you access to all the reporting from the test ran 
against your server.

 

 

Luke

 

 

Ns

 

 

Re: Network Speed Testing and Monitoring Platform

[Colton Conor]

Tim,

Doesn't OpenWRT support iperf3? Why not use that instead of wget?

I think there are a ton of options if I go with an OpenWRT based router.
Still not sure if I want to go through the process of developing out own
consumer grade routers, but still no one beside Mikrotik seems to have
speed test's built into their sub $100 CPEs.


On Fri, Jan 18, 2019 at 11:35 AM Tim J  wrote:

> On 2019-01-18 10:37, Colton Conor wrote:
> > Aaron,
> >
> > How does the https://account.speedtestcustom.com/login [2]  differ
> > from hosting a speedtest.net [3] server as an ISP, and letting anyone
> > test through it? Seems the speedtest custom is a paid option, but
> > hosting a speedtest.net [3] server is free if you allow it to the
> > public domain. Sure it uses up bandwidth (which I am sure you have a
> > ton of), so I don't see the point of having a custom one?
> Hi Colton,
>
> This may be too light-weight and manual for you, but in the past I've
> supplied a few clients with a decent OpenWrt router. I can then SSH in
> and do a wget to my FTP site. It might not be 100% accurate, but it's
> good low cost option for me, and enough for my purposes. YMMV.
>
> Tim
>
> >
> > On Thu, Jan 17, 2019 at 10:27 AM Aaron Gould  wrote:
> >
> >> https://github.com/adolfintel/speedtest [1] - one drawback we’ve
> >> seen is upload test has issues on some iphones (maybe other mobile
> >> devices) in safari, but I think chrome might work, unsure
> >>
> >> https://account.speedtestcustom.com/login [2] - ookla customer
> >> speedtest – we have this running *INTERNALLY* in our network on VM
> >> and also bare-metal, this is where our customers test locally
> >>
> >> Iperf - us engineers used it
> >>
> >> wifiperf – us engineers used it
> >>
> >> -Aaron
> >
> >
> > Links:
> > --
> > [1] https://github.com/adolfintel/speedtest
> > [2] https://account.speedtestcustom.com/login
> > [3] http://speedtest.net
>
> --
> This email and any files transmitted with it are confidential and
> intended solely for the use of the individual or entity to whom they are
> addressed. If you have received this email in error please notify the
> system manager. This message contains confidential information and is
> intended only for the individual named. If you are not the named
> addressee you should not disseminate, distribute or copy this e-mail.
> Please notify the sender immediately by e-mail if you have received this
> e-mail by mistake and delete this e-mail from your system. If you are
> not the intended recipient you are notified that disclosing, copying,
> distributing or taking any action in reliance on the contents of this
> information is strictly prohibited.
>

RE: Network Speed Testing and Monitoring Platform

[Luke Guillory]

Here is what you get.


resultDate

ipAddress

country

region

city

latitude

longitude

serverId

serverName

userAgent

connectionType

ispName

ispNameRaw

download (Kbps)

upload (Kbps)

ping (ms)

jitter

testId






From: Mike Hammett [mailto:na...@ics-il.net]
Sent: Friday, January 18, 2019 11:25 AM
To: Luke Guillory
Cc: NANOG; Aaron Gould; Colton Conor
Subject: Re: Network Speed Testing and Monitoring Platform

I haven't seen the level of reporting on the paid service because I don't have 
it, but I get reporting on a free, public server.


-
Mike Hammett
Intelligent Computing Solutions<http://www.ics-il.com/>
[http://www.ics-il.com/images/fbicon.png]<https://www.facebook.com/ICSIL>[http://www.ics-il.com/images/googleicon.png]<https://plus.google.com/+IntelligentComputingSolutionsDeKalb>[http://www.ics-il.com/images/linkedinicon.png]<https://www.linkedin.com/company/intelligent-computing-solutions>[http://www.ics-il.com/images/twittericon.png]<https://twitter.com/ICSIL>
Midwest Internet Exchange<http://www.midwest-ix.com/>
[http://www.ics-il.com/images/fbicon.png]<https://www.facebook.com/mdwestix>[http://www.ics-il.com/images/linkedinicon.png]<https://www.linkedin.com/company/midwest-internet-exchange>[http://www.ics-il.com/images/twittericon.png]<https://twitter.com/mdwestix>
The Brothers WISP<http://www.thebrotherswisp.com/>
[http://www.ics-il.com/images/fbicon.png]<https://www.facebook.com/thebrotherswisp>[http://www.ics-il.com/images/youtubeicon.png]<https://www.youtube.com/channel/UCXSdfxQv7SpoRQYNyLwntZg>

From: "Luke Guillory" 
mailto:lguill...@reservetele.com>>
To: "Aaron Gould" mailto:aar...@gvtc.com>>, "Colton Conor" 
mailto:colton.co...@gmail.com>>
Cc: "NANOG" mailto:nanog@nanog.org>>
Sent: Friday, January 18, 2019 11:22:21 AM
Subject: RE: Network Speed Testing and Monitoring Platform
The paid version gives you access to all the reporting from the test ran 
against your server.


Luke


Ns







From: NANOG [mailto:nanog-boun...@nanog.org] On Behalf Of Aaron Gould
Sent: Friday, January 18, 2019 11:18 AM
To: 'Colton Conor'
Cc: 'NANOG'
Subject: RE: Network Speed Testing and Monitoring Platform

I think the motivation for the paid/onsite version of ookla was so that we 
could say how good our customers speed is, without going through the internet.  
We can’t control utilization on the Internet, but we can internally.

-Aaron

From: Colton Conor [mailto:colton.co...@gmail.com]
Sent: Friday, January 18, 2019 8:37 AM
To: Aaron Gould
Cc: NANOG
Subject: Re: Network Speed Testing and Monitoring Platform

Aaron,

How does the https://account.speedtestcustom.com/login  differ from hosting a 
speedtest.net<http://speedtest.net> server as an ISP, and letting anyone test 
through it? Seems the speedtest custom is a paid option, but hosting a 
speedtest.net<http://speedtest.net> server is free if you allow it to the 
public domain. Sure it uses up bandwidth (which I am sure you have a ton of), 
so I don't see the point of having a custom one?

On Thu, Jan 17, 2019 at 10:27 AM Aaron Gould 
mailto:aar...@gvtc.com>> wrote:
https://github.com/adolfintel/speedtest - one drawback we’ve seen is upload 
test has issues on some iphones (maybe other mobile devices) in safari, but I 
think chrome might work, unsure

https://account.speedtestcustom.com/login - ookla customer speedtest – we have 
this running *internally* in our network on VM and also bare-metal, this is 
where our customers test locally

Iperf  - us engineers used it

wifiperf – us engineers used it

-Aaron

RE: Network Speed Testing and Monitoring Platform

[Luke Guillory]

The paid version gives you access to all the reporting from the test ran 
against your server.


Luke


Ns





From: NANOG [mailto:nanog-boun...@nanog.org] On Behalf Of Aaron Gould
Sent: Friday, January 18, 2019 11:18 AM
To: 'Colton Conor'
Cc: 'NANOG'
Subject: RE: Network Speed Testing and Monitoring Platform

I think the motivation for the paid/onsite version of ookla was so that we 
could say how good our customers speed is, without going through the internet.  
We can’t control utilization on the Internet, but we can internally.

-Aaron

From: Colton Conor [mailto:colton.co...@gmail.com]
Sent: Friday, January 18, 2019 8:37 AM
To: Aaron Gould
Cc: NANOG
Subject: Re: Network Speed Testing and Monitoring Platform

Aaron,

How does the https://account.speedtestcustom.com/login  differ from hosting a 
speedtest.net<http://speedtest.net> server as an ISP, and letting anyone test 
through it? Seems the speedtest custom is a paid option, but hosting a 
speedtest.net<http://speedtest.net> server is free if you allow it to the 
public domain. Sure it uses up bandwidth (which I am sure you have a ton of), 
so I don't see the point of having a custom one?

On Thu, Jan 17, 2019 at 10:27 AM Aaron Gould 
mailto:aar...@gvtc.com>> wrote:
https://github.com/adolfintel/speedtest - one drawback we’ve seen is upload 
test has issues on some iphones (maybe other mobile devices) in safari, but I 
think chrome might work, unsure

https://account.speedtestcustom.com/login - ookla customer speedtest – we have 
this running *internally* in our network on VM and also bare-metal, this is 
where our customers test locally

Iperf  - us engineers used it

wifiperf – us engineers used it

-Aaron

RE: Network Speed Testing and Monitoring Platform

[Aaron Gould]

I think the motivation for the paid/onsite version of ookla was so that we 
could say how good our customers speed is, without going through the internet.  
We can’t control utilization on the Internet, but we can internally.

 

-Aaron

 

From: Colton Conor [mailto:colton.co...@gmail.com] 
Sent: Friday, January 18, 2019 8:37 AM
To: Aaron Gould
Cc: NANOG
Subject: Re: Network Speed Testing and Monitoring Platform

 

Aaron,

 

How does the  <https://account.speedtestcustom.com/login> 
https://account.speedtestcustom.com/login  differ from hosting a speedtest.net 
server as an ISP, and letting anyone test through it? Seems the speedtest 
custom is a paid option, but hosting a speedtest.net server is free if you 
allow it to the public domain. Sure it uses up bandwidth (which I am sure you 
have a ton of), so I don't see the point of having a custom one? 

 

On Thu, Jan 17, 2019 at 10:27 AM Aaron Gould  wrote:

https://github.com/adolfintel/speedtest - one drawback we’ve seen is upload 
test has issues on some iphones (maybe other mobile devices) in safari, but I 
think chrome might work, unsure

 

https://account.speedtestcustom.com/login - ookla customer speedtest – we have 
this running *internally* in our network on VM and also bare-metal, this is 
where our customers test locally

 

Iperf  - us engineers used it

wifiperf – us engineers used it

 

-Aaron

 

Re: Network Speed Testing and Monitoring Platform

[Mike Hammett]

What's new in 6.44beta39 (2018-Nov-27 12:14): 
!) speedtest - added "/tool speed-test" for ping latency, jitter, loss and TCP 
and UDP download, upload speed measurements (CLI only); 




https://wiki.mikrotik.com/wiki/Manual:Tools/Speed_Test 
https://wiki.mikrotik.com/wiki/Manual:Tools/Traffic_Generator 
https://wiki.mikrotik.com/wiki/Manual:Tools/Bandwidth_Test 



- 
Mike Hammett 
Intelligent Computing Solutions 

Midwest Internet Exchange 

The Brothers WISP 

- Original Message -

From: "Colton Conor"  
To: "Mike Hammett"  
Cc: "Philip Loenneker" , "NANOG" 
 
Sent: Friday, January 18, 2019 8:31:58 AM 
Subject: Re: Network Speed Testing and Monitoring Platform 


Mike, 


So are you saying in Mikrotik, there is a Btest tool, a traffic generator tool, 
and a new speed-test tool? Sounds like this low cost CPE has a ton of options 
for remote speed test functionality? 


On Thu, Jan 17, 2019 at 5:16 PM Mike Hammett < na...@ics-il.net > wrote: 




Mikrotik RC has a new speed-test tool. I believe it's an improved BTEst. 




- 
Mike Hammett 
Intelligent Computing Solutions 

Midwest Internet Exchange 

The Brothers WISP 



From: "Philip Loenneker" < philip.loenne...@tasmanet.com.au > 
To: "NANOG" < nanog@nanog.org > 
Sent: Thursday, January 17, 2019 5:07:04 PM 
Subject: RE: Network Speed Testing and Monitoring Platform 



Connor, 

If you use the Traffic Generator tool instead of the Bandwidth Test tool built 
into MikroTik, you can definitely flood a 1Gbps link. However it requires the 
device to receive the packets that it has sent out, so it’s only viable for 
links with the same up/down speed. 

We have been investigating some TR-069 platforms, and several of those offer 
speed test functionality built in. This means our helpdesk guys can just click 
a few buttons to trigger it, it only talks to the CPE (nothing on customer 
LAN), and people don’t need to know how to configure the test other than “click 
here”. TR-069 also has a lot of other advantages which you can easily discover 
with a quick search. 

Regards, 
Philip Loenneker | Network Engineer | TasmaNet 

From: NANOG < nanog-boun...@nanog.org > On Behalf Of Colton Conor 
Sent: Friday, 18 January 2019 12:17 AM 
To: James Bensley < jwbens...@gmail.com > 
Cc: NANOG < nanog@nanog.org > 
Subject: Re: Network Speed Testing and Monitoring Platform 



All, thanks for the recommendations both on and off list. 




It has been brought to my attention that a Mikrotik has a bandwidth speed test 
tool built into their operating system. Someone recommended a 
https://mikrotik.com/product/hap_ac2 for MSRP of $69. The release notes of the 
newest version say: 



!) speedtest - added "/tool speed-test" for ping latency, jitter, loss and TCP 
and UDP download, upload speed measurements (CLI only); 
*) btest - added multithreading support for both UDP and TCP tests; 



Do you think this device can push a full 1Gbps connection? It does have a quad 
core qualcom processor. 



Besides mikrotik, I haven't found anything that doesn't require me to build a 
solution. Like OpenWRT with ipef3, or something like that. 



Seems like a commercial solution would exist for this. I though CAF providers 
have to test bandwidth for the FCC randomly to get funding? 



On Thu, Jan 17, 2019 at 2:59 AM James Bensley < jwbens...@gmail.com > wrote: 


On Wed, 16 Jan 2019 at 16:54, Colton Conor < colton.co...@gmail.com > wrote: 
> 
> As an internet service provider with many small business and residential 
> customers, our most common tech support calls are speed related. Customers 
> complaining on slow speeds, slowdowns, etc. 
> 
> We have a SNMP and ping monitoring platform today, but that mainly tells us 
> up-time and if data is flowing across the interface. We can of course see the 
> link speed, but customer call in saying the are not getting that speed. 
> 
> We are looking for a way to remotely test customers internet connections 
> besides telling the customer to go to speedtest.net , or worse sending a tech 
> out with a laptop to do the same thing. 
> 
> What opensource and commercial options are out there? 

Hi Colton, 

In the past I have used CPEs which support remote loopback. When the 
customer complains we enable remote loopback, send the traffic to that 
customers connection (rather than requiring a CPE that can generate 
the traffic or having an on site device) and measuring what comes 
back. 

Cheers, 
James. 

Re: Network Speed Testing and Monitoring Platform

[Colton Conor]

Aaron,

How does the https://account.speedtestcustom.com/login  differ from hosting
a speedtest.net server as an ISP, and letting anyone test through it? Seems
the speedtest custom is a paid option, but hosting a speedtest.net server
is free if you allow it to the public domain. Sure it uses up bandwidth
(which I am sure you have a ton of), so I don't see the point of having a
custom one?

On Thu, Jan 17, 2019 at 10:27 AM Aaron Gould  wrote:

> https://github.com/adolfintel/speedtest - one drawback we’ve seen is
> upload test has issues on some iphones (maybe other mobile devices) in
> safari, but I think chrome might work, unsure
>
>
>
> https://account.speedtestcustom.com/login - ookla customer speedtest – we
> have this running **internally** in our network on VM and also
> bare-metal, this is where our customers test locally
>
>
>
> Iperf  - us engineers used it
>
> wifiperf – us engineers used it
>
>
>
> -Aaron
>
>
>

Re: Network Speed Testing and Monitoring Platform

[Colton Conor]

Philip,

Which TR-069 tools are you referring to? I looked at TR-143, but its my
understanding it downloads a small file (like 50MB) from the TR-069 server
to the CPE's ram. Then uploads the file back. Unfortunately I couldn't see
how this would reliability test 1Gbps connections. Can you increase the
file size? Most of these modems have like 128MB ram right now?

On Thu, Jan 17, 2019 at 5:07 PM Philip Loenneker <
philip.loenne...@tasmanet.com.au> wrote:

> Connor,
>
>
>
> If you use the Traffic Generator tool instead of the Bandwidth Test tool
> built into MikroTik, you can definitely flood a 1Gbps link. However it
> requires the device to receive the packets that it has sent out, so it’s
> only viable for links with the same up/down speed.
>
>
>
> We have been investigating some TR-069 platforms, and several of those
> offer speed test functionality built in. This means our helpdesk guys can
> just click a few buttons to trigger it, it only talks to the CPE (nothing
> on customer LAN), and people don’t need to know how to configure the test
> other than “click here”. TR-069 also has a lot of other advantages which
> you can easily discover with a quick search.
>
>
>
> Regards,
>
> Philip Loenneker | Network Engineer | TasmaNet
>
>
>
> *From:* NANOG  *On Behalf Of *Colton Conor
> *Sent:* Friday, 18 January 2019 12:17 AM
> *To:* James Bensley 
> *Cc:* NANOG 
> *Subject:* Re: Network Speed Testing and Monitoring Platform
>
>
>
> All, thanks for the recommendations both on and off list.
>
>
>
> It has been brought to my attention that a Mikrotik has a bandwidth speed
> test tool built into their operating system. Someone recommended a
> https://mikrotik.com/product/hap_ac2 for MSRP of $69. The release notes
> of the newest version say:
>
>
>
> !) speedtest - added "/tool speed-test" for ping latency, jitter, loss and
> TCP and UDP download, upload speed measurements (CLI only);
> *) btest - added multithreading support for both UDP and TCP tests;
>
>
>
> Do you think this device can push a full 1Gbps connection? It does have a
> quad core qualcom processor.
>
>
>
> Besides mikrotik, I haven't found anything that doesn't require me to
> build a solution. Like OpenWRT with ipef3, or something like that.
>
>
>
> Seems like a commercial solution would exist for this.  I though CAF
> providers have to test bandwidth for the FCC randomly to get funding?
>
>
>
> On Thu, Jan 17, 2019 at 2:59 AM James Bensley  wrote:
>
> On Wed, 16 Jan 2019 at 16:54, Colton Conor  wrote:
> >
> > As an internet service provider with many small business and residential
> customers, our most common tech support calls are speed related. Customers
> complaining on slow speeds, slowdowns, etc.
> >
> > We have a SNMP and ping monitoring platform today, but that mainly tells
> us up-time and if data is flowing across the interface. We can of course
> see the link speed, but customer call in saying the are not getting that
> speed.
> >
> > We are looking for a way to remotely test customers internet connections
> besides telling the customer to go to speedtest.net, or worse sending a
> tech out with a laptop to do the same thing.
> >
> > What opensource and commercial options are out there?
>
> Hi Colton,
>
> In the past I have used CPEs which support remote loopback. When the
> customer complains we enable remote loopback, send the traffic to that
> customers connection (rather than requiring a CPE that can generate
> the traffic or having an on site device) and measuring what comes
> back.
>
> Cheers,
> James.
>
>

Re: Network Speed Testing and Monitoring Platform

[Colton Conor]

Mike,

So are you saying in Mikrotik, there is a Btest tool, a traffic generator
tool, and a new speed-test tool? Sounds like this low cost CPE has a ton of
options for remote speed test functionality?

On Thu, Jan 17, 2019 at 5:16 PM Mike Hammett  wrote:

> Mikrotik RC has a new speed-test tool. I believe it's an improved BTEst.
>
>
>
> -
> Mike Hammett
> Intelligent Computing Solutions <http://www.ics-il.com/>
> <https://www.facebook.com/ICSIL>
> <https://plus.google.com/+IntelligentComputingSolutionsDeKalb>
> <https://www.linkedin.com/company/intelligent-computing-solutions>
> <https://twitter.com/ICSIL>
> Midwest Internet Exchange <http://www.midwest-ix.com/>
> <https://www.facebook.com/mdwestix>
> <https://www.linkedin.com/company/midwest-internet-exchange>
> <https://twitter.com/mdwestix>
> The Brothers WISP <http://www.thebrotherswisp.com/>
> <https://www.facebook.com/thebrotherswisp>
> <https://www.youtube.com/channel/UCXSdfxQv7SpoRQYNyLwntZg>
> --------------
> *From: *"Philip Loenneker" 
> *To: *"NANOG" 
> *Sent: *Thursday, January 17, 2019 5:07:04 PM
> *Subject: *RE: Network Speed Testing and Monitoring Platform
>
> Connor,
>
>
>
> If you use the Traffic Generator tool instead of the Bandwidth Test tool
> built into MikroTik, you can definitely flood a 1Gbps link. However it
> requires the device to receive the packets that it has sent out, so it’s
> only viable for links with the same up/down speed.
>
>
>
> We have been investigating some TR-069 platforms, and several of those
> offer speed test functionality built in. This means our helpdesk guys can
> just click a few buttons to trigger it, it only talks to the CPE (nothing
> on customer LAN), and people don’t need to know how to configure the test
> other than “click here”. TR-069 also has a lot of other advantages which
> you can easily discover with a quick search.
>
>
>
> Regards,
>
> Philip Loenneker | Network Engineer | TasmaNet
>
>
>
> *From:* NANOG  *On Behalf Of *Colton Conor
> *Sent:* Friday, 18 January 2019 12:17 AM
> *To:* James Bensley 
> *Cc:* NANOG 
> *Subject:* Re: Network Speed Testing and Monitoring Platform
>
>
>
> All, thanks for the recommendations both on and off list.
>
>
>
> It has been brought to my attention that a Mikrotik has a bandwidth speed
> test tool built into their operating system. Someone recommended a
> https://mikrotik.com/product/hap_ac2 for MSRP of $69. The release notes
> of the newest version say:
>
>
>
> !) speedtest - added "/tool speed-test" for ping latency, jitter, loss and
> TCP and UDP download, upload speed measurements (CLI only);
> *) btest - added multithreading support for both UDP and TCP tests;
>
>
>
> Do you think this device can push a full 1Gbps connection? It does have a
> quad core qualcom processor.
>
>
>
> Besides mikrotik, I haven't found anything that doesn't require me to
> build a solution. Like OpenWRT with ipef3, or something like that.
>
>
>
> Seems like a commercial solution would exist for this.  I though CAF
> providers have to test bandwidth for the FCC randomly to get funding?
>
>
>
> On Thu, Jan 17, 2019 at 2:59 AM James Bensley  wrote:
>
> On Wed, 16 Jan 2019 at 16:54, Colton Conor  wrote:
> >
> > As an internet service provider with many small business and residential
> customers, our most common tech support calls are speed related. Customers
> complaining on slow speeds, slowdowns, etc.
> >
> > We have a SNMP and ping monitoring platform today, but that mainly tells
> us up-time and if data is flowing across the interface. We can of course
> see the link speed, but customer call in saying the are not getting that
> speed.
> >
> > We are looking for a way to remotely test customers internet connections
> besides telling the customer to go to speedtest.net, or worse sending a
> tech out with a laptop to do the same thing.
> >
> > What opensource and commercial options are out there?
>
> Hi Colton,
>
> In the past I have used CPEs which support remote loopback. When the
> customer complains we enable remote loopback, send the traffic to that
> customers connection (rather than requiring a CPE that can generate
> the traffic or having an on site device) and measuring what comes
> back.
>
> Cheers,
> James.
>
>
>

Re: Network Speed Testing and Monitoring Platform

[Mike Hammett]

Mikrotik RC has a new speed-test tool. I believe it's an improved BTEst. 




- 
Mike Hammett 
Intelligent Computing Solutions 

Midwest Internet Exchange 

The Brothers WISP 

- Original Message -

From: "Philip Loenneker"  
To: "NANOG"  
Sent: Thursday, January 17, 2019 5:07:04 PM 
Subject: RE: Network Speed Testing and Monitoring Platform 



Connor, 

If you use the Traffic Generator tool instead of the Bandwidth Test tool built 
into MikroTik, you can definitely flood a 1Gbps link. However it requires the 
device to receive the packets that it has sent out, so it’s only viable for 
links with the same up/down speed. 

We have been investigating some TR-069 platforms, and several of those offer 
speed test functionality built in. This means our helpdesk guys can just click 
a few buttons to trigger it, it only talks to the CPE (nothing on customer 
LAN), and people don’t need to know how to configure the test other than “click 
here”. TR-069 also has a lot of other advantages which you can easily discover 
with a quick search. 

Regards, 
Philip Loenneker | Network Engineer | TasmaNet 

From: NANOG  On Behalf Of Colton Conor 
Sent: Friday, 18 January 2019 12:17 AM 
To: James Bensley  
Cc: NANOG  
Subject: Re: Network Speed Testing and Monitoring Platform 



All, thanks for the recommendations both on and off list. 




It has been brought to my attention that a Mikrotik has a bandwidth speed test 
tool built into their operating system. Someone recommended a 
https://mikrotik.com/product/hap_ac2 for MSRP of $69. The release notes of the 
newest version say: 



!) speedtest - added "/tool speed-test" for ping latency, jitter, loss and TCP 
and UDP download, upload speed measurements (CLI only); 
*) btest - added multithreading support for both UDP and TCP tests; 



Do you think this device can push a full 1Gbps connection? It does have a quad 
core qualcom processor. 



Besides mikrotik, I haven't found anything that doesn't require me to build a 
solution. Like OpenWRT with ipef3, or something like that. 



Seems like a commercial solution would exist for this. I though CAF providers 
have to test bandwidth for the FCC randomly to get funding? 



On Thu, Jan 17, 2019 at 2:59 AM James Bensley < jwbens...@gmail.com > wrote: 


On Wed, 16 Jan 2019 at 16:54, Colton Conor < colton.co...@gmail.com > wrote: 
> 
> As an internet service provider with many small business and residential 
> customers, our most common tech support calls are speed related. Customers 
> complaining on slow speeds, slowdowns, etc. 
> 
> We have a SNMP and ping monitoring platform today, but that mainly tells us 
> up-time and if data is flowing across the interface. We can of course see the 
> link speed, but customer call in saying the are not getting that speed. 
> 
> We are looking for a way to remotely test customers internet connections 
> besides telling the customer to go to speedtest.net , or worse sending a tech 
> out with a laptop to do the same thing. 
> 
> What opensource and commercial options are out there? 

Hi Colton, 

In the past I have used CPEs which support remote loopback. When the 
customer complains we enable remote loopback, send the traffic to that 
customers connection (rather than requiring a CPE that can generate 
the traffic or having an on site device) and measuring what comes 
back. 

Cheers, 
James. 

RE: Network Speed Testing and Monitoring Platform

[Philip Loenneker]

Connor,

If you use the Traffic Generator tool instead of the Bandwidth Test tool built 
into MikroTik, you can definitely flood a 1Gbps link. However it requires the 
device to receive the packets that it has sent out, so it’s only viable for 
links with the same up/down speed.

We have been investigating some TR-069 platforms, and several of those offer 
speed test functionality built in. This means our helpdesk guys can just click 
a few buttons to trigger it, it only talks to the CPE (nothing on customer 
LAN), and people don’t need to know how to configure the test other than “click 
here”. TR-069 also has a lot of other advantages which you can easily discover 
with a quick search.

Regards,
Philip Loenneker | Network Engineer | TasmaNet

From: NANOG  On Behalf Of Colton Conor
Sent: Friday, 18 January 2019 12:17 AM
To: James Bensley 
Cc: NANOG 
Subject: Re: Network Speed Testing and Monitoring Platform

All, thanks for the recommendations both on and off list.

It has been brought to my attention that a Mikrotik has a bandwidth speed test 
tool built into their operating system. Someone recommended a 
https://mikrotik.com/product/hap_ac2 for MSRP of $69. The release notes of the 
newest version say:

!) speedtest - added "/tool speed-test" for ping latency, jitter, loss and TCP 
and UDP download, upload speed measurements (CLI only);
*) btest - added multithreading support for both UDP and TCP tests;

Do you think this device can push a full 1Gbps connection? It does have a quad 
core qualcom processor.

Besides mikrotik, I haven't found anything that doesn't require me to build a 
solution. Like OpenWRT with ipef3, or something like that.

Seems like a commercial solution would exist for this.  I though CAF providers 
have to test bandwidth for the FCC randomly to get funding?

On Thu, Jan 17, 2019 at 2:59 AM James Bensley 
mailto:jwbens...@gmail.com>> wrote:
On Wed, 16 Jan 2019 at 16:54, Colton Conor 
mailto:colton.co...@gmail.com>> wrote:
>
> As an internet service provider with many small business and residential 
> customers, our most common tech support calls are speed related. Customers 
> complaining on slow speeds, slowdowns, etc.
>
> We have a SNMP and ping monitoring platform today, but that mainly tells us 
> up-time and if data is flowing across the interface. We can of course see the 
> link speed, but customer call in saying the are not getting that speed.
>
> We are looking for a way to remotely test customers internet connections 
> besides telling the customer to go to speedtest.net<http://speedtest.net>, or 
> worse sending a tech out with a laptop to do the same thing.
>
> What opensource and commercial options are out there?

Hi Colton,

In the past I have used CPEs which support remote loopback. When the
customer complains we enable remote loopback, send the traffic to that
customers connection (rather than requiring a CPE that can generate
the traffic or having an on site device) and measuring what comes
back.

Cheers,
James.

Re: Network Speed Testing and Monitoring Platform

[Blake Hudson]

Zach Puls wrote on 1/16/2019 1:53 PM:


Maybe try setting up an Ookla on-site speedtest server? I believe the 
product is called Speedtest Custom. Setup is pretty simple, and is 
relatively inexpensive.


That gives you the ease-of-use of speedtest.net, with the accuracy 
similar to having a local iperf server.


*Zach Puls*

/Network Engineer /

/MEF-CECP/

Title: KsFiberNet - Description: Macintosh 
HD:Users:chunt:Documents:Logos_Brand 
Guide_KFN:WEB_logos:KFN_logo-WEB.png **


Direct: +1 (316) 221-2094

Email: zp...@ksfiber.net 

*Technical Support:  855-KFN-HELP (536-4357) *

/This e-mail, including any attachments, is intended only for the 
person or entity to which it is addressed and may contain 
confidential, proprietary and/or privileged material. Any review, 
retransmission, dissemination or other use of this information, 
directly or indirectly, by persons or entities other than the intended 
recipient is prohibited and may subject you to legal liability. If you 
received this in error, please contact the sender and delete the 
material from all computers in which it resides. This email, including 
any attachments, is not intended to constitute the formation of a 
contract binding KsFiberNet. KsFiberNet will be contractually bound 
only upon execution, by an authorized representative, of a definitive 
agreement containing agreed upon terms and conditions./





Last time I checked, the Ookla Speedtest Custom software license 
required for a local server installation (e.g. not using the public 
speedtest servers) started at ~$2k/year. That does not include the 
speedtest server hardware which may run you another $2k or more if you 
want to meet the minimum recommended specs for a gigabit speedtest. 
Perhaps an initial investment of $4k and a reoccurring $2k/year is 
inexpensive for some, but I can imagine some folks will struggle to find 
the value at that price point.


--Blake

Re: Network Speed Testing and Monitoring Platform

[rapier]

Hello all,

A colleague of mine pointed out this conversation to me. I'm not sure 
this is going to be the best solution to your problem but it may be 
helpful in some instances or for other people.


At PSC we also have to deal with customers complaining of speed issues. 
Generally speaking this is all on the customer end but diagnosing these 
issues remotely, especially when people have limited access or skills, 
is huge time sink. It's compounded by the fact that many times we're 
trying to work over a number of different operating systems 
configurations and so forth.


In order to cut down on that we created a service called TestRig2.0. In 
short, it dynamically generates an bootable ISO that automatically runs 
the host system through a number of network performance tests, packages 
the results, and send them back the network engineers via scp. The tests 
are run against the perfSonar infrastructure*. The reason why we use a 
bootable ISO is because we want to make sure that the tests are being 
conducted under a known good OS environment.


Additionally, we can also limit the number of tests the users can run - 
either by restricting them to specific time frame (say 7 days) or a 
total number of runs. After that the ISO will no longer conduct the tests.


If anyone is interested please take a look at https://testrig.psc.edu/ 
for more information. If you are interested in using the service let me 
know. Setting up an account is pretty easy but I'd like to work with 
people in the initial process.


Thanks,

Chris Rapier

* Not all commodity users will have access to all of the perfSonar nodes 
so this is a part where some extra work might be required on the part of 
the engineer.

Re: Network Speed Testing and Monitoring Platform

[R. Scott Evans]

In the US this type of testing may be an actual requirement for some 
ISP's if they get funding from the government.


https://docs.fcc.gov/public/attachments/DA-18-710A1.pdf

We provide basic CPE routers to our DSL & FTTH customers and are trying to get 
a custom firmware from the device manufacturer (Comtrend) to do these measurements. 
 We're not there yet (the manufacturer has been working with us on it but it's not 
very accurate yet) but the goal is to have a TR-143 client on the routers 
themselves that then talks to our test server (although per the FCC rule, we'll 
eventually have to place the test server at an FCC approved IX).

Alternatively, at a trade show I saw a product called a BETTI Box by VantagePoint 
that is a very small whitebox (maybe a 1" cube w/ eth port) to do this.  I only 
saw the device on a table so have no idea how effective or how much the device is.

On 1/16/19 11:52 AM, Colton Conor wrote:
As an internet service provider with many small business and 
residential customers, our most common tech support calls are speed 
related. Customers complaining on slow speeds, slowdowns, etc.


We have a SNMP and ping monitoring platform today, but that mainly 
tells us up-time and if data is flowing across the interface. We can 
of course see the link speed, but customer call in saying the are not 
getting that speed.


We are looking for a way to remotely test customers internet 
connections besides telling the customer to go to speedtest.net 
, or worse sending a tech out with a laptop to 
do the same thing.


What opensource and commercial options are out there?

RE: Network Speed Testing and Monitoring Platform

[Zach Puls]

Maybe try setting up an Ookla on-site speedtest server? I believe the product 
is called Speedtest Custom. Setup is pretty simple, and is relatively 
inexpensive.

That gives you the ease-of-use of speedtest.net, with the accuracy similar to 
having a local iperf server.

Zach Puls
Network Engineer
MEF-CECP
[Title: KsFiberNet - Description: Macintosh 
HD:Users:chunt:Documents:Logos_Brand 
Guide_KFN:WEB_logos:KFN_logo-WEB.png]<http://www.ksfiber.net/>
Direct: +1 (316) 221-2094
Email:  zp...@ksfiber.net<mailto:zp...@ksfiber.net>
Technical Support:  855-KFN-HELP (536-4357)
This e-mail, including any attachments, is intended only for the person or 
entity to which it is addressed and may contain confidential, proprietary 
and/or privileged material. Any review, retransmission, dissemination or other 
use of this information, directly or indirectly, by persons or entities other 
than the intended recipient is prohibited and may subject you to legal 
liability. If you received this in error, please contact the sender and delete 
the material from all computers in which it resides. This email, including any 
attachments, is not intended to constitute the formation of a contract binding 
KsFiberNet. KsFiberNet will be contractually bound only upon execution, by an 
authorized representative, of a definitive agreement containing agreed upon 
terms and conditions.

From: NANOG  On Behalf Of Casey Russell
Sent: Wednesday, January 16, 2019 13:46
To: Chris Kimball 
Cc: NANOG 
Subject: Re: Network Speed Testing and Monitoring Platform

I don't think a raspberry pi will reliably fill a full Gig and keep it full 
(maybe that's not required in this scenario), but I've installed a Linux based 
OS with the PerfSONAR tools (including iperf) on a couple of different mini PCs 
in the "few hundred dollars" price range.

The last one was the Liva X from ECS.  It was more than capable of filling 1G 
circuits with traffic and keeping them full without loss or wonky results due 
to things like CPU overrun or other processes causing bus contention.  I'm 
pretty sure the Liva X is retired now, but their current gen should suffice as 
should a number of comparable competitors.

Sincerely,
Casey Russell
Network Engineer
[KanREN]<http://www.kanren.net>
[phone]785-856-9809
2029 Becker Drive, Suite 282
Lawrence, Kansas 66047
[linkedin]<https://www.linkedin.com/company/92399?trk=tyah=clickedVertical%3Acompany%2CclickedEntityId%3A92399%2Cidx%3A1-1-1%2CtarId%3A1440002635645%2Ctas%3AKanREN>[twitter]<https://twitter.com/TheKanREN>[twitter]<http://www.kanren.net/feed/>need
 support?<mailto:supp...@kanren.net>



On Wed, Jan 16, 2019 at 1:27 PM Chris Kimball 
mailto:ckimb...@misalliance.com>> wrote:
Would a raspberry pi work for this?

Could 3D print a nice case with your logo for it.

From: NANOG mailto:nanog-boun...@nanog.org>> On Behalf 
Of Colton Conor
Sent: Wednesday, January 16, 2019 2:16 PM
To: David Guo mailto:da...@xtom.com>>
Cc: NANOG mailto:nanog@nanog.org>>
Subject: Re: Network Speed Testing and Monitoring Platform

Last time I setup Iperf3 it was semi difficult, and would be impossible trying 
to coach a soccer mom on how to setup over the phone.

I am leaning towards a CPE that has speed test built in, or a low cost, sub 
$100 device we could ship to the customer to install. Anyone know of something 
like that?

On Wed, Jan 16, 2019 at 10:55 AM David Guo 
mailto:da...@xtom.com>> wrote:
We ask our customers use iperf3 to test speed.

Get Outlook for iOS<https://aka.ms/o0ukef>


From: NANOG mailto:nanog-boun...@nanog.org>> on behalf 
of Colton Conor mailto:colton.co...@gmail.com>>
Sent: Thursday, January 17, 2019 00:54
To: NANOG
Subject: Network Speed Testing and Monitoring Platform

As an internet service provider with many small business and residential 
customers, our most common tech support calls are speed related. Customers 
complaining on slow speeds, slowdowns, etc.

We have a SNMP and ping monitoring platform today, but that mainly tells us 
up-time and if data is flowing across the interface. We can of course see the 
link speed, but customer call in saying the are not getting that speed.

We are looking for a way to remotely test customers internet connections 
besides telling the customer to go to speedtest.net<http://speedtest.net>, or 
worse sending a tech out with a laptop to do the same thing.

What opensource and commercial options are out there?

- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - 
- - -

The information contained in this electronic message may be confidential, and 
the message is for the use of intended recipients only. If you are not the 
intended recipient, do not disseminate, copy, or disclose this communication or 
its contents. If you have received this communication in error, please 
immediately notify me by replying to the email or call MIS Alliance at 
617-500-1700 and permanently delete this communication.

Re: Network Speed Testing and Monitoring Platform

[Chris Boyd]

> On Jan 17, 2019, at 7:17 AM, Colton Conor  wrote:
> 
> Besides mikrotik, I haven't found anything that doesn't require me to build a 
> solution. Like OpenWRT with ipef3, or something like that. 
> 
> Seems like a commercial solution would exist for this.  I though CAF 
> providers have to test bandwidth for the FCC randomly to get funding? 

Bias note—I know the founders.  The product is voice focused, but it does 
include the capability to run a speed test, and has all the cloud based 
reporting features that you’d expect today.

https://www.replycloud.io

—Chris

RE: Network Speed Testing and Monitoring Platform

[Aaron Gould]

https://github.com/adolfintel/speedtest - one drawback we’ve seen is upload 
test has issues on some iphones (maybe other mobile devices) in safari, but I 
think chrome might work, unsure

 

https://account.speedtestcustom.com/login - ookla customer speedtest – we have 
this running *internally* in our network on VM and also bare-metal, this is 
where our customers test locally

 

Iperf  - us engineers used it

wifiperf – us engineers used it

 

-Aaron

 

Re: Network Speed Testing and Monitoring Platform

[Livingood, Jason]

We ran into an issue with RPi and Banana Pi hitting multi-hundred meg and 1 - 2 
gig speeds reliably, and ended up using ODROID - https://www.hardkernel.com/. 

Also, Ookla (speedtest.net) have a software client that can be embedded in CPE 
gateway devices as does SamKnows. 

JL

On 1/16/19, 3:49 PM, "NANOG on behalf of valdis.kletni...@vt.edu" 
 wrote:

On Wed, 16 Jan 2019 19:26:41 +, Chris Kimball said:
> Would a raspberry pi work for this?
>
> Could 3D print a nice case with your logo for it.

The Pi has a bandwidth limit at 300mbits/sec due to a USB port being used.

I wonder if something like the RIPE Atlas probes could be flashed with 
suitable
code.  They're smaller than a Pi, and easy to set up - connect a USB power 
cord
and an RJ45 on some cat-5 and away you go.  Mine showed up with the two 
cords
needed and everything.


https://www-static.ripe.net/static/rnd-ui/atlas/static/docs/probe-images/v1.jpg

Re: Network Speed Testing and Monitoring Platform

[Aled Morris via NANOG]

On Wed, 16 Jan 2019 at 20:49,  wrote:

> On Wed, 16 Jan 2019 19:26:41 +, Chris Kimball said:
> > Would a raspberry pi work for this?
> >
> > Could 3D print a nice case with your logo for it.
>
> The Pi has a bandwidth limit at 300mbits/sec due to a USB port being used.
>

I've been using Hardkernel Odroid  C2 for this reason.  It looks a bit like
a Pi but its Gigabit Ethernet can achieve near line rate, 930+ Mbps on
iperf, see below for two Odroids connected across a gigabit ethernet switch.

Aled


# iperf3 -c 172.16.0.139
Connecting to host 172.16.0.139, port 5201
[  4] local 172.16.0.142 port 49203 connected to 172.16.0.139 port 5201
[ ID] Interval   Transfer Bandwidth   Retr  Cwnd
[  4]   0.00-1.00   sec   110 MBytes   921 Mbits/sec   45788 KBytes

[  4]   1.00-2.00   sec   112 MBytes   937 Mbits/sec0878 KBytes

[  4]   2.00-3.00   sec   112 MBytes   939 Mbits/sec   45672 KBytes

[  4]   3.00-4.00   sec   112 MBytes   938 Mbits/sec0717 KBytes

[  4]   4.00-5.00   sec   112 MBytes   938 Mbits/sec0748 KBytes

[  4]   5.00-6.00   sec   112 MBytes   939 Mbits/sec0765 KBytes

[  4]   6.00-7.00   sec   112 MBytes   939 Mbits/sec0773 KBytes

[  4]   7.00-8.00   sec   112 MBytes   939 Mbits/sec0775 KBytes

[  4]   8.00-9.00   sec   112 MBytes   938 Mbits/sec0778 KBytes

[  4]   9.00-10.00  sec   112 MBytes   938 Mbits/sec0779 KBytes

- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval   Transfer Bandwidth   Retr
[  4]   0.00-10.00  sec  1.09 GBytes   937 Mbits/sec   90 sender
[  4]   0.00-10.00  sec  1.09 GBytes   933 Mbits/sec
 receiver

iperf Done.

Re: Network Speed Testing and Monitoring Platform

[Alain Hebert]

    Yeah,

    There is not enough capacity, interrupt wise, to achieve it.

    OpenSpeedTest works for us.

-
Alain Hebertaheb...@pubnix.net
PubNIX Inc.
50 boul. St-Charles
P.O. Box 26770 Beaconsfield, Quebec H9W 6G7
Tel: 514-990-5911  http://www.pubnix.netFax: 514-990-9443

On 1/16/19 2:45 PM, Casey Russell wrote:
I don't think a raspberry pi will reliably fill a full Gig and keep it 
full (maybe that's not required in this scenario), but I've installed 
a Linux based OS with the PerfSONAR tools (including iperf) on a 
couple of different mini PCs in the "few hundred dollars" price range.


The last one was the Liva X from ECS.  It was more than capable of 
filling 1G circuits with traffic and keeping them full without loss or 
wonky results due to things like CPU overrun or other processes 
causing bus contention.  I'm pretty sure the Liva X is retired now, 
but their current gen should suffice as should a number of comparable 
competitors.


Sincerely,
Casey Russell
Network Engineer
KanREN <http://www.kanren.net>
phone785-856-9809
2029 Becker Drive, Suite 282
Lawrence, Kansas 66047
linkedin 
<https://www.linkedin.com/company/92399?trk=tyah=clickedVertical%3Acompany%2CclickedEntityId%3A92399%2Cidx%3A1-1-1%2CtarId%3A1440002635645%2Ctas%3AKanREN> 
twitter <https://twitter.com/TheKanREN> twitter 
<http://www.kanren.net/feed/> need support? <mailto:supp...@kanren.net>




On Wed, Jan 16, 2019 at 1:27 PM Chris Kimball 
mailto:ckimb...@misalliance.com>> wrote:


Would a raspberry pi work for this?

Could 3D print a nice case with your logo for it.

*From:* NANOG mailto:nanog-boun...@nanog.org>> *On Behalf Of *Colton Conor
*Sent:* Wednesday, January 16, 2019 2:16 PM
*To:* David Guo mailto:da...@xtom.com>>
    *Cc:* NANOG mailto:nanog@nanog.org>>
*Subject:* Re: Network Speed Testing and Monitoring Platform

Last time I setup Iperf3 it was semi difficult, and would be
impossible trying to coach a soccer mom on how to setup over the
phone.

I am leaning towards a CPE that has speed test built in, or a low
cost, sub $100 device we could ship to the customer to install.
Anyone know of something like that?

On Wed, Jan 16, 2019 at 10:55 AM David Guo mailto:da...@xtom.com>> wrote:

We ask our customers use iperf3 to test speed.

Get Outlook for iOS <https://aka.ms/o0ukef>



*From:*NANOG mailto:nanog-boun...@nanog.org>> on behalf of Colton Conor
mailto:colton.co...@gmail.com>>
*Sent:* Thursday, January 17, 2019 00:54
*To:* NANOG
*Subject:* Network Speed Testing and Monitoring Platform

As an internet service provider with many small business and
residential customers, our most common tech support calls are
speed related. Customers complaining on slow speeds,
slowdowns, etc.

We have a SNMP and ping monitoring platform today, but that
mainly tells us up-time and if data is flowing across the
interface. We can of course see the link speed, but customer
call in saying the are not getting that speed.

We are looking for a way to remotely test customers internet
connections besides telling the customer to go to
speedtest.net <http://speedtest.net>, or worse sending a tech
out with a laptop to do the same thing.

What opensource and commercial options are out there?

- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
- - - - - - - - - -

The information contained in this electronic message may be
confidential, and the message is for the use of intended
recipients only. If you are not the intended recipient, do not
disseminate, copy, or disclose this communication or its contents.
If you have received this communication in error, please
immediately notify me by replying to the email or call MIS
Alliance at 617-500-1700 and permanently delete this communication.

Re: Network Speed Testing and Monitoring Platform

[Eric Dugas]

There's a Montreal startup called Obkio who are doing network probes (VM
and hardware). I've tested the product in its early phase (i.e. it was
lacking features that are now implemented or are going to be implemented
soon).

They recently launched the speed test feature:
https://medium.com/obkio/app-new-release-v1-6-0-public-agents-support-chat-and-speed-tests-c84651f7008a
and launched a beefier probe called X5001 which can supposedly do 940Mbps:
https://medium.com/obkio/new-hardware-agent-x5001-the-10x-agent-b278e435c458

I think it's worth a look.

Disclaimer: the CEO is an acquaintance of mine

Eric

On Thu, Jan 17, 2019 at 9:04 AM tgrand via NANOG  wrote:

> Just download the btest.exe
> It run on windows PC.
> Most routerboards not fast enough for TCP test as TCP packet assembly is
> intensive.
>
>
> Sent from my Samsung Galaxy smartphone.
>
>  Original message 
> From: Colton Conor 
> Date: 2019-01-17 7:17 AM (GMT-06:00)
> To: James Bensley 
> Cc: NANOG 
> Subject: Re: Network Speed Testing and Monitoring Platform
>
> All, thanks for the recommendations both on and off list.
>
> It has been brought to my attention that a Mikrotik has a bandwidth speed
> test tool built into their operating system. Someone recommended a
> https://mikrotik.com/product/hap_ac2 for MSRP of $69. The release notes
> of the newest version say:
>
> !) speedtest - added "/tool speed-test" for ping latency, jitter, loss and
> TCP and UDP download, upload speed measurements (CLI only);
> *) btest - added multithreading support for both UDP and TCP tests;
>
> Do you think this device can push a full 1Gbps connection? It does have a
> quad core qualcom processor.
>
> Besides mikrotik, I haven't found anything that doesn't require me to
> build a solution. Like OpenWRT with ipef3, or something like that.
>
> Seems like a commercial solution would exist for this.  I though CAF
> providers have to test bandwidth for the FCC randomly to get funding?
>
> On Thu, Jan 17, 2019 at 2:59 AM James Bensley  wrote:
>
>> On Wed, 16 Jan 2019 at 16:54, Colton Conor 
>> wrote:
>> >
>> > As an internet service provider with many small business and
>> residential customers, our most common tech support calls are speed
>> related. Customers complaining on slow speeds, slowdowns, etc.
>> >
>> > We have a SNMP and ping monitoring platform today, but that mainly
>> tells us up-time and if data is flowing across the interface. We can of
>> course see the link speed, but customer call in saying the are not getting
>> that speed.
>> >
>> > We are looking for a way to remotely test customers internet
>> connections besides telling the customer to go to speedtest.net, or
>> worse sending a tech out with a laptop to do the same thing.
>> >
>> > What opensource and commercial options are out there?
>>
>> Hi Colton,
>>
>> In the past I have used CPEs which support remote loopback. When the
>> customer complains we enable remote loopback, send the traffic to that
>> customers connection (rather than requiring a CPE that can generate
>> the traffic or having an on site device) and measuring what comes
>> back.
>>
>> Cheers,
>> James.
>>
>

Re: Network Speed Testing and Monitoring Platform

[tgrand via NANOG]

Just download the btest.exeIt run on windows PC.Most routerboards not fast 
enough for TCP test as TCP packet assembly is intensive.

Sent from my Samsung Galaxy smartphone.
 Original message From: Colton Conor  
Date: 2019-01-17  7:17 AM  (GMT-06:00) To: James Bensley  
Cc: NANOG  Subject: Re: Network Speed Testing and Monitoring 
Platform 
All, thanks for the recommendations both on and off list.

It has been brought to my attention that a Mikrotik has a bandwidth speed test 
tool built into their operating system. Someone recommended a 
https://mikrotik.com/product/hap_ac2 for MSRP of $69. The release notes of the 
newest version say:
!) speedtest - added "/tool speed-test" for ping latency, jitter, loss and TCP 
and UDP download, upload speed measurements (CLI only);
*) btest - added multithreading support for both UDP and TCP tests; 
Do you think this device can push a full 1Gbps connection? It does have a quad 
core qualcom processor. 
Besides mikrotik, I haven't found anything that doesn't require me to build a 
solution. Like OpenWRT with ipef3, or something like that. 
Seems like a commercial solution would exist for this.  I though CAF providers 
have to test bandwidth for the FCC randomly to get funding? 

On Thu, Jan 17, 2019 at 2:59 AM James Bensley  wrote:
On Wed, 16 Jan 2019 at 16:54, Colton Conor  wrote:

>

> As an internet service provider with many small business and residential 
> customers, our most common tech support calls are speed related. Customers 
> complaining on slow speeds, slowdowns, etc.

>

> We have a SNMP and ping monitoring platform today, but that mainly tells us 
> up-time and if data is flowing across the interface. We can of course see the 
> link speed, but customer call in saying the are not getting that speed.

>

> We are looking for a way to remotely test customers internet connections 
> besides telling the customer to go to speedtest.net, or worse sending a tech 
> out with a laptop to do the same thing.

>

> What opensource and commercial options are out there?



Hi Colton,



In the past I have used CPEs which support remote loopback. When the

customer complains we enable remote loopback, send the traffic to that

customers connection (rather than requiring a CPE that can generate

the traffic or having an on site device) and measuring what comes

back.



Cheers,

James.

Re: Network Speed Testing and Monitoring Platform

[Colton Conor]

All, thanks for the recommendations both on and off list.

It has been brought to my attention that a Mikrotik has a bandwidth speed
test tool built into their operating system. Someone recommended a
https://mikrotik.com/product/hap_ac2 for MSRP of $69. The release notes of
the newest version say:

!) speedtest - added "/tool speed-test" for ping latency, jitter, loss and
TCP and UDP download, upload speed measurements (CLI only);
*) btest - added multithreading support for both UDP and TCP tests;

Do you think this device can push a full 1Gbps connection? It does have a
quad core qualcom processor.

Besides mikrotik, I haven't found anything that doesn't require me to build
a solution. Like OpenWRT with ipef3, or something like that.

Seems like a commercial solution would exist for this.  I though CAF
providers have to test bandwidth for the FCC randomly to get funding?

On Thu, Jan 17, 2019 at 2:59 AM James Bensley  wrote:

> On Wed, 16 Jan 2019 at 16:54, Colton Conor  wrote:
> >
> > As an internet service provider with many small business and residential
> customers, our most common tech support calls are speed related. Customers
> complaining on slow speeds, slowdowns, etc.
> >
> > We have a SNMP and ping monitoring platform today, but that mainly tells
> us up-time and if data is flowing across the interface. We can of course
> see the link speed, but customer call in saying the are not getting that
> speed.
> >
> > We are looking for a way to remotely test customers internet connections
> besides telling the customer to go to speedtest.net, or worse sending a
> tech out with a laptop to do the same thing.
> >
> > What opensource and commercial options are out there?
>
> Hi Colton,
>
> In the past I have used CPEs which support remote loopback. When the
> customer complains we enable remote loopback, send the traffic to that
> customers connection (rather than requiring a CPE that can generate
> the traffic or having an on site device) and measuring what comes
> back.
>
> Cheers,
> James.
>

Re: Network Speed Testing and Monitoring Platform

[James Bensley]

On Wed, 16 Jan 2019 at 16:54, Colton Conor  wrote:
>
> As an internet service provider with many small business and residential 
> customers, our most common tech support calls are speed related. Customers 
> complaining on slow speeds, slowdowns, etc.
>
> We have a SNMP and ping monitoring platform today, but that mainly tells us 
> up-time and if data is flowing across the interface. We can of course see the 
> link speed, but customer call in saying the are not getting that speed.
>
> We are looking for a way to remotely test customers internet connections 
> besides telling the customer to go to speedtest.net, or worse sending a tech 
> out with a laptop to do the same thing.
>
> What opensource and commercial options are out there?

Hi Colton,

In the past I have used CPEs which support remote loopback. When the
customer complains we enable remote loopback, send the traffic to that
customers connection (rather than requiring a CPE that can generate
the traffic or having an on site device) and measuring what comes
back.

Cheers,
James.

Re: Network Speed Testing and Monitoring Platform

[James R Cutler]

On Jan 16, 2019, at 4:01 PM, valdis.kletni...@vt.edu wrote:
> 
> So out of curiosity - does anybody have info on what percentage of residential
> internet connections are on CPE that's been suitably de-bufferbloated?

I have not read anything suggesting that de-bufferbloating has happened. It 
would be nice to see something.

I participated in bufferbloat testing on Comcast Business Internet some years 
ago and have never seen any results published.

James R. Cutler
james.cut...@consultant.com
GPG keys: hkps://hkps.pool.sks-keyservers.net

Re: Network Speed Testing and Monitoring Platform

[valdis . kletnieks]

On Wed, 16 Jan 2019 10:52:58 -0600, Colton Conor said:
> As an internet service provider with many small business and residential
> customers, our most common tech support calls are speed related. Customers
> complaining on slow speeds, slowdowns, etc.

So out of curiosity - does anybody have info on what percentage of residential
internet connections are on CPE that's been suitably de-bufferbloated?

Re: Network Speed Testing and Monitoring Platform

[valdis . kletnieks]

On Wed, 16 Jan 2019 19:26:41 +, Chris Kimball said:
> Would a raspberry pi work for this?
>
> Could 3D print a nice case with your logo for it.

The Pi has a bandwidth limit at 300mbits/sec due to a USB port being used.

I wonder if something like the RIPE Atlas probes could be flashed with suitable
code.  They're smaller than a Pi, and easy to set up - connect a USB power cord
and an RJ45 on some cat-5 and away you go.  Mine showed up with the two cords
needed and everything.

https://www-static.ripe.net/static/rnd-ui/atlas/static/docs/probe-images/v1.jpg

Re: Network Speed Testing and Monitoring Platform

[Blake Hudson]

I investigated building a product that could reliably speedtest up to a 
gig and found the same thing. A raspberry Pi 3B or 3B+ can reliably test 
up to ~100Mbps. The 3B only has a 10/100 NIC; The 3B+, while having a 
gigabit NIC, tops out at ~300Mbps internally. Both models of the Pi are 
available as a kit that retails under $100. For testing up to 1Gbps, an 
x86 mini PC like those sold for firewall appliances 
(http://a.co/d/02UQFow) are available and retail for $200-$300 at the 
low end.


My conclusion was that doing testing within the CPE was the most cost 
effective way to go. One should keep in mind that even gigabit CPEs may 
not be able to reliably test > 100Mbps due to CPU or other software 
limitations. Public speedtest servers may also not reliably test > 
100Mbps, so for reliable gigabit testing you'll need to run your own.




Casey Russell wrote on 1/16/2019 1:45 PM:
I don't think a raspberry pi will reliably fill a full Gig and keep it 
full (maybe that's not required in this scenario), but I've installed 
a Linux based OS with the PerfSONAR tools (including iperf) on a 
couple of different mini PCs in the "few hundred dollars" price range.


The last one was the Liva X from ECS.  It was more than capable of 
filling 1G circuits with traffic and keeping them full without loss or 
wonky results due to things like CPU overrun or other processes 
causing bus contention.  I'm pretty sure the Liva X is retired now, 
but their current gen should suffice as should a number of comparable 
competitors.


Sincerely,
Casey Russell
Network Engineer

phone785-856-9809
2029 Becker Drive, Suite 282
Lawrence, Kansas 66047
linkedin 
 
twitter  twitter 
 need support? 




On Wed, Jan 16, 2019 at 1:27 PM Chris Kimball 
mailto:ckimb...@misalliance.com>> wrote:


Would a raspberry pi work for this?

Could 3D print a nice case with your logo for it.

RE: Network Speed Testing and Monitoring Platform

[Cummings, Chris]

Depending on the Bandwidth needed, yes, but the Pi is limited at the NIC level 
because it is on a shared USB 2.0 Bus.

[cid:image001.jpg@01D42B24.779DE300]<http://www.coeur.com/>
Chris Cummings | Network Engineer
Coeur Mining, Inc.|  104 S. Michigan Ave. Suite 900 | Chicago, IL 60603
t: 312.489.5852 | m: 773.294.6496 | 
ccummi...@coeur.com<mailto:ccummi...@coeur.com>
NYSE: CDE | www.coeur.com<http://www.coeur.com/>

Notice of Confidentiality: The contents of this e-mail message and any 
attachments are confidential and are intended solely for addressee. This 
transmission is sent in trust, for the sole purpose of delivery to the intended 
recipient.  If you have received this transmission in error, any use, 
reproduction or dissemination of this transmission is strictly prohibited.  If 
you are not the intended recipient, please immediately notify the sender by 
reply e-mail or phone, and delete this message and its attachments, if any.

P Please consider the environment before printing this e-mail.

From: NANOG  On Behalf Of Chris Kimball
Sent: Wednesday, January 16, 2019 11:27 AM
To: Colton Conor ; David Guo 
Cc: NANOG 
Subject: RE: Network Speed Testing and Monitoring Platform

Would a raspberry pi work for this?

Could 3D print a nice case with your logo for it.

From: NANOG mailto:nanog-boun...@nanog.org>> On Behalf 
Of Colton Conor
Sent: Wednesday, January 16, 2019 2:16 PM
To: David Guo mailto:da...@xtom.com>>
Cc: NANOG mailto:nanog@nanog.org>>
Subject: Re: Network Speed Testing and Monitoring Platform

Last time I setup Iperf3 it was semi difficult, and would be impossible trying 
to coach a soccer mom on how to setup over the phone.

I am leaning towards a CPE that has speed test built in, or a low cost, sub 
$100 device we could ship to the customer to install. Anyone know of something 
like that?

On Wed, Jan 16, 2019 at 10:55 AM David Guo 
mailto:da...@xtom.com>> wrote:
We ask our customers use iperf3 to test speed.

Get Outlook for 
iOS<https://linkprotect.cudasvc.com/url?a=https%3a%2f%2faka.ms%2fo0ukef=E,1,O0iK_NFkz0m_F6jEpYdQE6Y3gvVe2Dzrm_HShwMf5uaBlHkd-EWnaq2qmcWDOZp1O7n2qrXMu2gdpoWhRzmjiAqRBpNK6wzc6_aRyx1IKw-z=1>


From: NANOG mailto:nanog-boun...@nanog.org>> on behalf 
of Colton Conor mailto:colton.co...@gmail.com>>
Sent: Thursday, January 17, 2019 00:54
To: NANOG
Subject: Network Speed Testing and Monitoring Platform

As an internet service provider with many small business and residential 
customers, our most common tech support calls are speed related. Customers 
complaining on slow speeds, slowdowns, etc.

We have a SNMP and ping monitoring platform today, but that mainly tells us 
up-time and if data is flowing across the interface. We can of course see the 
link speed, but customer call in saying the are not getting that speed.

We are looking for a way to remotely test customers internet connections 
besides telling the customer to go to speedtest.net<http://speedtest.net>, or 
worse sending a tech out with a laptop to do the same thing.

What opensource and commercial options are out there?

- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - 
- - -

The information contained in this electronic message may be confidential, and 
the message is for the use of intended recipients only. If you are not the 
intended recipient, do not disseminate, copy, or disclose this communication or 
its contents. If you have received this communication in error, please 
immediately notify me by replying to the email or call MIS Alliance at 
617-500-1700 and permanently delete this communication.

Re: Network Speed Testing and Monitoring Platform

[Ryan Wilkins]

A Raspberry Pi uses USB 2 for Ethernet interconnection to the CPU so it most 
definitely will not keep even half a gig full.  It’ll do a bit over 300 Mbps.

Ryan Wilkins

> On Jan 16, 2019, at 2:45 PM, Casey Russell  wrote:
> 
> I don't think a raspberry pi will reliably fill a full Gig and keep it full 
> (maybe that's not required in this scenario), but I've installed a Linux 
> based OS with the PerfSONAR tools (including iperf) on a couple of different 
> mini PCs in the "few hundred dollars" price range.  
> 
> The last one was the Liva X from ECS.  It was more than capable of filling 1G 
> circuits with traffic and keeping them full without loss or wonky results due 
> to things like CPU overrun or other processes causing bus contention.  I'm 
> pretty sure the Liva X is retired now, but their current gen should suffice 
> as should a number of comparable competitors.
> 
> Sincerely,
> Casey Russell
> Network Engineer
>  <http://www.kanren.net/>
> 785-856-9809
> 2029 Becker Drive, Suite 282
> Lawrence, Kansas 66047
>
> <https://www.linkedin.com/company/92399?trk=tyah=clickedVertical%3Acompany%2CclickedEntityId%3A92399%2Cidx%3A1-1-1%2CtarId%3A1440002635645%2Ctas%3AKanREN>
>   
> <https://twitter.com/TheKanREN>   
>   
> <http://www.kanren.net/feed/>   need support? 
> <mailto:supp...@kanren.net>
> 
> 
> 
> On Wed, Jan 16, 2019 at 1:27 PM Chris Kimball  <mailto:ckimb...@misalliance.com>> wrote:
> Would a raspberry pi work for this?
> 
>  
> 
> Could 3D print a nice case with your logo for it.
> 
>  
> 
> From: NANOG mailto:nanog-boun...@nanog.org>> On 
> Behalf Of Colton Conor
> Sent: Wednesday, January 16, 2019 2:16 PM
> To: David Guo mailto:da...@xtom.com>>
> Cc: NANOG mailto:nanog@nanog.org>>
> Subject: Re: Network Speed Testing and Monitoring Platform
> 
>  
> 
> Last time I setup Iperf3 it was semi difficult, and would be impossible 
> trying to coach a soccer mom on how to setup over the phone.
> 
>  
> 
> I am leaning towards a CPE that has speed test built in, or a low cost, sub 
> $100 device we could ship to the customer to install. Anyone know of 
> something like that?
> 
>  
> 
> On Wed, Jan 16, 2019 at 10:55 AM David Guo  <mailto:da...@xtom.com>> wrote:
> 
> We ask our customers use iperf3 to test speed.
> 
>  
> 
> Get Outlook for iOS <https://aka.ms/o0ukef>
>  
> 
> From: NANOG mailto:nanog-boun...@nanog.org>> on 
> behalf of Colton Conor  <mailto:colton.co...@gmail.com>>
> Sent: Thursday, January 17, 2019 00:54
> To: NANOG
> Subject: Network Speed Testing and Monitoring Platform
> 
>  
> 
> As an internet service provider with many small business and residential 
> customers, our most common tech support calls are speed related. Customers 
> complaining on slow speeds, slowdowns, etc.
> 
>  
> 
> We have a SNMP and ping monitoring platform today, but that mainly tells us 
> up-time and if data is flowing across the interface. We can of course see the 
> link speed, but customer call in saying the are not getting that speed. 
> 
>  
> 
> We are looking for a way to remotely test customers internet connections 
> besides telling the customer to go to speedtest.net <http://speedtest.net/>, 
> or worse sending a tech out with a laptop to do the same thing.
> 
>  
> 
> What opensource and commercial options are out there? 
> 
>  
> 
> - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - 
> - - - - 
> 
> The information contained in this electronic message may be confidential, and 
> the message is for the use of intended recipients only. If you are not the 
> intended recipient, do not disseminate, copy, or disclose this communication 
> or its contents. If you have received this communication in error, please 
> immediately notify me by replying to the email or call MIS Alliance at 
> 617-500-1700 and permanently delete this communication.

Re: Network Speed Testing and Monitoring Platform

[Casey Russell]

I don't think a raspberry pi will reliably fill a full Gig and keep it full
(maybe that's not required in this scenario), but I've installed a Linux
based OS with the PerfSONAR tools (including iperf) on a couple of
different mini PCs in the "few hundred dollars" price range.

The last one was the Liva X from ECS.  It was more than capable of filling
1G circuits with traffic and keeping them full without loss or wonky
results due to things like CPU overrun or other processes causing bus
contention.  I'm pretty sure the Liva X is retired now, but their current
gen should suffice as should a number of comparable competitors.

Sincerely,
Casey Russell
Network Engineer
[image: KanREN] <http://www.kanren.net>
[image: phone]785-856-9809
2029 Becker Drive, Suite 282
Lawrence, Kansas 66047
[image: linkedin]
<https://www.linkedin.com/company/92399?trk=tyah=clickedVertical%3Acompany%2CclickedEntityId%3A92399%2Cidx%3A1-1-1%2CtarId%3A1440002635645%2Ctas%3AKanREN>
[image:
twitter] <https://twitter.com/TheKanREN> [image: twitter]
<http://www.kanren.net/feed/> need support? 



On Wed, Jan 16, 2019 at 1:27 PM Chris Kimball 
wrote:

> Would a raspberry pi work for this?
>
>
>
> Could 3D print a nice case with your logo for it.
>
>
>
> *From:* NANOG  *On Behalf Of *Colton Conor
> *Sent:* Wednesday, January 16, 2019 2:16 PM
> *To:* David Guo 
> *Cc:* NANOG 
> *Subject:* Re: Network Speed Testing and Monitoring Platform
>
>
>
> Last time I setup Iperf3 it was semi difficult, and would be impossible
> trying to coach a soccer mom on how to setup over the phone.
>
>
>
> I am leaning towards a CPE that has speed test built in, or a low cost,
> sub $100 device we could ship to the customer to install. Anyone know of
> something like that?
>
>
>
> On Wed, Jan 16, 2019 at 10:55 AM David Guo  wrote:
>
> We ask our customers use iperf3 to test speed.
>
>
>
> Get Outlook for iOS <https://aka.ms/o0ukef>
>
>
> --
>
> *From:* NANOG  on behalf of Colton Conor <
> colton.co...@gmail.com>
> *Sent:* Thursday, January 17, 2019 00:54
> *To:* NANOG
> *Subject:* Network Speed Testing and Monitoring Platform
>
>
>
> As an internet service provider with many small business and residential
> customers, our most common tech support calls are speed related. Customers
> complaining on slow speeds, slowdowns, etc.
>
>
>
> We have a SNMP and ping monitoring platform today, but that mainly tells
> us up-time and if data is flowing across the interface. We can of course
> see the link speed, but customer call in saying the are not getting that
> speed.
>
>
>
> We are looking for a way to remotely test customers internet connections
> besides telling the customer to go to speedtest.net, or worse sending a
> tech out with a laptop to do the same thing.
>
>
>
> What opensource and commercial options are out there?
>
>
>
> - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
> - - - - - -
>
> The information contained in this electronic message may be confidential,
> and the message is for the use of intended recipients only. If you are not
> the intended recipient, do not disseminate, copy, or disclose this
> communication or its contents. If you have received this communication in
> error, please immediately notify me by replying to the email or call MIS
> Alliance at 617-500-1700 and permanently delete this communication.
>

RE: Network Speed Testing and Monitoring Platform

[Chris Kimball]

Would a raspberry pi work for this?

Could 3D print a nice case with your logo for it.

From: NANOG  On Behalf Of Colton Conor
Sent: Wednesday, January 16, 2019 2:16 PM
To: David Guo 
Cc: NANOG 
Subject: Re: Network Speed Testing and Monitoring Platform

Last time I setup Iperf3 it was semi difficult, and would be impossible trying 
to coach a soccer mom on how to setup over the phone.

I am leaning towards a CPE that has speed test built in, or a low cost, sub 
$100 device we could ship to the customer to install. Anyone know of something 
like that?

On Wed, Jan 16, 2019 at 10:55 AM David Guo 
mailto:da...@xtom.com>> wrote:
We ask our customers use iperf3 to test speed.

Get Outlook for iOS<https://aka.ms/o0ukef>


From: NANOG mailto:nanog-boun...@nanog.org>> on behalf 
of Colton Conor mailto:colton.co...@gmail.com>>
Sent: Thursday, January 17, 2019 00:54
To: NANOG
Subject: Network Speed Testing and Monitoring Platform

As an internet service provider with many small business and residential 
customers, our most common tech support calls are speed related. Customers 
complaining on slow speeds, slowdowns, etc.

We have a SNMP and ping monitoring platform today, but that mainly tells us 
up-time and if data is flowing across the interface. We can of course see the 
link speed, but customer call in saying the are not getting that speed.

We are looking for a way to remotely test customers internet connections 
besides telling the customer to go to speedtest.net<http://speedtest.net>, or 
worse sending a tech out with a laptop to do the same thing.

What opensource and commercial options are out there?

- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - 
- - -

The information contained in this electronic message may be confidential, and 
the message is for the use of intended recipients only. If you are not the 
intended recipient, do not disseminate, copy, or disclose this communication or 
its contents. If you have received this communication in error, please 
immediately notify me by replying to the email or call MIS Alliance at 
617-500-1700 and permanently delete this communication.

Re: Network Speed Testing and Monitoring Platform

[Colton Conor]

Last time I setup Iperf3 it was semi difficult, and would be impossible
trying to coach a soccer mom on how to setup over the phone.

I am leaning towards a CPE that has speed test built in, or a low cost, sub
$100 device we could ship to the customer to install. Anyone know of
something like that?

On Wed, Jan 16, 2019 at 10:55 AM David Guo  wrote:

> We ask our customers use iperf3 to test speed.
>
> Get Outlook for iOS 
>
> --
> *From:* NANOG  on behalf of Colton Conor <
> colton.co...@gmail.com>
> *Sent:* Thursday, January 17, 2019 00:54
> *To:* NANOG
> *Subject:* Network Speed Testing and Monitoring Platform
>
> As an internet service provider with many small business and residential
> customers, our most common tech support calls are speed related. Customers
> complaining on slow speeds, slowdowns, etc.
>
> We have a SNMP and ping monitoring platform today, but that mainly tells
> us up-time and if data is flowing across the interface. We can of course
> see the link speed, but customer call in saying the are not getting that
> speed.
>
> We are looking for a way to remotely test customers internet connections
> besides telling the customer to go to speedtest.net, or worse sending a
> tech out with a laptop to do the same thing.
>
> What opensource and commercial options are out there?
>
>

Re: Network Speed Testing and Monitoring Platform

[J. Hellenthal via NANOG]

Might be worth while to get some graphing on customers max transmission speeds 
over the period of three days, a week, two weeks, month to better predict what 
they may be seeing so you can better predict the area’s that could be effected 
due to whatever causes.

A lot of times I find this comes down to name resolution as where to the 
customer it looks slow but is more likely being drowned out by other traffic or 
slow responses from the name servers them self that traverse . But 
those are just common causes. Prioritizing traffic will greatly depend on the 
information you are seeing and a root cause will greatly evade you just doing 
speed tests.

MRTG, rrdtool and some others can accomplish this for you.

Good luck

> On Jan 16, 2019, at 10:52, Colton Conor  wrote:
> 
> As an internet service provider with many small business and residential 
> customers, our most common tech support calls are speed related. Customers 
> complaining on slow speeds, slowdowns, etc.
> 
> We have a SNMP and ping monitoring platform today, but that mainly tells us 
> up-time and if data is flowing across the interface. We can of course see the 
> link speed, but customer call in saying the are not getting that speed. 
> 
> We are looking for a way to remotely test customers internet connections 
> besides telling the customer to go to speedtest.net, or worse sending a tech 
> out with a laptop to do the same thing.
> 
> What opensource and commercial options are out there? 
> 


— 

J. Hellenthal

The fact that there's a highway to Hell but only a stairway to Heaven says a 
lot about anticipated traffic volume.

Re: Network Speed Testing and Monitoring Platform

[Christoffer Hansen]

On 16/01/2019 17:52, Colton Conor wrote:
> We are looking for a way to remotely test customers internet connections
> besides telling the customer to go to speedtest.net, or worse sending a
> tech out with a laptop to do the same thing.
> 
> What opensource and commercial options are out there?

You could optionally run tools such as iperf[123] on the CPE device
directly. If you can install it on the CPE, that is.

Alternative is the classic of doing a L2 loop with dedicated VLANs on
the CPE. E.g. Server1 -> VlanX -> CPE -> VlanY -> Server2 in your own
network.

-Christoffer

Re: Network Speed Testing and Monitoring Platform

[Mike Hammett]

Good luck with that if their only devices are tablets, phones, and Rokus? 




- 
Mike Hammett 
Intelligent Computing Solutions 

Midwest Internet Exchange 

The Brothers WISP 

- Original Message -

From: "David Guo via NANOG"  
To: "Colton Conor" , "NANOG"  
Sent: Wednesday, January 16, 2019 10:55:51 AM 
Subject: Re: Network Speed Testing and Monitoring Platform 





We ask our customers use iperf3 to test speed. 


Get Outlook for iOS 


From: NANOG  on behalf of Colton Conor 
 
Sent: Thursday, January 17, 2019 00:54 
To: NANOG 
Subject: Network Speed Testing and Monitoring Platform 

As an internet service provider with many small business and residential 
customers, our most common tech support calls are speed related. Customers 
complaining on slow speeds, slowdowns, etc. 


We have a SNMP and ping monitoring platform today, but that mainly tells us 
up-time and if data is flowing across the interface. We can of course see the 
link speed, but customer call in saying the are not getting that speed. 



We are looking for a way to remotely test customers internet connections 
besides telling the customer to go to speedtest.net , or worse sending a tech 
out with a laptop to do the same thing. 


What opensource and commercial options are out there? 

Re: Network Speed Testing and Monitoring Platform

[David Guo via NANOG]

We ask our customers use iperf3 to test speed.

Get Outlook for iOS


From: NANOG  on behalf of Colton Conor 

Sent: Thursday, January 17, 2019 00:54
To: NANOG
Subject: Network Speed Testing and Monitoring Platform

As an internet service provider with many small business and residential 
customers, our most common tech support calls are speed related. Customers 
complaining on slow speeds, slowdowns, etc.

We have a SNMP and ping monitoring platform today, but that mainly tells us 
up-time and if data is flowing across the interface. We can of course see the 
link speed, but customer call in saying the are not getting that speed.

We are looking for a way to remotely test customers internet connections 
besides telling the customer to go to speedtest.net, or 
worse sending a tech out with a laptop to do the same thing.

What opensource and commercial options are out there?