Re: [pfSense] Using on Fiber
On 5/6/15 3:37 pm, Ryan Coleman wrote: And those of you with VMware experience… if I run the virtual firewall I would need to have at least a VMware Essentials license to come close to the throughput, right? Since the IOps are capped at something like 10MB/sec in the free version. I can't comment on the Netgate hardware, having never used it, but regarding virtualisation, have you considered KVM instead of VMware (especially if the latter is limited to 10Mbps)? I've had BSD VMs running under KVM achieving fairly close to gig throughput in the past... Kind regards, Chris -- This email is made from 100% recycled electrons ___ pfSense mailing list https://lists.pfsense.org/mailman/listinfo/list Support the project with Gold! https://pfsense.org/gold
[pfSense] Using on Fiber
So our office is getting a big shot in the arm soon… We’re getting Gigabit service from US Internet here in Minneapolis. Has anyone had an experience using the physical or virtual Netgate routers with this type of connection? Are there things I need to look out for when setting it up and replying? And those of you with VMware experience… if I run the virtual firewall I would need to have at least a VMware Essentials license to come close to the throughput, right? Since the IOps are capped at something like 10MB/sec in the free version. Thanks, Ryan ___ pfSense mailing list https://lists.pfsense.org/mailman/listinfo/list Support the project with Gold! https://pfsense.org/gold
Re: [pfSense] Using on Fiber
On Fri, Jun 5, 2015 at 9:43 AM, Ryan Coleman ryan.cole...@cwis.biz wrote: Hmm. I wonder why my file transfers never exceed 10MB/sec then… I’ve been trying to migrate many TB of data via SCP That's likely the issue right there. ssh/scp/sftp won't go faster than that with the default settings. It might have to do with buffers, but I'm not entirely sure. Try another protocol such as ftp, nfs, or smb if you can live without the encryption. db ___ pfSense mailing list https://lists.pfsense.org/mailman/listinfo/list Support the project with Gold! https://pfsense.org/gold
Re: [pfSense] Using on Fiber
Any chance you have set something in the shaper that causes it? fre. 5. juni 2015, 17:43 skrev Ryan Coleman ryan.cole...@cwis.biz: On Jun 5, 2015, at 10:12 AM, Brennan H. McNenly bmcne...@singularisit.com wrote: And those of you with VMware experience… if I run the virtual firewall I would need to have at least a VMware Essentials license to come close to the throughput, right? Since the IOps are capped at something like 10MB/sec in the free version. There are no IOP or throughput limits on the free version of the ESXi hypervisor. The VMWare Essentials license gets you vSphere which can be used to manage up to three ESXi hosts. This also lets you setup an HA cluster with those hosts. Otherwise you can run ESXi stand alone for free without vSphere and without any performance limits. Hmm. I wonder why my file transfers never exceed 10MB/sec then… I’ve been trying to migrate many TB of data via SCP to the datastore but I also have similar caps when doing FTP over the LAN to a server. If there’s someone here that would be interested in giving me a hand with this off list I’d be most appreciative. Moving 13TB of data at 10MB/sec has been very challenging. ___ pfSense mailing list https://lists.pfsense.org/mailman/listinfo/list Support the project with Gold! https://pfsense.org/gold ___ pfSense mailing list https://lists.pfsense.org/mailman/listinfo/list Support the project with Gold! https://pfsense.org/gold
Re: [pfSense] Using on Fiber
What guest you running? Could it be the virtual nic that's connected to the VM? --Tiernan On 5 June 2015 16:43:16 GMT+01:00, Ryan Coleman ryan.cole...@cwis.biz wrote: On Jun 5, 2015, at 10:12 AM, Brennan H. McNenly bmcne...@singularisit.com wrote: And those of you with VMware experience… if I run the virtual firewall I would need to have at least a VMware Essentials license to come close to the throughput, right? Since the IOps are capped at something like 10MB/sec in the free version. There are no IOP or throughput limits on the free version of the ESXi hypervisor. The VMWare Essentials license gets you vSphere which can be used to manage up to three ESXi hosts. This also lets you setup an HA cluster with those hosts. Otherwise you can run ESXi stand alone for free without vSphere and without any performance limits. Hmm. I wonder why my file transfers never exceed 10MB/sec then… I’ve been trying to migrate many TB of data via SCP to the datastore but I also have similar caps when doing FTP over the LAN to a server. If there’s someone here that would be interested in giving me a hand with this off list I’d be most appreciative. Moving 13TB of data at 10MB/sec has been very challenging. ___ pfSense mailing list https://lists.pfsense.org/mailman/listinfo/list Support the project with Gold! https://pfsense.org/gold -- Sent from my Android device with K-9 Mail. Please excuse my brevity. ___ pfSense mailing list https://lists.pfsense.org/mailman/listinfo/list Support the project with Gold! https://pfsense.org/gold
Re: [pfSense] Using on Fiber
Presently it’s Ubunutu 14.04.2 LTS Network interface is VMXNet3 on an Intel I350 GigE, Auto negotiated at 1000Mbps full duplex Switch is a Cisco SG300-50p Board is a SuperMIcro X9DR3 with 64GB RAM LSI 9270-8i controller with RES2SV240 expander (running 21 drives in R6) ESXi 5.5.0 For buildout purposes VM has 1GB and 1CPU and isn’t coming close to taxing out (Xeon E5-2630, 6-core 2.3GHz). The VM host is not less than 20% right now (mostly idle). My best upload was 12.5Mbps according to the performance graphs. On Jun 5, 2015, at 10:45 AM, Tiernan OToole tier...@tiernanotoole.net wrote: What guest you running? Could it be the virtual nic that's connected to the VM? --Tiernan On 5 June 2015 16:43:16 GMT+01:00, Ryan Coleman ryan.cole...@cwis.biz wrote: On Jun 5, 2015, at 10:12 AM, Brennan H. McNenly bmcne...@singularisit.com wrote: And those of you with VMware experience… if I run the virtual firewall I would need to have at least a VMware Essentials license to come close to the throughput, right? Since the IOps are capped at something like 10MB/sec in the free version. There are no IOP or throughput limits on the free version of the ESXi hypervisor. The VMWare Essentials license gets you vSphere which can be used to manage up to three ESXi hosts. This also lets you setup an HA cluster with those hosts. Otherwise you can run ESXi stand alone for free without vSphere and without any performance limits. Hmm. I wonder why my file transfers never exceed 10MB/sec then… I’ve been trying to migrate many TB of data via SCP to the datastore but I also have similar caps when doing FTP over the LAN to a server. If there’s someone here that would be interested in giving me a hand with this off list I’d be most appreciative. Moving 13TB of data at 10MB/sec has been very challenging. ___ pfSense mailing list https://lists.pfsense.org/mailman/listinfo/list Support the project with Gold! https://pfsense.org/gold -- Sent from my Android device with K-9 Mail. Please excuse my brevity. ___ pfSense mailing list https://lists.pfsense.org/mailman/listinfo/list Support the project with Gold! https://pfsense.org/gold ___ pfSense mailing list https://lists.pfsense.org/mailman/listinfo/list Support the project with Gold! https://pfsense.org/gold
Re: [pfSense] Using on Fiber
I’m not running this data through the firewalls - this is across the LAN right now. :-\ On Jun 5, 2015, at 10:46 AM, Espen Johansen pfse...@gmail.com wrote: Any chance you have set something in the shaper that causes it? fre. 5. juni 2015, 17:43 skrev Ryan Coleman ryan.cole...@cwis.biz: On Jun 5, 2015, at 10:12 AM, Brennan H. McNenly bmcne...@singularisit.com wrote: And those of you with VMware experience… if I run the virtual firewall I would need to have at least a VMware Essentials license to come close to the throughput, right? Since the IOps are capped at something like 10MB/sec in the free version. There are no IOP or throughput limits on the free version of the ESXi hypervisor. The VMWare Essentials license gets you vSphere which can be used to manage up to three ESXi hosts. This also lets you setup an HA cluster with those hosts. Otherwise you can run ESXi stand alone for free without vSphere and without any performance limits. Hmm. I wonder why my file transfers never exceed 10MB/sec then… I’ve been trying to migrate many TB of data via SCP to the datastore but I also have similar caps when doing FTP over the LAN to a server. If there’s someone here that would be interested in giving me a hand with this off list I’d be most appreciative. Moving 13TB of data at 10MB/sec has been very challenging. ___ pfSense mailing list https://lists.pfsense.org/mailman/listinfo/list Support the project with Gold! https://pfsense.org/gold ___ pfSense mailing list https://lists.pfsense.org/mailman/listinfo/list Support the project with Gold! https://pfsense.org/gold ___ pfSense mailing list https://lists.pfsense.org/mailman/listinfo/list Support the project with Gold! https://pfsense.org/gold
Re: [pfSense] Using on Fiber
There is a serverfault question about this: http://serverfault.com/questions/380778/vmware-seems-to-throttle-scp-copies-what-can-be-the-reason?rq=1 SCP does (did) have performance problems. They fall into two groups. First, over a WAN the internal buffer was a bit too small for high speed (100 meg) connections with a round trip time of greater than 30 milliseconds. When connections pushed toward 1 gig, it was way too slow. I think recent copies of OpenSSH have a bigger buffer that reduces the speed limiting. Second, as described in the above link, the CPU requirements for the encryption in SCP can hit the host CPU limiter in ESX and that can limit bandwidth. Check that as well. I've got an ESX 5 machine and the limiting factor on copies is the 100 meg ethernet switch that I'm plugged into (big ISO copies top out at 12.5MB/sec, which is limit for a 100 meg TCP/IP connection). Walter On Fri, Jun 5, 2015 at 8:54 AM, Ryan Coleman ryan.cole...@cwis.biz wrote: I’m not running this data through the firewalls - this is across the LAN right now. :-\ On Jun 5, 2015, at 10:46 AM, Espen Johansen pfse...@gmail.com wrote: Any chance you have set something in the shaper that causes it? fre. 5. juni 2015, 17:43 skrev Ryan Coleman ryan.cole...@cwis.biz: On Jun 5, 2015, at 10:12 AM, Brennan H. McNenly bmcne...@singularisit.com wrote: And those of you with VMware experience… if I run the virtual firewall I would need to have at least a VMware Essentials license to come close to the throughput, right? Since the IOps are capped at something like 10MB/sec in the free version. There are no IOP or throughput limits on the free version of the ESXi hypervisor. The VMWare Essentials license gets you vSphere which can be used to manage up to three ESXi hosts. This also lets you setup an HA cluster with those hosts. Otherwise you can run ESXi stand alone for free without vSphere and without any performance limits. Hmm. I wonder why my file transfers never exceed 10MB/sec then… I’ve been trying to migrate many TB of data via SCP to the datastore but I also have similar caps when doing FTP over the LAN to a server. If there’s someone here that would be interested in giving me a hand with this off list I’d be most appreciative. Moving 13TB of data at 10MB/sec has been very challenging. ___ pfSense mailing list https://lists.pfsense.org/mailman/listinfo/list Support the project with Gold! https://pfsense.org/gold ___ pfSense mailing list https://lists.pfsense.org/mailman/listinfo/list Support the project with Gold! https://pfsense.org/gold ___ pfSense mailing list https://lists.pfsense.org/mailman/listinfo/list Support the project with Gold! https://pfsense.org/gold -- The greatest dangers to liberty lurk in insidious encroachment by men of zeal, well-meaning but without understanding. -- Justice Louis D. Brandeis ___ pfSense mailing list https://lists.pfsense.org/mailman/listinfo/list Support the project with Gold! https://pfsense.org/gold
Re: [pfSense] Using on Fiber
On Jun 5, 2015, at 10:12 AM, Brennan H. McNenly bmcne...@singularisit.com wrote: And those of you with VMware experience… if I run the virtual firewall I would need to have at least a VMware Essentials license to come close to the throughput, right? Since the IOps are capped at something like 10MB/sec in the free version. There are no IOP or throughput limits on the free version of the ESXi hypervisor. The VMWare Essentials license gets you vSphere which can be used to manage up to three ESXi hosts. This also lets you setup an HA cluster with those hosts. Otherwise you can run ESXi stand alone for free without vSphere and without any performance limits. Hmm. I wonder why my file transfers never exceed 10MB/sec then… I’ve been trying to migrate many TB of data via SCP to the datastore but I also have similar caps when doing FTP over the LAN to a server. If there’s someone here that would be interested in giving me a hand with this off list I’d be most appreciative. Moving 13TB of data at 10MB/sec has been very challenging. ___ pfSense mailing list https://lists.pfsense.org/mailman/listinfo/list Support the project with Gold! https://pfsense.org/gold
Re: [pfSense] Using on Fiber
And those of you with VMware experience… if I run the virtual firewall I would need to have at least a VMware Essentials license to come close to the throughput, right? Since the IOps are capped at something like 10MB/sec in the free version. There are no IOP or throughput limits on the free version of the ESXi hypervisor. The VMWare Essentials license gets you vSphere which can be used to manage up to three ESXi hosts. This also lets you setup an HA cluster with those hosts. Otherwise you can run ESXi stand alone for free without vSphere and without any performance limits. ___ pfSense mailing list https://lists.pfsense.org/mailman/listinfo/list Support the project with Gold! https://pfsense.org/gold
