Bezüglich Bryan Venteicher's Nachricht vom 27.08.2013 06:18 (localtime): ...
>> It seems if_vmx doesn't support jumbo frames. If I set mtu 9000, I get >> »vmx0: cannot populate Rx queue 0«, I have no problems using jumbo >> frames with vmxnet3. >> > This could fail for two reasons - could not allocate an mbuf cluster, > or the call to bus_dmamap_load_mbuf_sg() failed. For the former, you > should check vmstat -z. For the later, the behavior of > bus_dmamap_load_mbuf_sg() > changed between 9.1 and 9.2, and I know it was broken for awhile. I don't > recall exactly when I fixed it (I think shortly after I made the original > announcement). Could you retry with the files from HEAD @ [1]? Also, there > are new sysctl oids (dev.vmx.X.mbuf_load_failed & dev.vmx.X.mgetcl_failed) > for these errors. > > I just compiled the driver on 9.2-RC2 with the sources from HEAD and was > able to change the MTU to 9000. > > [1]- http://svnweb.freebsd.org/base/head/sys/dev/vmware/vmxnet3/ Thanks a lot for your ongoing work! I can confirm that with recent if_vmx.c from head and compiled for 9.2-RC3, setting mtu to 9000 works as expected :-) >> I took a oldish host (4x2,8GHz Core2[LGA775]) with recent software: ESXi >> 5.1U1 and FreeBSD-9.2-RC2 >> Two guests are connected to one MTU9000 "VMware Software Switch". >> > I've got a few performance things to still look at. What's the sysctl > dev.vmx.X output for the if_vmx<->if_vmx tests? Just repeated if_vmx simple iperf bench, results vary slightly from standard 10sec run to run, but still noticable high Intr usage: if_vmx <-> if_vmx 1.32 GBits/sec, load: 10-45%Sys 40-48%Intr if_vmxJumbo <-> if_vmxJumbo 5.01 GBits/sec, load: 10-45%Sys 40-48%Intr Please find attached the different outputs of dev.vmx.X (the mtu9000 run was only 3.47GBits/sec in that case, took the numbers anyway) wbr, -Harry
dev.vmx.0.%desc: VMware VMXNET3 Ethernet Adapter dev.vmx.0.%driver: vmx dev.vmx.0.%location: slot=0 function=0 handle=\_SB_.PCI0.PE40.S1F0 dev.vmx.0.%pnpinfo: vendor=0x15ad device=0x07b0 subvendor=0x15ad subdevice=0x07b0 class=0x020000 dev.vmx.0.%parent: pci3 dev.vmx.0.ntxqueues: 1 dev.vmx.0.nrxqueues: 1 dev.vmx.0.collapsed: 0 dev.vmx.0.mgetcl_failed: 0 dev.vmx.0.mbuf_load_failed: 0 dev.vmx.0.txq0.ringfull: 133479 dev.vmx.0.txq0.offload_failed: 0 dev.vmx.0.txq0.hstats.tso_packets: 564986 dev.vmx.0.txq0.hstats.tso_bytes: 1686184580 dev.vmx.0.txq0.hstats.ucast_packets: 570604 dev.vmx.0.txq0.hstats.unicast_bytes: 1694679608 dev.vmx.0.txq0.hstats.mcast_packets: 0 dev.vmx.0.txq0.hstats.mcast_bytes: 0 dev.vmx.0.txq0.hstats.error: 0 dev.vmx.0.txq0.hstats.discard: 0 dev.vmx.0.txq0.debug.cmd_head: 106 dev.vmx.0.txq0.debug.cmd_next: 106 dev.vmx.0.txq0.debug.cmd_ndesc: 512 dev.vmx.0.txq0.debug.cmd_gen: 0 dev.vmx.0.txq0.debug.comp_next: 238 dev.vmx.0.txq0.debug.comp_ndesc: 512 dev.vmx.0.txq0.debug.comp_gen: 1 dev.vmx.0.rxq0.hstats.lro_packets: 0 dev.vmx.0.rxq0.hstats.lro_bytes: 0 dev.vmx.0.rxq0.hstats.ucast_packets: 579137 dev.vmx.0.rxq0.hstats.unicast_bytes: 38409312 dev.vmx.0.rxq0.hstats.mcast_packets: 0 dev.vmx.0.rxq0.hstats.mcast_bytes: 0 dev.vmx.0.rxq0.hstats.bcast_packets: 29 dev.vmx.0.rxq0.hstats.bcast_bytes: 1740 dev.vmx.0.rxq0.hstats.nobuffer: 0 dev.vmx.0.rxq0.hstats.error: 0 dev.vmx.0.rxq0.debug.cmd0_fill: 94 dev.vmx.0.rxq0.debug.cmd0_ndesc: 256 dev.vmx.0.rxq0.debug.cmd0_gen: 0 dev.vmx.0.rxq0.debug.cmd1_fill: 0 dev.vmx.0.rxq0.debug.cmd1_ndesc: 256 dev.vmx.0.rxq0.debug.cmd1_gen: 0 dev.vmx.0.rxq0.debug.comp_next: 94 dev.vmx.0.rxq0.debug.comp_ndesc: 512 dev.vmx.0.rxq0.debug.comp_gen: 0
dev.vmx.0.%desc: VMware VMXNET3 Ethernet Adapter dev.vmx.0.%driver: vmx dev.vmx.0.%location: slot=0 function=0 handle=\_SB_.PCI0.PE40.S1F0 dev.vmx.0.%pnpinfo: vendor=0x15ad device=0x07b0 subvendor=0x15ad subdevice=0x07b0 class=0x020000 dev.vmx.0.%parent: pci3 dev.vmx.0.ntxqueues: 1 dev.vmx.0.nrxqueues: 1 dev.vmx.0.collapsed: 0 dev.vmx.0.mgetcl_failed: 0 dev.vmx.0.mbuf_load_failed: 0 dev.vmx.0.txq0.ringfull: 58950 dev.vmx.0.txq0.offload_failed: 0 dev.vmx.0.txq0.hstats.tso_packets: 230508 dev.vmx.0.txq0.hstats.tso_bytes: 4314020112 dev.vmx.0.txq0.hstats.ucast_packets: 235382 dev.vmx.0.txq0.hstats.unicast_bytes: 4356943552 dev.vmx.0.txq0.hstats.mcast_packets: 0 dev.vmx.0.txq0.hstats.mcast_bytes: 0 dev.vmx.0.txq0.hstats.error: 0 dev.vmx.0.txq0.hstats.discard: 0 dev.vmx.0.txq0.debug.cmd_head: 333 dev.vmx.0.txq0.debug.cmd_next: 333 dev.vmx.0.txq0.debug.cmd_ndesc: 512 dev.vmx.0.txq0.debug.cmd_gen: 0 dev.vmx.0.txq0.debug.comp_next: 376 dev.vmx.0.txq0.debug.comp_ndesc: 512 dev.vmx.0.txq0.debug.comp_gen: 0 dev.vmx.0.rxq0.hstats.lro_packets: 0 dev.vmx.0.rxq0.hstats.lro_bytes: 0 dev.vmx.0.rxq0.hstats.ucast_packets: 255918 dev.vmx.0.rxq0.hstats.unicast_bytes: 17043918 dev.vmx.0.rxq0.hstats.mcast_packets: 0 dev.vmx.0.rxq0.hstats.mcast_bytes: 0 dev.vmx.0.rxq0.hstats.bcast_packets: 15 dev.vmx.0.rxq0.hstats.bcast_bytes: 900 dev.vmx.0.rxq0.hstats.nobuffer: 0 dev.vmx.0.rxq0.hstats.error: 0 dev.vmx.0.rxq0.debug.cmd0_fill: 121 dev.vmx.0.rxq0.debug.cmd0_ndesc: 256 dev.vmx.0.rxq0.debug.cmd0_gen: 1 dev.vmx.0.rxq0.debug.cmd1_fill: 0 dev.vmx.0.rxq0.debug.cmd1_ndesc: 256 dev.vmx.0.rxq0.debug.cmd1_gen: 0 dev.vmx.0.rxq0.debug.comp_next: 445 dev.vmx.0.rxq0.debug.comp_ndesc: 512 dev.vmx.0.rxq0.debug.comp_gen: 0
dev.vmx.0.%desc: VMware VMXNET3 Ethernet Adapter dev.vmx.0.%driver: vmx dev.vmx.0.%location: slot=0 function=0 handle=\_SB_.PCI0.PE41.S1F0 dev.vmx.0.%pnpinfo: vendor=0x15ad device=0x07b0 subvendor=0x15ad subdevice=0x07b0 class=0x020000 dev.vmx.0.%parent: pci4 dev.vmx.0.ntxqueues: 1 dev.vmx.0.nrxqueues: 1 dev.vmx.0.collapsed: 0 dev.vmx.0.mgetcl_failed: 0 dev.vmx.0.mbuf_load_failed: 0 dev.vmx.0.txq0.ringfull: 0 dev.vmx.0.txq0.offload_failed: 0 dev.vmx.0.txq0.hstats.tso_packets: 0 dev.vmx.0.txq0.hstats.tso_bytes: 0 dev.vmx.0.txq0.hstats.ucast_packets: 579135 dev.vmx.0.txq0.hstats.unicast_bytes: 38409174 dev.vmx.0.txq0.hstats.mcast_packets: 0 dev.vmx.0.txq0.hstats.mcast_bytes: 0 dev.vmx.0.txq0.hstats.error: 0 dev.vmx.0.txq0.hstats.discard: 0 dev.vmx.0.txq0.debug.cmd_head: 64 dev.vmx.0.txq0.debug.cmd_next: 64 dev.vmx.0.txq0.debug.cmd_ndesc: 512 dev.vmx.0.txq0.debug.cmd_gen: 0 dev.vmx.0.txq0.debug.comp_next: 64 dev.vmx.0.txq0.debug.comp_ndesc: 512 dev.vmx.0.txq0.debug.comp_gen: 0 dev.vmx.0.rxq0.hstats.lro_packets: 0 dev.vmx.0.rxq0.hstats.lro_bytes: 0 dev.vmx.0.rxq0.hstats.ucast_packets: 1147186 dev.vmx.0.rxq0.hstats.unicast_bytes: 1732071160 dev.vmx.0.rxq0.hstats.mcast_packets: 0 dev.vmx.0.rxq0.hstats.mcast_bytes: 0 dev.vmx.0.rxq0.hstats.bcast_packets: 44 dev.vmx.0.rxq0.hstats.bcast_bytes: 2640 dev.vmx.0.rxq0.hstats.nobuffer: 313 dev.vmx.0.rxq0.hstats.error: 0 dev.vmx.0.rxq0.debug.cmd0_fill: 94 dev.vmx.0.rxq0.debug.cmd0_ndesc: 256 dev.vmx.0.rxq0.debug.cmd0_gen: 1 dev.vmx.0.rxq0.debug.cmd1_fill: 0 dev.vmx.0.rxq0.debug.cmd1_ndesc: 256 dev.vmx.0.rxq0.debug.cmd1_gen: 0 dev.vmx.0.rxq0.debug.comp_next: 350 dev.vmx.0.rxq0.debug.comp_ndesc: 512 dev.vmx.0.rxq0.debug.comp_gen: 1
dev.vmx.0.%desc: VMware VMXNET3 Ethernet Adapter dev.vmx.0.%driver: vmx dev.vmx.0.%location: slot=0 function=0 handle=\_SB_.PCI0.PE41.S1F0 dev.vmx.0.%pnpinfo: vendor=0x15ad device=0x07b0 subvendor=0x15ad subdevice=0x07b0 class=0x020000 dev.vmx.0.%parent: pci4 dev.vmx.0.ntxqueues: 1 dev.vmx.0.nrxqueues: 1 dev.vmx.0.collapsed: 0 dev.vmx.0.mgetcl_failed: 0 dev.vmx.0.mbuf_load_failed: 0 dev.vmx.0.txq0.ringfull: 0 dev.vmx.0.txq0.offload_failed: 0 dev.vmx.0.txq0.hstats.tso_packets: 0 dev.vmx.0.txq0.hstats.tso_bytes: 0 dev.vmx.0.txq0.hstats.ucast_packets: 255916 dev.vmx.0.txq0.hstats.unicast_bytes: 17043780 dev.vmx.0.txq0.hstats.mcast_packets: 0 dev.vmx.0.txq0.hstats.mcast_bytes: 0 dev.vmx.0.txq0.hstats.error: 0 dev.vmx.0.txq0.hstats.discard: 0 dev.vmx.0.txq0.debug.cmd_head: 429 dev.vmx.0.txq0.debug.cmd_next: 429 dev.vmx.0.txq0.debug.cmd_ndesc: 512 dev.vmx.0.txq0.debug.cmd_gen: 0 dev.vmx.0.txq0.debug.comp_next: 429 dev.vmx.0.txq0.debug.comp_ndesc: 512 dev.vmx.0.txq0.debug.comp_gen: 0 dev.vmx.0.rxq0.hstats.lro_packets: 0 dev.vmx.0.rxq0.hstats.lro_bytes: 0 dev.vmx.0.rxq0.hstats.ucast_packets: 501186 dev.vmx.0.rxq0.hstats.unicast_bytes: 4370243816 dev.vmx.0.rxq0.hstats.mcast_packets: 0 dev.vmx.0.rxq0.hstats.mcast_bytes: 0 dev.vmx.0.rxq0.hstats.bcast_packets: 8 dev.vmx.0.rxq0.hstats.bcast_bytes: 480 dev.vmx.0.rxq0.hstats.nobuffer: 287 dev.vmx.0.rxq0.hstats.error: 0 dev.vmx.0.rxq0.debug.cmd0_fill: 147 dev.vmx.0.rxq0.debug.cmd0_ndesc: 256 dev.vmx.0.rxq0.debug.cmd0_gen: 1 dev.vmx.0.rxq0.debug.cmd1_fill: 234 dev.vmx.0.rxq0.debug.cmd1_ndesc: 256 dev.vmx.0.rxq0.debug.cmd1_gen: 1 dev.vmx.0.rxq0.debug.comp_next: 80 dev.vmx.0.rxq0.debug.comp_ndesc: 512 dev.vmx.0.rxq0.debug.comp_gen: 0
signature.asc
Description: OpenPGP digital signature
