Hi,
I guess you're hitting 2 bottlenecks: the CPU performance for iperf and
HDD performance for scp.
Check how much CPU is consumed during iperf transfer and try scp'ing
something not from/to HDD, e.g. /dev/zero.
I've seen extremely slow HDD performance in OpenBSD, like 12x slower
than on Linux, also no filesystem cache, so depending on your HDD with
scp you may be hitting the max throughput for the FS, not the network.
Regards,
Anatoli
*From:* Mark Schneider <m...@it-infrastrukturen.org>
*Sent:* Saturday, April 06, 2019 17:52
*To:* Misc <misc@openbsd.org>
*Subject:* 10GBit network performance on OpenBSD 6.4
Hi,
Please allow me few questions regarding 10GBit network performance on
OpenBSD 6.4.
I face quite low network performance for the Intell X520-DA2 10GBit
network card.
Test configuration in OpenBSD-Linux-10GBit_net_performance.txt -
http://paste.debian.net/1076461/
Low transfer rate for scp - OpenBSD-10GBit-perftest.txt -
http://paste.debian.net/1076460/
Test configuration:
# ---
# OpenBSD 6.4 on HP DL380g7
# -------------------------
# 10GBit X520-DA2 NIC
ix0: flags=208843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST,AUTOCONF6> mtu
1500
media: Ethernet autoselect (10GbaseSR full-duplex,rxpause,txpause)
inet6 fe80::d51e:1b74:17d7:8230%ix0 prefixlen 64 scopeid 0x1
inet 200.0.0.3 netmask 0xffffff00 broadcast 200.0.0.255
ix1: flags=208843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST,AUTOCONF6> mtu
1500
media: Ethernet autoselect (10GbaseSR full-duplex,rxpause,txpause)
inet 10.0.0.7 netmask 0xffffff00 broadcast 10.0.0.255
inet6 fe80::b488:caea:5d6f:9992%ix1 prefixlen 64 scopeid 0x2
# ---
Compare to Linux the 10GBit transfer from/to OpenBSD is few times slower:
# ---
# OpenBSD to Linux (Asus P8BWS)
# -----------------------------
srvob# iperf3 -c 10.0.0.2
...
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bitrate
[ 5] 0.00-10.00 sec 1.50 GBytes 1.29 Gbits/sec
sender
[ 5] 0.00-10.20 sec 1.50 GBytes 1.27 Gbits/sec
receiver
# ---
# ---
# Linux (DL380g7) to Linux (Asus P8BWS)
# -------------------------------------
root@kali:~# iperf3 -c 100.0.0.2
...
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bitrate Retr
[ 5] 0.00-10.00 sec 10.9 GBytes 9.39 Gbits/sec 328 sender
[ 5] 0.00-10.04 sec 10.9 GBytes 9.35 Gbits/sec
receiver
# ---
The scp transfer rate is like 21MBytes/s only per ssh connection
(OpenBSD <-> Linux):
# ---
root@kali:~# scp /re*/b*/ka*/kali-linux-kde-2019.1a-*.iso
ironm@10.0.0.7:/home/ironm/t12.iso
ironm@10.0.0.7's password:
kali-linux-kde-2019.1a-amd64.iso 4% 173MB
21.5MB/s 02:40 ETA
# ---
The 1GBit cooper based NIC works also slower but reaching almost 40% of
the max trasfer rate of 1 Gbit:
# ---
# OpenBSD 6.4 (DL380g7 1Gbit NIC) to Linux (DL380g7 1GBit NIC)
# ------------------------------------------------------------
srvob# iperf3 -c 170.0.0.10
...
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bitrate
[ 5] 0.00-10.00 sec 471 MBytes 395 Mbits/sec
sender
[ 5] 0.00-10.20 sec 471 MBytes 388 Mbits/sec
receiver
# ---
# ---
# Linux (Asus P8BWS) to Linux (DL380g7)
# -------------------------------------
root@kali:~# iperf3 -c 192.168.1.122
...
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bitrate Retr
[ 5] 0.00-10.00 sec 1.09 GBytes 939 Mbits/sec 183 sender
[ 5] 0.00-10.04 sec 1.09 GBytes 934 Mbits/sec
receiver
# ---
Thank you in advance for your hints what OpenBSD 6.4 settings do I miss.
Best regards
Mark
