Hi Peter
Thank you very much for your feedback.
It looks like the performance issue is more complex than I have expected.
Just for the test I have installed OpenBSD 6.4 and FreeBSD 13.0 on few
different servers and compared results (details are in attached files).
Pure network speed I have to test with sucht tools like tcpbench, iperf3
or netperf to get independent of the mass storage stuff and other things.
Kind regards
Mark
--
m...@it-infrastrukturen.org
Am 08.04.2019 05:12, schrieb Peter Membrey:
Hi Mark,
I saw very similar performance issues on my system as well. The card was an
Intel X550-10 dual port on an Atom C2750 box (8 core but low power). I've never
had great TCP performance from OpenBSD on this box, but routing traffic through
it had always been fine. Upgrading to 10Gb/s though I found I couldn't get much
more than the speeds you were seeing.
As the OS was due for an upgrade anyway, I tried it with Linux, and was
immediately about to hit 9.8Gb/s. Since I'm also quite comfortable using Linux,
I left it in place (it's a key router for me) and it's been working great ever
since.
I'm afraid I can't add much to help you apart from a "me too" but at least it
rules out it being an issue with your particular hardware.
Kind Regards,
Peter Membrey
----- Original Message -----
From: "Mark Schneider" <m...@it-infrastrukturen.org>
To: "misc" <misc@openbsd.org>
Sent: Monday, 8 April, 2019 06:09:09
Subject: Re: 10GBit network performance on OpenBSD 6.4
Short feedback:
Just for the test I have checked the 10GBit network performance
between two FreeBSD 13.0 servers (both HP DL380g7 machines)
transfering data in both directions
# ---
ironm@fbsdsrv2:~ $ scp ironm@200.0.0.10:/home/ironm/t2.iso t100.iso
Password for ironm@fbsdsrv1:
t2.iso 100% 3626MB 130.2MB/s 00:27
# ---
ironm@fbsdsrv2:~ $ scp obsd2fbsd.iso ironm@200.0.0.10:/home/ironm/t1.iso
Password for ironm@fbsdsrv1:
obsd2fbsd.iso 100% 3626MB 140.4MB/s 00:25
# ---
The ssh performance using 10GBit network connection on FreeBSD 13.0
is approx 7 times higher than the one on OpenBSD 6.4.
Is it the question of the "ix" NIC driver of OpenBSD 6.4?
(X520-DA2 NICs from Intel)
Does one of you achieve good 10Gbit network performance with other
10Gbit NICs?
Thank you in advance for your hints.
Kind regards
Mark
ironm@wheezy:~$ time dd if=/dev/zero of=file1.tmp bs=1M count=4096 && sync
4096+0 Datensätze ein
4096+0 Datensätze aus
4294967296 Bytes (4.3 GB) kopiert, 1.0029 s, 4.3 GB/s
real 0m1.231s
user 0m0.000s
sys 0m1.224s
---
ironm@fbsdsrv8:~ $ time dd if=/dev/zero of=file1.tmp bs=1M count=4096 && sync
4096+0 records in
4096+0 records out
4294967296 bytes transferred in 8.432852 secs (509313755 bytes/sec)
8.79 real 0.01 user 3.36 sys
---
ironm@fbsdsrv1:~ $ time dd if=/dev/zero of=file1.tmp bs=1M count=4096 && sync
4096+0 records in
4096+0 records out
4294967296 bytes transferred in 5.947370 secs (722162508 bytes/sec)
6.41 real 0.00 user 4.65
---
ironm@fbsdsrv2:~ $ time dd if=/dev/zero of=file1.tmp bs=1M count=4096 && sync
4096+0 records in
4096+0 records out
4294967296 bytes transferred in 8.804378 secs (487821753 bytes/sec)
9.26 real 0.00 user 4.94 sys
--------------------------------------------------------------------------------
ronm@wheezy:~$ time dd if=file1.tmp of=/dev/null bs=1M count=4096 && sync
4096+0 Datensätze ein
4096+0 Datensätze aus
4294967296 Bytes (4.3 GB) kopiert, 0.410687 s, 10.5 GB/s
real 0m0.412s
user 0m0.000s
sys 0m0.408s
ironm@wheezy:~$ time dd if=file1.tmp of=/dev/null bs=1M count=512 && sync
512+0 Datensätze ein
512+0 Datensätze aus
536870912 Bytes (537 MB) kopiert, 0.0558006 s, 9.6 GB/s
real 0m0.057s
user 0m0.000s
sys 0m0.056s
---
ironm@fbsdsrv8:~ $ time dd if=file1.tmp of=/dev/null bs=1M count=4096 && sync
4096+0 records in
4096+0 records out
4294967296 bytes transferred in 1.338350 secs (3209151777 bytes/sec)
1.34 real 0.00 user 1.34 sys
ironm@fbsdsrv8:~ $ time dd if=file1.tmp of=/dev/null bs=1M count=512 && sync
512+0 records in
512+0 records out
536870912 bytes transferred in 0.167219 secs (3210581655 bytes/sec)
0.17 real 0.00 user 0.17 sys
---
ironm@fbsdsrv1:~ $ time dd if=file1.tmp of=/dev/null bs=1M count=4096 && sync
4096+0 records in
4096+0 records out
4294967296 bytes transferred in 1.173098 secs (3661217181 bytes/sec)
1.17 real 0.00 user 1.17 sys
ironm@fbsdsrv1:~ $ time dd if=file1.tmp of=/dev/null bs=1M count=512 && sync
512+0 records in
512+0 records out
536870912 bytes transferred in 0.191353 secs (2805662938 bytes/sec)
0.19 real 0.00 user 0.18 sys
---
ironm@fbsdsrv2:~ $ time dd if=file1.tmp of=/dev/null bs=1M count=4096 && sync
4096+0 records in
4096+0 records out
4294967296 bytes transferred in 1.159899 secs (3702879890 bytes/sec)
1.16 real 0.00 user 1.16 sys
ironm@fbsdsrv2:~ $ time dd if=file1.tmp of=/dev/null bs=1M count=512 && sync
512+0 records in
512+0 records out
536870912 bytes transferred in 0.213278 secs (2517231248 bytes/sec)
0.21 real 0.00 user 0.21 sys
---------------------------------------------------------------------------
obsdsrv2$ time dd if=/dev/zero of=file1.tmp bs=1M count=4096 && sync
4096+0 records in
4096+0 records out
4294967296 bytes transferred in 9.136 secs (470078173 bytes/sec)
0m09.15s real 0m00.00s user 0m04.77s system
---
obsdsrv2$ time dd if=file1.tmp of=/dev/null bs=1M count=4096 && sync
4096+0 records in
4096+0 records out
4294967296 bytes transferred in 11.280 secs (380734881 bytes/sec)
obsdsrv2$ time dd if=file1.tmp of=/dev/null bs=1M count=4096 && sync
4096+0 records in
4096+0 records out
4294967296 bytes transferred in 10.167 secs (422400700 bytes/sec)
0m10.16s real 0m00.00s user 0m03.63s system
obsdsrv2$ time dd if=file1.tmp of=/dev/null bs=1M count=2048 && sync
2048+0 records in
2048+0 records out
2147483648 bytes transferred in 4.515 secs (475551520 bytes/sec)
0m04.51s real 0m00.00s user 0m01.85s system
obsdsrv2$ time dd if=file1.tmp of=/dev/null bs=1M count=1024 && sync
1024+0 records in
1024+0 records out
1073741824 bytes transferred in 1.728 secs (621203080 bytes/sec)
0m01.72s real 0m00.00s user 0m00.91s system
obsdsrv2$ time dd if=file1.tmp of=/dev/null bs=1M count=512 && sync
512+0 records in
512+0 records out
536870912 bytes transferred in 0.265 secs (2021821094 bytes/sec)
0m00.26s real 0m00.00s user 0m00.26s system
ironm@wheezy:~$ time dd if=/dev/zero of=file1.tmp bs=1M count=4096 && sync
4096+0 Datensätze ein
4096+0 Datensätze aus
4294967296 Bytes (4.3 GB) kopiert, 1.0029 s, 4.3 GB/s
real 0m1.231s
user 0m0.000s
sys 0m1.224s
---
ironm@fbsdsrv8:~ $ time dd if=/dev/zero of=file1.tmp bs=1M count=4096 && sync
4096+0 records in
4096+0 records out
4294967296 bytes transferred in 8.432852 secs (509313755 bytes/sec)
8.79 real 0.01 user 3.36 sys
---
ironm@fbsdsrv1:~ $ time dd if=/dev/zero of=file1.tmp bs=1M count=4096 && sync
4096+0 records in
4096+0 records out
4294967296 bytes transferred in 5.947370 secs (722162508 bytes/sec)
6.41 real 0.00 user 4.65
---
ironm@fbsdsrv2:~ $ time dd if=/dev/zero of=file1.tmp bs=1M count=4096 && sync
4096+0 records in
4096+0 records out
4294967296 bytes transferred in 8.804378 secs (487821753 bytes/sec)
9.26 real 0.00 user 4.94 sys
--------------------------------------------------------------------------------
ronm@wheezy:~$ time dd if=file1.tmp of=/dev/null bs=1M count=4096 && sync
4096+0 Datensätze ein
4096+0 Datensätze aus
4294967296 Bytes (4.3 GB) kopiert, 0.410687 s, 10.5 GB/s
real 0m0.412s
user 0m0.000s
sys 0m0.408s
ironm@wheezy:~$ time dd if=file1.tmp of=/dev/null bs=1M count=512 && sync
512+0 Datensätze ein
512+0 Datensätze aus
536870912 Bytes (537 MB) kopiert, 0.0558006 s, 9.6 GB/s
real 0m0.057s
user 0m0.000s
sys 0m0.056s
---
ironm@fbsdsrv8:~ $ time dd if=file1.tmp of=/dev/null bs=1M count=4096 && sync
4096+0 records in
4096+0 records out
4294967296 bytes transferred in 1.338350 secs (3209151777 bytes/sec)
1.34 real 0.00 user 1.34 sys
ironm@fbsdsrv8:~ $ time dd if=file1.tmp of=/dev/null bs=1M count=512 && sync
512+0 records in
512+0 records out
536870912 bytes transferred in 0.167219 secs (3210581655 bytes/sec)
0.17 real 0.00 user 0.17 sys
---
ironm@fbsdsrv1:~ $ time dd if=file1.tmp of=/dev/null bs=1M count=4096 && sync
4096+0 records in
4096+0 records out
4294967296 bytes transferred in 1.173098 secs (3661217181 bytes/sec)
1.17 real 0.00 user 1.17 sys
ironm@fbsdsrv1:~ $ time dd if=file1.tmp of=/dev/null bs=1M count=512 && sync
512+0 records in
512+0 records out
536870912 bytes transferred in 0.191353 secs (2805662938 bytes/sec)
0.19 real 0.00 user 0.18 sys
---
ironm@fbsdsrv2:~ $ time dd if=file1.tmp of=/dev/null bs=1M count=4096 && sync
4096+0 records in
4096+0 records out
4294967296 bytes transferred in 1.159899 secs (3702879890 bytes/sec)
1.16 real 0.00 user 1.16 sys
ironm@fbsdsrv2:~ $ time dd if=file1.tmp of=/dev/null bs=1M count=512 && sync
512+0 records in
512+0 records out
536870912 bytes transferred in 0.213278 secs (2517231248 bytes/sec)
0.21 real 0.00 user 0.21 sys
---------------------------------------------------------------------------
obsdsrv2$ time dd if=/dev/zero of=file1.tmp bs=1M count=4096 && sync
4096+0 records in
4096+0 records out
4294967296 bytes transferred in 9.136 secs (470078173 bytes/sec)
0m09.15s real 0m00.00s user 0m04.77s system
---
obsdsrv2$ time dd if=file1.tmp of=/dev/null bs=1M count=4096 && sync
4096+0 records in
4096+0 records out
4294967296 bytes transferred in 11.280 secs (380734881 bytes/sec)
obsdsrv2$ time dd if=file1.tmp of=/dev/null bs=1M count=4096 && sync
4096+0 records in
4096+0 records out
4294967296 bytes transferred in 10.167 secs (422400700 bytes/sec)
0m10.16s real 0m00.00s user 0m03.63s system
obsdsrv2$ time dd if=file1.tmp of=/dev/null bs=1M count=2048 && sync
2048+0 records in
2048+0 records out
2147483648 bytes transferred in 4.515 secs (475551520 bytes/sec)
0m04.51s real 0m00.00s user 0m01.85s system
obsdsrv2$ time dd if=file1.tmp of=/dev/null bs=1M count=1024 && sync
1024+0 records in
1024+0 records out
1073741824 bytes transferred in 1.728 secs (621203080 bytes/sec)
0m01.72s real 0m00.00s user 0m00.91s system
obsdsrv2$ time dd if=file1.tmp of=/dev/null bs=1M count=512 && sync
512+0 records in
512+0 records out
536870912 bytes transferred in 0.265 secs (2021821094 bytes/sec)
0m00.26s real 0m00.00s user 0m00.26s system
ironm@wheezy:~$ scp fbsd2debian-send-conf_AMD_FX_4100_to_Xeon-E312700.iso
ironm@10.0.0.3:/home/ironm/debiani2obsd-send-conf_Xeon-E312700_to_AMD_FX_4100.iso
ironm@10.0.0.3's password:
fbsd2debian-send-conf_AMD_FX_4100_to_Xeon-E312700.iso 100% 3626MB 78.8MB/s
00:46
---
# OpenBSD
load averages: 0.74, 0.24, 0.09 obsdsrv2.born2b3.net
16:28:37
49 processes: 1 running, 47 idle, 1 on processor up
0:34
CPU0 states: 13.6% user, 0.0% nice, 37.9% sys, 7.8% spin, 9.0% intr, 31.7%
idle
CPU1 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
CPU2 states: 16.2% user, 0.0% nice, 40.9% sys, 6.2% spin, 0.0% intr, 36.7%
idle
CPU3 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
Memory: Real: 71M/1028M act/tot Free: 30G Cache: 886M Swap: 0K/32G
PID USERNAME PRI NICE SIZE RES STATE WAIT TIME CPU COMMAND
87302 ironm 55 0 1204K 3052K run/0 - 0:14 44.92% sshd
30598 ironm 2 0 424K 1424K sleep/2 poll 0:04 14.21% scp
--------------------------------------------------------------------------------------
ironm@wheezy:~/netperf_BSDs$ scp
ironm@10.0.0.3:/home/ironm/debiani2obsd-send-conf_Xeon-E312700_to_AMD_FX_4100.iso
t99.iso
ironm@10.0.0.3's password:
debiani2obsd-send-conf_Xeon-E312700_to_AMD_FX_4100.iso 00% 3626MB
69.7MB/s 00:5
# OpenBSD
---
load averages: 0.84, 0.38, 0.17 obsdsrv2.born2b3.net
16:33:37
49 processes: 47 idle, 2 on processor up
0:39
CPU0 states: 14.0% user, 0.0% nice, 27.5% sys, 8.8% spin, 4.2% intr, 45.5%
idle
CPU1 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
CPU2 states: 12.0% user, 0.0% nice, 31.7% sys, 9.8% spin, 0.0% intr, 46.5%
idle
CPU3 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
Memory: Real: 75M/1033M act/tot Free: 30G Cache: 886M Swap: 0K/32G
PID USERNAME PRI NICE SIZE RES STATE WAIT TIME CPU COMMAND
7977 ironm 51 0 4948K 6776K onproc/0 - 0:11 36.96% sshd
45910 ironm 2 0 424K 1452K sleep/2 poll 0:04 12.65% scp
# debian
---
top - 16:33:47 up 11:39, 14 users, load average: 0.62, 0.31, 0.18
Tasks: 149 total, 3 running, 146 sleeping, 0 stopped, 0 zombie
%Cpu(s): 12.0 us, 0.9 sy, 0.0 ni, 87.1 id, 0.0 wa, 0.0 hi, 0.0 si, 0.0 st
KiB Mem: 32997232 total, 13803156 used, 19194076 free, 212128 buffers
KiB Swap: 0 total, 0 used, 0 free, 12965016 cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
7910 ironm 20 0 42536 4268 2396 R 99.9 0.0 0:24.70 ssh
7909 ironm 20 0 12532 764 632 S 3.0 0.0 0:00.80 scp
ironm@wheezy:~/netperf_BSDs$ scp ironm@10.0.0.3:/home/ironm/t1.iso
fbsd2debian-send-conf_AMD_FX_4100_to_Xeon-E312700.iso
Password for ironm@fbsdsrv8:
t1.iso 100% 3626MB 80.6MB/s 00:45
# FreeBSD
last pid: 1506; load averages: 0.34, 0.27, 0.21 up 0+03:16:34 15:13:34
35 processes: 2 running, 33 sleeping
CPU: 6.1% user, 0.0% nice, 10.6% system, 0.0% interrupt, 83.3% idle
Mem: 15M Active, 7056M Inact, 786M Wired, 468M Buf, 24G Free
Swap: 4034M Total, 4034M Free
PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND
1505 ironm 1 84 0 23M 12M CPU2 2 0:14 38.49% sshd
1506 ironm 1 23 0 16M 6284K select 2 0:02 6.31% scp
1481 ironm 1 20 0 13M 3624K CPU1 1 0:00 0.03% top
# ---
# debian
top - 15:12:00 up 10:18, 14 users, load average: 0.50, 0.18, 0.10
Tasks: 152 total, 2 running, 150 sleeping, 0 stopped, 0 zombie
%Cpu(s): 12.1 us, 1.3 sy, 0.0 ni, 86.3 id, 0.0 wa, 0.0 hi, 0.3 si, 0.0 st
KiB Mem: 32997232 total, 5599504 used, 27397728 free, 212088 buffers
KiB Swap: 0 total, 0 used, 0 free, 4759800 cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
7590 ironm 20 0 43564 5260 2412 R 99.5 0.0 0:41.43 ssh
7589 ironm 20 0 12532 764 632 S 4.3 0.0 0:01.82 scp
# ---------------------------------------------------------------------
ironm@wheezy:~/netperf_BSDs$ scp
fbsd2debian-send-conf_AMD_FX_4100_to_Xeon-E312700.iso
ironm@10.0.0.3:/home/ironm/debiani2fbsd-send-conf_Xeon-E312700_to_AMD_FX_4100.iso
Password for ironm@fbsdsrv8:
fbsd2debian-send-conf_AMD_FX_4100_to_Xeon-E312700.iso 100% 3626MB 74.0MB/s
00:49
# Debian
top - 15:18:01 up 10:24, 14 users, load average: 0.66, 0.32, 0.18
Tasks: 151 total, 2 running, 149 sleeping, 0 stopped, 0 zombie
%Cpu(s): 12.2 us, 1.2 sy, 0.0 ni, 86.5 id, 0.0 wa, 0.0 hi, 0.0 si, 0.0 st
KiB Mem: 32997232 total, 5891576 used, 27105656 free, 212088 buffers
KiB Swap: 0 total, 0 used, 0 free, 5057692 cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
7618 ironm 20 0 41476 2956 2288 R 100.1 0.0 0:37.35 ssh
7617 ironm 20 0 12532 764 632 S 3.0 0.0 0:01.10 scp
# FreeBSD
last pid: 1513; load averages: 0.33, 0.23, 0.19
up 0+03:21:08 15:18:08
35 processes: 1 running, 34 sleeping
CPU: 6.3% user, 0.0% nice, 12.5% system, 0.2% interrupt, 81.0% idle
Mem: 12M Active, 10G Inact, 1015M Wired, 687M Buf, 20G Free
Swap: 4034M Total, 4034M Free
PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND
1512 ironm 1 52 0 20M 9192K select 1 0:21 41.77% sshd
1513 ironm 1 26 0 16M 6284K select 3 0:05 9.99% scp
1481 ironm 1 20 0 13M 3624K CPU2 2 0:00 0.04% top
# fbsdsrv1 kernel: CPU: Intel(R) Xeon(R) CPU X5690 @ 3.47GHz
(3465.76-MHz K8-class CPU)
# fbsdsrv1 kernel: FreeBSD/SMP: Multiprocessor System Detected: 24 CPUs
# fbsdsrv1 kernel: real memory = 103079215104 (98304 MB)
# fbsdsrv1 kernel: da0: <HP RAID ADG OK> Fixed Direct Access SPC-3 SCSI device
# fbsdsrv1 kernel: da0: Serial Number PACCRCN80ZL1RD7
# fbsdsrv1 kernel: da0: 135.168MB/s transfers
# fbsdsrv1 kernel: da0: Command Queueing enabled
# fbsdsrv1 kernel: da0: 839893MB (1720102192 512 byte sectors)
# fbsdsrv1 kernel: ix0: <Intel(R) PRO/10GbE PCI-Express Network Driver> port
0x7000-0x701f mem 0xe9a80000-0xe9afffff,0xe9a70000-0xe9a73fff irq 26
# at device 0.0 on pci6
# fbsdsrv1 kernel: ix0: Using 2048 tx descriptors and 2048 rx descriptors
# fbsdsrv1 kernel: ix0: queue equality override not set, capping rx_queues at
12 and tx_queues at 12
# fbsdsrv1 kernel: ix0: Using 12 rx queues 12 tx queues
# fbsdsrv1 kernel: ix0: Using MSI-X interrupts with 13 vectors
# fbsdsrv1 kernel: ix0: allocated for 12 queues
# fbsdsrv1 kernel: ix0: allocated for 12 rx queues
# fbsdsrv1 kernel: ix0: Ethernet address: 90:e2:ba:16:20:a4
# fbsdsrv1 kernel: ix0: PCI Express Bus: Speed 5.0GT/s Width x4
# fbsdsrv1 kernel: ix0: netmap queues/slots: TX 12/2048, RX 12/2048
# fbsdsrv1 kernel: ix1: <Intel(R) PRO/10GbE PCI-Express Network Driver> port
0x7020-0x703f mem 0xe9980000-0xe99fffff,0xe9970000-0xe9973fff irq 25
# at device 0.1 on pci6
# fbsdsrv1 kernel: ix1: Using 2048 tx descriptors and 2048 rx descriptors
# fbsdsrv1 kernel: ix1: queue equality override not set, capping rx_queues at
12 and tx_queues at 12
# fbsdsrv1 kernel: ix1: Using 12 rx queues 12 tx queues
# fbsdsrv1 kernel: ix1: Using MSI-X interrupts with 13 vectors
# fbsdsrv1 kernel: ix1: allocated for 12 queues
# fbsdsrv1 kernel: ix1: allocated for 12 rx queues
# fbsdsrv1 kernel: ix1: Ethernet address: 90:e2:ba:16:20:a5
# fbsdsrv1 kernel: ix1: PCI Express Bus: Speed 5.0GT/s Width x4
# fbsdsrv1 kernel: ix1: netmap queues/slots: TX 12/2048, RX 12/2048
# ---
ironm@fbsdsrv1:~ $ scp t1.iso
ironm@200.0.0.20:/home/ironm/fbsd2fbs-send-conf1.iso
Password for ironm@fbsdsrv2:
t1.iso 100% 3626MB 132.0MB/s
00:27
last pid: 1426; load averages: 0.62, 0.20, 0.07 up 0+00:38:00
13:09:34
20 processes: 2 running, 18 sleeping
CPU: 2.9% user, 0.0% nice, 3.8% system, 0.0% interrupt, 93.2% idle
Mem: 14M Active, 3628M Inact, 675M Wired, 245M Buf, 136G Free
Swap: 3897M Total, 3897M Free
PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND
1425 ironm 1 87 0 20M 9020K CPU7 7 0:07 99.34% sshd
1426 ironm 1 35 0 16M 6288K select 19 0:02 25.44% scp
1421 ironm 1 20 0 13M 3608K CPU17 17 0:00 0.03% top
# ------------------------------------------------------------------------------
# fbsdsrv2 kernel: CPU: Intel(R) Xeon(R) CPU X5680 @ 3.33GHz
(3332.45-MHz K8-class CPU)
# fbsdsrv2 kernel: FreeBSD/SMP: Multiprocessor System Detected: 24 CPUs
# fbsdsrv2 kernel: real memory = 154618822656 (147456 MB)
# fbsdsrv2 kernel: da0: <HP RAID ADG OK> Fixed Direct Access SPC-3 SCSI device
# fbsdsrv2 kernel: da0: Serial Number 500143801478FAF0
# fbsdsrv2 kernel: da0: 135.168MB/s transfers
# fbsdsrv2 kernel: da0: Command Queueing enabled
# fbsdsrv2 kernel: da0: 559929MB (1146734896 512 byte sectors
# fbsdsrv2 kernel: ix0: <Intel(R) PRO/10GbE PCI-Express Network Driver> port
0x5000-0x501f mem 0xf1a80000-0xf1afffff,0xf1a70000-0xf1a73fff irq 26
# at device 0.0 on pci5
# fbsdsrv2 kernel: ix0: Using 2048 tx descriptors and 2048 rx descriptors
# fbsdsrv2 kernel: ix0: queue equality override not set, capping rx_queues at
12 and tx_queues at 12
# fbsdsrv2 kernel: ix0: Using 12 rx queues 12 tx queues
# fbsdsrv2 kernel: ix0: Using MSI-X interrupts with 13 vectors
# fbsdsrv2 kernel: ix0: allocated for 12 queues
# fbsdsrv2 kernel: ix0: allocated for 12 rx queues
# fbsdsrv2 kernel: ix0: Ethernet address: 90:e2:ba:16:16:70
# fbsdsrv2 kernel: ix0: PCI Express Bus: Speed 5.0GT/s Width x4
# fbsdsrv2 kernel: ix0: netmap queues/slots: TX 12/2048, RX 12/2048
# fbsdsrv2 kernel: ix1: <Intel(R) PRO/10GbE PCI-Express Network Driver> port
0x5020-0x503f mem 0xf1980000-0xf19fffff,0xf1970000-0xf1973fff irq 25
# at device 0.1 on pci5
# fbsdsrv2 kernel: ix1: Using 2048 tx descriptors and 2048 rx descriptors
# fbsdsrv2 kernel: ix1: queue equality override not set, capping rx_queues at
12 and tx_queues at 12
# fbsdsrv2 kernel: ix1: Using 12 rx queues 12 tx queues
# fbsdsrv2 kernel: ix1: Using MSI-X interrupts with 13 vectors
# fbsdsrv2 kernel: ix1: allocated for 12 queues
# fbsdsrv2 kernel: ix1: allocated for 12 rx queues
# fbsdsrv2 kernel: ix1: Ethernet address: 90:e2:ba:16:16:71
# fbsdsrv2 kernel: ix1: PCI Express Bus: Speed 5.0GT/s Width x4
# fbsdsrv2 kernel: ix1: netmap queues/slots: TX 12/2048, RX 12/2048
# ---
ironm@fbsdsrv2:~ $ scp t100.iso
ironm@200.0.0.10:/home/ironm/fbsd2fbs-send-conf2.iso
Password for ironm@fbsdsrv1:
t100.iso 100% 3626MB 138.7MB/s
00:26
last pid: 2137; load averages: 0.30, 0.15, 0.08 up 0+00:43:37
13:15:10
21 processes: 2 running, 19 sleeping
CPU: 2.7% user, 0.0% nice, 4.9% system, 0.0% interrupt, 92.4% idle
Mem: 18M Active, 5123M Inact, 859M Wired, 469M Buf, 88G Free
Swap: 4096M Total, 4096M Free
PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND
2134 ironm 1 93 0 25M 13M CPU2 2 0:12 103.48% sshd
2135 ironm 1 39 0 16M 6288K select 17 0:03 30.70% scp
2130 ironm 1 20 0 13M 3616K CPU10 10 0:00 0.03% top
# ------------------------------------------------------------------------------
# fbsdsrv8 kernel: CPU: AMD FX(tm)-4100 Quad-Core Processor
(3612.06-MHz K8-class CPU)
# fbsdsrv8 kernel: FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
# fbsdsrv8 kernel: real memory = 34359738368 (32768 MB)
# fbsdsrv8 kernel: ada0: <Samsung SSD 860 PRO 512GB RVM01B6Q> ACS-4 ATA SATA
3.x device
# fbsdsrv8 kernel: ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 512bytes)
# fbsdsrv8 kernel: ada0: Command Queueing enabled
# fbsdsrv8 kernel: ada0: 488386MB (1000215216 512 byte sectors
# fbsdsrv8 kernel: ix0: <Intel(R) PRO/10GbE PCI-Express Network Driver> port
0xd020-0xd03f mem 0xfe200000-0xfe2fffff,0xfe404000-0xfe407fff irq 28
# at device 0.0 on pci2
# fbsdsrv8 kernel: ix0: Using 2048 tx descriptors and 2048 rx descriptors
# fbsdsrv8 kernel: ix0: Using 4 rx queues 4 tx queues
# fbsdsrv8 kernel: ix0: Using MSI-X interrupts with 5 vectors
# fbsdsrv8 kernel: ix0: allocated for 4 queues
# fbsdsrv8 kernel: ix0: allocated for 4 rx queues
# fbsdsrv8 kernel: ix0: Ethernet address: a0:36:9f:26:94:9c
# fbsdsrv8 kernel: ix0: PCI Express Bus: Speed 5.0GT/s Width x8
# fbsdsrv8 kernel: ix0: netmap queues/slots: TX 4/2048, RX 4/2048
# fbsdsrv8 kernel: ix1: <Intel(R) PRO/10GbE PCI-Express Network Driver> port
0xd000-0xd01f mem 0xfe100000-0xfe1fffff,0xfe400000-0xfe403fff irq 29
# at device 0.1 on pci2
# fbsdsrv8 kernel: ix1: Using 2048 tx descriptors and 2048 rx descriptors
# fbsdsrv8 kernel: ix1: Using 4 rx queues 4 tx queues
# fbsdsrv8 kernel: ix1: Using MSI-X interrupts with 5 vectors
# fbsdsrv8 kernel: ix1: allocated for 4 queues
# fbsdsrv8 kernel: ix1: allocated for 4 rx queues
# fbsdsrv8 kernel: ix1: Ethernet address: a0:36:9f:26:94:9e
# fbsdsrv8 kernel: ix1: PCI Express Bus: Speed 5.0GT/s Width x8
# fbsdsrv8 kernel: ix1: netmap queues/slots: TX 4/2048, RX 4/2048
# ---
ironm@fbsdsrv8:~ $ scp t1.iso
ironm@30.0.0.20:/home/ironm/fbsd2fbs-send-conf_AMD_FX_4100_to_X5680.iso
Password for ironm@fbsdsrv2:
t1.iso 100% 3626MB 97.1MB/s
00:37
last pid: 1636; load averages: 0.16, 0.04, 0.01 up 0+02:23:23
14:54:57
20 processes: 2 running, 18 sleeping
CPU: 2.5% user, 0.0% nice, 3.4% system, 0.0% interrupt, 94.1% idle
Mem: 12M Active, 7930M Inact, 1156M Wired, 692M Buf, 132G Free
Swap: 3897M Total, 3897M Free
PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND
1635 ironm 1 90 0 24M 12M CPU7 7 0:10 89.67% sshd
1636 ironm 1 27 0 16M 6288K select 2 0:02 12.19% scp
1634 ironm 1 20 0 13M 3600K CPU11 11 0:00 0.04% top
# ---
ironm@fbsdsrv8:~ $ scp ironm@30.0.0.20:/home/ironm/t100.iso
fbsd2fbs-send-conf_X5680_to_AMD_FX_4100.iso
Password for ironm@fbsdsrv2:
t100.iso 100% 3626MB 91.9MB/s
00:3
last pid: 1675; load averages: 0.35, 0.15, 0.06 up 0+02:28:28
15:00:02
20 processes: 3 running, 17 sleeping
CPU: 2.8% user, 0.0% nice, 2.8% system, 0.0% interrupt, 94.4% idle
Mem: 11M Active, 10G Inact, 1169M Wired, 692M Buf, 129G Free
Swap: 3897M Total, 3897M Free
PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND
1657 ironm 1 95 0 22M 11M CPU8 8 0:17 91.00% sshd
1658 ironm 1 25 0 16M 6288K CPU14 14 0:02 10.93% scp
1653 ironm 1 20 0 13M 3608K CPU20 20 0:00 0.06% top
# ---
Xeon E31270 CPU Server
load averages: 0.00, 0.00, 0.03
obsdsrv1.born2b3.net 00:38:06
46 processes: 45 idle, 1 on processor
up 2:08
CPU0 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
CPU1 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
CPU2 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
CPU3 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
CPU4 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
CPU5 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
CPU6 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
CPU7 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
Memory: Real: 69M/886M act/tot Free: 30G Cache: 712M Swap: 0K/32G
PID USERNAME PRI NICE SIZE RES STATE WAIT TIME CPU COMMAND
20673 root 2 0 1092K 3756K idle poll 10:50 0.00% sshd
18870 _slaacd 2 0 732K 788K idle kqread 0:05 0.00% slaacd
36852 _dhcp 2 0 772K 692K idle poll 0:05 0.00% dhclient
51148 root 18 0 964K 992K idle pause 0:04 0.00% ksh
67419 root 28 0 1104K 2964K onproc/0 - 0:01 0.00% top
AMD FX 4100 CPU Server
load averages: 0.06, 0.02, 0.04
obsdsrv2.born2b3.net 00:38:38
54 processes: 53 idle, 1 on processor
up 1:35
CPU0 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
CPU1 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
CPU2 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
CPU3 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
Memory: Real: 109M/873M act/tot Free: 30G Cache: 658M Swap: 0K/32G
PID USERNAME PRI NICE SIZE RES STATE WAIT TIME CPU COMMAND
19929 _x11 2 0 27M 40M sleep/0 poll 0:12 0.00% Xorg
1 root 10 0 404K 456K idle wait 0:01 0.00% init
20145 ironm 2 0 920K 3456K sleep/2 select 0:01 0.00% fvwm
62507 ironm 2 0 7004K 11M sleep/0 select 0:00 0.00% xterm
# ------------------------------------------------------------------------------
# Single send
obsdsrv2$ scp 4GByte-random.bin ironm@10.0.0.2:/home/ironm/send4GByte-v1.bin
4GByte-random.bin 89% 3665MB
71.0MB/s 00:06 ETA
# ---
load averages: 0.30, 0.06, 0.04
obsdsrv1.born2b3.net 00:39:51
50 processes: 48 idle, 2 on processor
up 2:10
CPU0 states: 0.6% user, 0.0% nice, 1.0% sys, 0.2% spin, 3.6% intr, 94.6%
idle
CPU1 states: 20.2% user, 0.0% nice, 28.7% sys, 6.6% spin, 0.0% intr, 44.5%
idle
CPU2 states: 11.8% user, 0.0% nice, 25.7% sys, 4.8% spin, 0.0% intr, 57.7%
idle
CPU3 states: 9.6% user, 0.0% nice, 11.8% sys, 4.0% spin, 0.0% intr, 74.7%
idle
CPU4 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
CPU5 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
CPU6 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
CPU7 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
Memory: Real: 71M/889M act/tot Free: 30G Cache: 712M Swap: 0K/32G
PID USERNAME PRI NICE SIZE RES STATE WAIT TIME CPU COMMAND
27857 ironm 39 0 1220K 3024K onproc/1 - 0:11 37.45% sshd
47712 ironm 2 0 428K 1456K sleep/2 poll 0:02 9.77% scp
20673 root 2 0 1092K 3756K idle poll 10:50 0.00% sshd
18870 _slaacd 2 0 732K 788K idle kqread 0:05 0.00% slaacd
load averages: 0.43, 0.10, 0.07
obsdsrv2.born2b3.net 00:39:58
56 processes: 54 idle, 2 on processor
up 1:37
CPU0 states: 33.7% user, 0.0% nice, 27.1% sys, 10.6% spin, 6.0% intr, 22.6%
idle
CPU1 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
CPU2 states: 31.7% user, 0.0% nice, 34.9% sys, 10.0% spin, 0.0% intr, 23.4%
idle
CPU3 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
Memory: Real: 112M/877M act/tot Free: 30G Cache: 658M Swap: 0K/32G
PID USERNAME PRI NICE SIZE RES STATE WAIT TIME CPU COMMAND
35786 ironm 10 0 3108K 5888K onproc/2 - 0:20 61.82% ssh
21137 ironm 2 0 420K 1496K sleep/2 poll 0:05 13.53% scp
19929 _x11 2 0 27M 40M sleep/2 poll 0:12 1.37% Xorg
# ------------------------------------------------------------------------------
# Send and receive at once (two scp connections)
obsdsrv2$ scp 4GByte-random.bin ironm@10.0.0.2:/home/ironm/send4GByte-v1.bin
ironm@10.0.0.2's password:
4GByte-random.bin 50% 2050MB
47.7MB/s 00:42 ETA
obsdsrv2$ scp ironm@10.0.0.2:/home/ironm/4GByte-random.bin receive4GByte-v1.bin
ironm@10.0.0.2's password:
4GByte-random.bin 68% 2814MB 50.8MB/s
00:25 ETA
load averages: 1.33, 0.40, 0.18
obsdsrv1.born2b3.net 01:06:11
57 processes: 54 idle, 3 on processor
up 2:36
CPU0 states: 11.4% user, 0.0% nice, 15.4% sys, 9.8% spin, 10.0% intr, 53.5%
idle
CPU1 states: 30.1% user, 0.0% nice, 24.8% sys, 14.0% spin, 0.0% intr, 31.1%
idle
CPU2 states: 21.0% user, 0.0% nice, 31.1% sys, 11.8% spin, 0.0% intr, 36.1%
idle
CPU3 states: 21.6% user, 0.0% nice, 23.6% sys, 12.6% spin, 0.0% intr, 42.3%
idle
CPU4 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
CPU5 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
CPU6 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
CPU7 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
Memory: Real: 84M/906M act/tot Free: 30G Cache: 712M Swap: 0K/32G
PID USERNAME PRI NICE SIZE RES STATE WAIT TIME CPU COMMAND
96628 ironm 10 0 1176K 3060K onproc/1 - 0:41 66.46% sshd
32758 ironm 64 0 4892K 6780K onproc/0 - 0:41 61.67% sshd
39950 ironm 2 0 432K 1440K sleep/3 poll 0:08 13.09% scp
90607 ironm 2 0 436K 1480K sleep/3 poll 0:09 12.84% scp
59276 root 2 0 1044K 3764K sleep/2 poll 0:34 0.00% sshd
13599 root 2 0 1044K 3752K sleep/3 poll 0:09 0.00% sshd
18870 _slaacd 2 0 732K 788K sleep/3 kqread 0:05 0.00% slaacd
load averages: 2.44, 0.76, 0.33
obsdsrv2.born2b3.net 01:06:14
60 processes: 3 running, 56 idle, 1 on processor
up 2:03
CPU0 states: 38.3% user, 0.0% nice, 42.7% sys, 13.6% spin, 5.4% intr, 0.0%
idle
CPU1 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
CPU2 states: 40.9% user, 0.0% nice, 44.1% sys, 14.8% spin, 0.0% intr, 0.2%
idle
CPU3 states: 0.0% user, 0.0% nice, 0.0% sys, 0.0% spin, 0.0% intr, 100%
idle
Memory: Real: 120M/887M act/tot Free: 30G Cache: 658M Swap: 0K/32G
PID USERNAME PRI NICE SIZE RES STATE WAIT TIME CPU COMMAND
12350 ironm 64 0 1156K 3924K run/0 - 0:49 66.21% ssh
78915 ironm 64 0 4560K 7336K run/2 - 0:47 64.16% ssh
11917 ironm 48 0 424K 1512K run/2 - 0:09 13.53% scp
1584 ironm 2 0 440K 1528K sleep/2 poll 0:08 9.96% scp
19929 _x11 2 0 27M 40M sleep/2 poll 0:14 0.98% Xorg
1 root 10 0 404K 456K idle wait 0:01 0.00% init
# ---
obsdsrv2$ scp 4GByte-random.bin ironm@10.0.0.2:/home/ironm/send4GByte-v1.bin
4GByte-random.bin 100% 4096MB 49.4MB/s 01:22
obsdsrv2$ scp ironm@10.0.0.2:/home/ironm/4GByte-random.bin receive4GByte-v1.bin
4GByte-random.bin 100% 4096MB 51.2MB/s 01:19
ironm@fbsdsrv2:~ $ scp obsd2fbsd.iso ironm@200.0.0.10:/home/ironm/
Password for ironm@fbsdsrv1:
obsd2fbsd.iso
100% 3626MB 140.5MB/s 00:25
ironm@fbsdsrv2:~ $ scp obsd2fbsd.iso ironm@200.0.0.10:/home/ironm/t2.iso
Password for ironm@fbsdsrv1:
obsd2fbsd.iso
100% 3626MB 124.5MB/s 00:29
ironm@fbsdsrv2:~ $ scp obsd2fbsd.iso ironm@170.0.0.10:/home/ironm/t172.iso
Password for ironm@fbsdsrv1:
obsd2fbsd.iso
100% 3626MB 22.2MB/s 02:43
ironm@fbsdsrv2:~ $
ironm@fbsdsrv2:~ $ scp obsd2fbsd.iso ironm@200.0.0.10:/home/ironm/t2.iso
Password for ironm@fbsdsrv1:
Password for ironm@fbsdsrv1:
obsd2fbsd.iso
100% 3626MB 43.2MB/s 01:24
ironm@fbsdsrv2:~ $ scp ironm@200.0.0.10:/home/ironm/t2.iso t100.iso
Password for ironm@fbsdsrv1:
t2.iso
100% 3626MB 130.2MB/s 00:27
ironm@fbsdsrv2:~ $ scp obsd2fbsd.iso ironm@200.0.0.10:/home/ironm/
The authenticity of host '200.0.0.10 (200.0.0.10)' can't be established.
ECDSA key fingerprint is SHA256:/4A6G7sn+LIXfmhN/UX92F8oL8YM/1PgmeN1VXJ0vkk.
No matching host key fingerprint found in DNS.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added '200.0.0.10' (ECDSA) to the list of known hosts.
Password for ironm@fbsdsrv1:
obsd2fbsd.iso
100% 3626MB 137.8MB/s 00:26
ironm@fbsdsrv2:~ $ scp obsd2fbsd.iso ironm@200.0.0.10:/home/ironm/
Password for ironm@fbsdsrv1:
obsd2fbsd.iso
49% 1797MB 141.3MB/s 00:12 ETA^Cironm@fbsdsrv2:~ $ scp obsd2fbsd.iso
ironm@200.0.0.10:/home/ironm/t1.iso
Password for ironm@fbsdsrv1:
obsd2fbsd.iso
100% 3626MB 119.7MB/s 00:30
ironm@fbsdsrv2:~ $ scp obsd2fbsd.iso ironm@170.0.0.10:/home/ironm/t1701.iso
The authenticity of host '170.0.0.10 (170.0.0.10)' can't be established.
ECDSA key fingerprint is SHA256:/4A6G7sn+LIXfmhN/UX92F8oL8YM/1PgmeN1VXJ0vkk.
No matching host key fingerprint found in DNS.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added '170.0.0.10' (ECDSA) to the list of known hosts.
Password for ironm@fbsdsrv1:
obsd2fbsd.iso
100% 3626MB 21.9MB/s 02:45
ironm@fbsdsrv2:~ $ scp obsd2fbsd.iso ironm@200.0.0.10:/home/ironm/t1.iso
Password for ironm@fbsdsrv1:
obsd2fbsd.iso
100% 3626MB 40.9MB/s 01:28
ironm@fbsdsrv2:~ $ scp obsd2fbsd.iso ironm@200.0.0.10:/home/ironm/t1.iso
Password for ironm@fbsdsrv1:
obsd2fbsd.iso
100% 3626MB 148.2MB/s 00:24
ironm@fbsdsrv2:~ $ scp obsd2fbsd.iso ironm@200.0.0.10:/home/ironm/t1.iso
Password for ironm@fbsdsrv1:
obsd2fbsd.iso
100% 3626MB 140.4MB/s 00:25
ironm@fbsdsrv2:~ $ scp obsd2fbsd.iso ironm@200.0.0.10:/home/ironm/t5.iso
Password for ironm@fbsdsrv1:
obsd2fbsd.iso
100% 3626MB 27.4MB/s 02:12
ironm@fbsdsrv2:~ $ scp obsd2fbsd.iso ironm@200.0.0.10:/home/ironm/t6.iso
Password for ironm@fbsdsrv1:
obsd2fbsd.iso
100% 3626MB 27.8MB/s 02:10
ironm@fbsdsrv2:~ $
sendmail_enable="NONE"
hostname="fbsdsrv2"
# ifconfig_bce0="DHCP"
ifconfig_bce0="inet 192.168.1.20 netmask 255.25.255.0"
ifconfig_bce2="inet 170.0.0.20 netmask 255.25.255.0"
ifconfig_ix0="inet 200.0.0.20 netmask 255.25.255.0"
ifconfig_ix1="inet 10.0.0.20 netmask 255.25.255.0"
sshd_enable="YES"
# Set dumpdev to "AUTO" to enable crash dumps, "NO" to disable
dumpdev="AUTO"
obsdsrv1: Asus P8B-WS Xeon CPU, 32GB ECC DDR3 RAM, 512GB Sasmung Pro 860 SSD
10GBit NIC (Intel X520-DA2) directly connected to the other 10GBit NIC
OpenBSD obsdsrv1.born2b3.net 6.4 GENERIC.MP#364 amd64
obsdsrv2: Asus MB AMD_FX_4100 CPU, 32GB ECC DDR3 RAM, 512GB Sasmung Pro 860 SSD
10GBit NIC (Intel X520-DA2) directly connected to the other 10GBit NIC
OpenBSD obsdsrv2.born2b3.net 6.4 GENERIC.MP#364 amd64
# Send or receive standalone (IPv4)
# -------------------------------------------------------------------------
obsdsrv2$ scp 4GByte-random-v2.bin ironm@10.0.0.2:/home/ironm/send4GByte-v2.bin
4GByte-random-v2.bin 100% 4096MB 69.0MB/s 00:59 0
# -------------------------------------------------------------------------
obsdsrv2$ scp ironm@10.0.0.2:/home/ironm/4GByte-random.bin receive4GByte-v1.bin
4GByte-random.bin 100% 4096MB 63.6MB/s 01:04
# -------------------------------------------------------------------------
# Send AND receive at once (IPv4)
# -------------------------------------------------------------------------
obsdsrv2$ scp 4GByte-random-v2.bin ironm@10.0.0.2:/home/ironm/send4GByte-v2.bin
4GByte-random-v2.bin 100% 4096MB 49.6MB/s 01:22
# -------------------------------------------------------------------------
obsdsrv2$ scp ironm@10.0.0.2:/home/ironm/4GByte-random.bin receive4GByte-v1.bin
4GByte-random.bin 100% 4096MB 49.4MB/s 01:22
# -------------------------------------------------------------------------
# Network configuration (10GBit X520-DA2 NICs)
# -------------------------------------------------------------------------
obsdsrv1# ifconfig -a
ix0: flags=208843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST,AUTOCONF6> mtu 1500
lladdr 90:e2:ba:32:c4:34
index 1 priority 0 llprio 3
media: Ethernet autoselect (10GbaseSR full-duplex,rxpause,txpause)
status: active
inet 10.0.0.2 netmask 0xffffff00 broadcast 10.0.0.255
inet6 fe80::fd68:4835:ead2:86d9%ix0 prefixlen 64 scopeid 0x1
ix1: flags=208843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST,AUTOCONF6> mtu 1500
lladdr 90:e2:ba:32:c4:35
index 2 priority 0 llprio 3
media: Ethernet autoselect
status: no carrier
inet 100.0.0.2 netmask 0xffffff00 broadcast 100.0.0.255
inet6 fe80::b3aa:3eb7:89ef:3b14%ix1 prefixlen 64 scopeid 0x2
obsdsrv2# ifconfig -a
ix0: flags=208843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST,AUTOCONF6> mtu 1500
lladdr a0:36:9f:26:94:9c
index 1 priority 0 llprio 3
media: Ethernet autoselect
status: no carrier
inet 100.0.0.3 netmask 0xffffff00 broadcast 100.0.0.255
inet6 fe80::2981:1007:3f88:9d2d%ix0 prefixlen 64 scopeid 0x1
ix1: flags=208843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST,AUTOCONF6> mtu 1500
lladdr a0:36:9f:26:94:9e
index 2 priority 0 llprio 3
media: Ethernet autoselect (10GbaseSR full-duplex,rxpause,txpause)
status: active
inet 10.0.0.3 netmask 0xffffff00 broadcast 10.0.0.255
inet6 fe80::efa1:94f9:d931:3ae9%ix1 prefixlen 64 scopeid 0x2
# Send or receive Xeon / AMD FX 4100 CPU, 32GByte ECC RAM, 10GBit NIC
(X520-DA2), SSD
# OpenBSD 6.4 "send to /receive from" FreeBSD 13.0 (SSD)
obsdsrv2$ scp 4GB-test.bin ironm@10.0.0.2:/home/ironm
Password for ironm@fbsdsrv7:
4GB-test.bin 100% 4096MB 70.6MB/s 00:58
-----------------------------------------------------------------------
obsdsrv2$ scp ironm@10.0.0.2:/home/ironm/4GB-test.bin hugo-received.iso
Password for ironm@fbsdsrv7:
4GB-test.bin 100% 4096MB 78.5MB/s 00:52
obsdsrv2$ ifconfig -a
ix0: flags=208843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST,AUTOCONF6> mtu 1500
lladdr a0:36:9f:26:94:9c
index 1 priority 0 llprio 3
media: Ethernet autoselect (10GbaseSR full-duplex,rxpause,txpause)
status: active
inet 30.0.0.3 netmask 0xffffff00 broadcast 30.0.0.255
inet6 fe80::2981:1007:3f88:9d2d%ix0 prefixlen 64 scopeid 0x1
ix1: flags=208843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST,AUTOCONF6> mtu 1500
lladdr a0:36:9f:26:94:9e
index 2 priority 0 llprio 3
media: Ethernet autoselect (10GbaseSR full-duplex,rxpause,txpause)
status: active
inet 10.0.0.3 netmask 0xffffff00 broadcast 10.0.0.255
inet6 fe80::efa1:94f9:d931:3ae9%ix1 prefixlen 64 scopeid 0x2
