> https://openports.pl/path/benchmarks/fio
> To test perf on many small IO (measuring iops basically) run:
>
> fio --name=random-write --rw=write --bs=4k --numjobs=2 --size=1g
> --iodepth=16 --runtime=60 --time_based --end_fsync=1
fio-3.26
Starting 2 threads
Jobs: 2 (f=2): [F(2)][100.0%][w=6502KiB/s][w=1625 IOPS][eta 00m:00s]
random-write: (groupid=0, jobs=1): err= 0: pid=96172096: Thu Mar 3
19:01:51 2022
write: IOPS=1592, BW=6370KiB/s (6523kB/s)(375MiB/60305msec); 0 zone resets
clat (usec): min=3, max=531908, avg=622.66, stdev=11014.61
lat (usec): min=4, max=531908, avg=623.30, stdev=11014.61
clat percentiles (usec):
| 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 6],
| 30.00th=[ 6], 40.00th=[ 7], 50.00th=[ 7], 60.00th=[ 7],
| 70.00th=[ 7], 80.00th=[ 10], 90.00th=[ 101], 95.00th=[ 111],
| 99.00th=[ 127], 99.50th=[ 141], 99.90th=[221250], 99.95th=[240124],
| 99.99th=[270533]
bw ( KiB/s): min= 1783, max=17482, per=50.07%, avg=6413.82,
stdev=3737.49, samples=119
iops : min= 445, max= 4370, avg=1603.28, stdev=934.38, samples=119
lat (usec) : 4=0.07%, 10=80.84%, 20=3.70%, 50=0.48%, 100=4.84%
lat (usec) : 250=9.71%
lat (msec) : 50=0.01%, 100=0.11%, 250=0.22%, 500=0.03%, 750=0.01%
cpu : usr=0.38%, sys=3.18%, ctx=352, majf=0, minf=3
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwts: total=0,96040,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
random-write: (groupid=0, jobs=1): err= 0: pid=-1958487488: Thu Mar 3
19:01:51 2022
write: IOPS=1609, BW=6438KiB/s (6592kB/s)(379MiB/60305msec); 0 zone resets
clat (usec): min=3, max=531873, avg=616.18, stdev=10954.39
lat (usec): min=4, max=531873, avg=616.80, stdev=10954.38
clat percentiles (usec):
| 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 6],
| 30.00th=[ 6], 40.00th=[ 7], 50.00th=[ 7], 60.00th=[ 7],
| 70.00th=[ 9], 80.00th=[ 56], 90.00th=[ 60], 95.00th=[ 64],
| 99.00th=[ 120], 99.50th=[ 130], 99.90th=[221250], 99.95th=[240124],
| 99.99th=[267387]
bw ( KiB/s): min= 1791, max=17603, per=50.60%, avg=6481.80,
stdev=3808.08, samples=119
iops : min= 447, max= 4400, avg=1620.29, stdev=952.06, samples=119
lat (usec) : 4=0.23%, 10=74.48%, 20=1.27%, 50=0.54%, 100=21.89%
lat (usec) : 250=1.24%
lat (msec) : 50=0.01%, 100=0.10%, 250=0.22%, 500=0.03%, 750=0.01%
cpu : usr=0.25%, sys=3.15%, ctx=351, majf=0, minf=3
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwts: total=0,97056,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
Run status group 0 (all jobs):
WRITE: bw=12.5MiB/s (13.1MB/s), 6370KiB/s-6438KiB/s
(6523kB/s-6592kB/s), io=754MiB (791MB), run=60305-60305msec
>
> To test large-IO perf:
>
> fio --name=random-write --rw=write --bs=1M --numjobs=1 --size=1g
> --iodepth=1 --runtime=60 --time_based --end_fsync=1
fio: this platform does not support process shared mutexes, forcing
use of threads. Use the 'thread' option to get rid of this warning.
random-write: (g=0): rw=write, bs=(R) 1024KiB-1024KiB, (W)
1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=1
fio-3.26
Starting 1 thread
Jobs: 1 (f=1): [W(1)][100.0%][w=9124KiB/s][w=8 IOPS][eta 00m:00s]
random-write: (groupid=0, jobs=1): err= 0: pid=-1257487296: Thu Mar 3
19:06:55 2022
write: IOPS=18, BW=18.9MiB/s (19.8MB/s)(1138MiB/60364msec); 0 zone resets
clat (usec): min=676, max=365152, avg=52717.28, stdev=77225.34
lat (usec): min=723, max=365213, avg=52776.70, stdev=77225.59
clat percentiles (usec):
| 1.00th=[ 701], 5.00th=[ 1745], 10.00th=[ 1926], 20.00th=[ 1975],
| 30.00th=[ 2040], 40.00th=[ 2180], 50.00th=[ 2343], 60.00th=[ 48497],
| 70.00th=[ 51643], 80.00th=[ 64750], 90.00th=[206570], 95.00th=[231736],
| 99.00th=[267387], 99.50th=[299893], 99.90th=[350225], 99.95th=[367002],
| 99.99th=[367002]
bw ( KiB/s): min= 4096, max=44259, per=100.00%, avg=19452.77,
stdev=13520.95, samples=118
iops : min= 4, max= 43, avg=18.68, stdev=13.28, samples=118
lat (usec) : 750=4.04%, 1000=0.09%
lat (msec) : 2=20.65%, 4=28.65%, 20=0.09%, 50=13.80%, 100=16.08%
lat (msec) : 250=14.41%, 500=2.20%
cpu : usr=0.10%, sys=3.59%, ctx=542, majf=0, minf=3
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwts: total=0,1138,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=1
Run status group 0 (all jobs):
WRITE: bw=18.9MiB/s (19.8MB/s), 18.9MiB/s-18.9MiB/s
(19.8MB/s-19.8MB/s), io=1138MiB (1193MB), run=60364-60364msec
>
> Look for the result in the post-run report,
> for small IO it can be
> write: IOPS=37.8k, BW=148MiB/s (155MB/s)
> and for larger writes
> write: IOPS=253, BW=253MiB/s (266MB/s)
>
Not really like your report, did you run it on another OS or cited from memory?
Besides this, are my values too low or just the expected ones?
More info here:
https://marc.info/?l=openbsd-misc&m=164548029214340&w=2
Thanks.
