Thank you for the suggestion to test mainline.
Regarding the kernel parameters: The test is run on the host and not in
a virtual machine, for completeness I have removed the iommu and vf
related kernel parameters and they do not affect the outcome of the
test.
Unfortunately using the mainline kernel does not appear to help on the
machines in question:
# cat /proc/cmdline
BOOT_IMAGE=/vmlinuz-5.7.0-050700rc7-generic
root=UUID=99527048-4021-4a56-a7d3-21c6cb761879 ro
# uname -a
Linux node-mees 5.7.0-050700rc7-generic #202005242331 SMP Sun May 24 23:33:19
UTC 2020 x86_64 x86_64 x86_64 GNU/Linux
# cpufreq-info -o
...
CPU 47 1200000 kHz ( 41 %) - 2900000 kHz (100 %) - performance
# fio /usr/share/doc/fio/examples/fio-seq-write.fio
...
Run status group 0 (all jobs):
WRITE: bw=63.1MiB/s (66.2MB/s), 63.1MiB/s-63.1MiB/s (66.2MB/s-66.2MB/s),
io=60.0GiB (64.4GB), run=973234-973234msec
** Changed in: linux (Ubuntu)
Status: Incomplete => New
--
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1880943
Title:
[focal] disk I/O performance regression
Status in linux package in Ubuntu:
New
Bug description:
Freshly deployed equal machines with flat disk layout as configured by
MAAS, performance governor changed from ondemand to performance.
Bionic (4.15.0-101-generic) fio ext4 on spinning rust:
Run status group 0 (all jobs):
WRITE: bw=1441MiB/s (1511MB/s), 1441MiB/s-1441MiB/s (1511MB/s-1511MB/s),
io=1267GiB (1360GB), run=900001-900001msec
Disk stats (read/write):
sda: ios=2/332092, merge=0/567, ticks=196/123698912, in_queue=123760992,
util=95.91%
Bionic (4.15.0-101-generic) fio ext4 on nvme:
Run status group 0 (all jobs):
WRITE: bw=2040MiB/s (2139MB/s), 2040MiB/s-2040MiB/s (2139MB/s-2139MB/s),
io=1793GiB (1925GB), run=900001-900001msec
Disk stats (read/write):
nvme0n1: ios=0/2617321, merge=0/465, ticks=0/233900784, in_queue=232549460,
util=78.97%
Focal (5.4.0-31-generic) fio ext4 on spinning rust:
Run status group 0 (all jobs):
WRITE: bw=108MiB/s (113MB/s), 108MiB/s-108MiB/s (113MB/s-113MB/s),
io=100GiB (107GB), run=947255-947255msec
Disk stats (read/write):
sda: ios=65/430942, merge=0/980, ticks=1655/5837146, in_queue=4898628,
util=48.75%
Focal (5.4.0-31-generic) fio ext4 on nvme:
status group 0 (all jobs):
WRITE: bw=361MiB/s (378MB/s), 361MiB/s-361MiB/s (378MB/s-378MB/s),
io=320GiB (344GB), run=907842-907842msec
Disk stats (read/write):
nvme0n1: ios=0/2847497, merge=0/382, ticks=0/236641266, in_queue=230690420,
util=78.95%
Freshly deployed equal machines with bcache as configured by MAAS,
performance governor changed from ondemand to performance.
Bionic (4.15.0-101-generic):
Run status group 0 (all jobs):
WRITE: bw=2080MiB/s (2181MB/s), 2080MiB/s-2080MiB/s (2181MB/s-2181MB/s),
io=1828GiB (1963GB), run=900052-900052msec
Disk stats (read/write):
bcache3: ios=0/53036, merge=0/0, ticks=0/15519188, in_queue=15522076,
util=91.81%, aggrios=0/212383, aggrmerge=0/402, aggrticks=0/59247094,
aggrin_queue=59256646, aggrutil=91.82%
nvme0n1: ios=0/7169, merge=0/397, ticks=0/0, in_queue=0, util=0.00%
sda: ios=0/417598, merge=0/407, ticks=0/118494188, in_queue=118513292,
util=91.82%
Bionic (5.3.0-53-generic):
Run status group 0 (all jobs):
WRITE: bw=2725MiB/s (2858MB/s), 2725MiB/s-2725MiB/s (2858MB/s-2858MB/s),
io=2395GiB (2572GB), run=900001-900001msec
Disk stats (read/write):
bcache3: ios=96/3955, merge=0/0, ticks=4/895876, in_queue=895880,
util=2.63%, aggrios=48/222087, aggrmerge=0/391, aggrticks=3/2730760,
aggrin_queue=2272248, aggrutil=90.56%
nvme0n1: ios=96/2755, merge=0/373, ticks=6/78, in_queue=8, util=1.12%
sda: ios=0/441420, merge=0/409, ticks=0/5461443, in_queue=4544488,
util=90.56%
Focal (5.4.0-31-generic):
Run status group 0 (all jobs):
WRITE: bw=117MiB/s (123MB/s), 117MiB/s-117MiB/s (123MB/s-123MB/s),
io=110GiB (118GB), run=959924-959924msec
Disk stats (read/write):
bcache3: ios=0/4061, merge=0/0, ticks=0/1571168, in_queue=1571168,
util=1.40%, aggrios=0/226807, aggrmerge=0/183, aggrticks=0/2816798,
aggrin_queue=2331594, aggrutil=52.79%
nvme0n1: ios=0/1474, merge=0/46, ticks=0/50, in_queue=0, util=0.53%
sda: ios=0/452140, merge=0/321, ticks=0/5633547, in_queue=4663188,
util=52.79%
; fio-seq-write.job for fiotest
[global]
name=fio-seq-write
filename=fio-seq-write
rw=write
bs=256K
direct=0
numjobs=1
time_based=1
runtime=900
[file1]
size=10G
ioengine=libaio
iodepth=16
ProblemType: Bug
DistroRelease: Ubuntu 20.04
Package: linux-image-5.4.0-31-generic 5.4.0-31.35
ProcVersionSignature: Ubuntu 5.4.0-31.35-generic 5.4.34
Uname: Linux 5.4.0-31-generic x86_64
AlsaDevices:
total 0
crw-rw---- 1 root audio 116, 1 May 27 11:52 seq
crw-rw---- 1 root audio 116, 33 May 27 11:52 timer
AplayDevices: Error: [Errno 2] No such file or directory: 'aplay'
ApportVersion: 2.20.11-0ubuntu27
Architecture: amd64
ArecordDevices: Error: [Errno 2] No such file or directory: 'arecord'
AudioDevicesInUse: Error: command ['fuser', '-v', '/dev/snd/seq',
'/dev/snd/timer'] failed with exit code 1:
CasperMD5CheckResult: skip
Date: Wed May 27 12:44:10 2020
IwConfig: Error: [Errno 2] No such file or directory: 'iwconfig'
Lsusb:
Bus 002 Device 002: ID 8087:8002 Intel Corp.
Bus 002 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
Bus 001 Device 003: ID 413c:a001 Dell Computer Corp. Hub
Bus 001 Device 002: ID 8087:800a Intel Corp.
Bus 001 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
Lsusb-t:
/: Bus 02.Port 1: Dev 1, Class=root_hub, Driver=ehci-pci/2p, 480M
|__ Port 1: Dev 2, If 0, Class=Hub, Driver=hub/8p, 480M
/: Bus 01.Port 1: Dev 1, Class=root_hub, Driver=ehci-pci/2p, 480M
|__ Port 1: Dev 2, If 0, Class=Hub, Driver=hub/6p, 480M
|__ Port 6: Dev 3, If 0, Class=Hub, Driver=hub/6p, 480M
MachineType: Dell Inc. PowerEdge R630
PciMultimedia:
ProcFB: 0 mgag200drmfb
ProcKernelCmdLine: BOOT_IMAGE=/vmlinuz-5.4.0-31-generic
root=UUID=8dd6086f-e616-466d-a424-e5556fd75045 ro intel_iommu=on iommu=pt
probe_vf=0
RelatedPackageVersions:
linux-restricted-modules-5.4.0-31-generic N/A
linux-backports-modules-5.4.0-31-generic N/A
linux-firmware 1.187
RfKill: Error: [Errno 2] No such file or directory: 'rfkill'
SourcePackage: linux
UpgradeStatus: No upgrade log present (probably fresh install)
dmi.bios.date: 11/08/2016
dmi.bios.vendor: Dell Inc.
dmi.bios.version: 2.3.4
dmi.board.name: 02C2CP
dmi.board.vendor: Dell Inc.
dmi.board.version: A03
dmi.chassis.type: 23
dmi.chassis.vendor: Dell Inc.
dmi.modalias:
dmi:bvnDellInc.:bvr2.3.4:bd11/08/2016:svnDellInc.:pnPowerEdgeR630:pvr:rvnDellInc.:rn02C2CP:rvrA03:cvnDellInc.:ct23:cvr:
dmi.product.name: PowerEdge R630
dmi.product.sku: SKU=NotProvided;ModelName=PowerEdge R630
dmi.sys.vendor: Dell Inc.
To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1880943/+subscriptions
--
Mailing list: https://launchpad.net/~kernel-packages
Post to : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help : https://help.launchpad.net/ListHelp
