Hello
For a home lab, I'm trying to set up virtualized compute node for Red
Hat OpenStack 13 (Queens) with DPDK-enabled OvS and failing badly...
Yes, I know I won't be able to do any performance testing, but for
functional testing, I would still find it useful.
[root@overcloud-computeovsdpdk-0 ~]# ovs-vswitchd --version
ovs-vswitchd (Open vSwitch) 2.9.0
DPDK 17.11.0
root@overcloud-computeovsdpdk-0 ~]# ovs-vsctl show
c9072cdc-8cb7-425d-a5af-a3ea0f21a2dc
Manager "ptcp:6640:127.0.0.1"
is_connected: true
Bridge br-ex
fail_mode: standalone
Port br-ex
Interface br-ex
type: internal
Port "dpdk0"
Interface "dpdk0"
type: dpdk
options: {dpdk-devargs="0000:02:00.0"}
error: "Error attaching device '0000:02:00.0' to DPDK"
[root@overcloud-computeovsdpdk-0 ~]# driverctl list-overrides
0000:02:00.0 vfio-pci
Potentially useful information from the ovs-vswitchd.log:
2019-10-18T13:20:53.156Z|00006|dpdk|INFO|Using DPDK 17.11.0
2019-10-18T13:20:53.156Z|00007|dpdk|INFO|DPDK Enabled - initializing...
2019-10-18T13:20:53.156Z|00008|dpdk|INFO|No vhost-sock-dir provided -
defaulting to /var/run/openvswitch
2019-10-18T13:20:53.156Z|00009|dpdk|INFO|IOMMU support for vhost-user-client
disabled.
2019-10-18T13:20:53.156Z|00010|dpdk|INFO|EAL ARGS: ovs-vswitchd -c 2
--socket-mem 1024 -n 1
2019-10-18T13:20:53.156Z|00011|dpdk|INFO|EAL: Detected 4 lcore(s)
2019-10-18T13:20:53.160Z|00012|dpdk|INFO|EAL: Probing VFIO support...
2019-10-18T13:20:53.160Z|00013|dpdk|INFO|EAL: VFIO support initialized
2019-10-18T13:20:53.161Z|00014|dpdk|ERR|EAL: Cannot obtain physical addresses:
Permission denied. Only vfio will function.
2019-10-18T13:20:53.487Z|00016|dpdk|INFO|EAL: PCI device 0000:01:00.0 on NUMA
socket -1
2019-10-18T13:20:53.487Z|00017|dpdk|WARN|EAL: Invalid NUMA socket, default to 0
2019-10-18T13:20:53.487Z|00018|dpdk|INFO|EAL: probe driver: 1af4:1041 net_virtio
2019-10-18T13:20:53.487Z|00019|dpdk|INFO|EAL: PCI device 0000:02:00.0 on NUMA
socket -1
2019-10-18T13:20:53.487Z|00020|dpdk|WARN|EAL: Invalid NUMA socket, default to 0
2019-10-18T13:20:53.487Z|00021|dpdk|INFO|EAL: probe driver: 1af4:1041 net_virtio
2019-10-18T13:20:53.487Z|00022|dpdk|ERR|EAL: Cannot open /dev/vfio/noiommu-0:
Permission denied
2019-10-18T13:20:53.487Z|00023|dpdk|ERR|EAL: Can't write to PCI bar (0) :
offset (12)
2019-10-18T13:20:53.487Z|00024|dpdk|ERR|EAL: Can't read from PCI bar (0) :
offset (12)
2019-10-18T13:20:53.487Z|00025|dpdk|ERR|EAL: Can't read from PCI bar (0) :
offset (12)
2019-10-18T13:20:53.487Z|00026|dpdk|ERR|EAL: Can't write to PCI bar (0) :
offset (12)
2019-10-18T13:20:53.487Z|00027|dpdk|ERR|EAL: Can't read from PCI bar (0) :
offset (12)
2019-10-18T13:20:53.487Z|00028|dpdk|ERR|EAL: Can't write to PCI bar (0) :
offset (12)
2019-10-18T13:20:53.487Z|00029|dpdk|ERR|EAL: Can't read from PCI bar (0) :
offset (0)
2019-10-18T13:20:53.487Z|00030|dpdk|ERR|EAL: Can't write to PCI bar (0) :
offset (4)
2019-10-18T13:20:53.487Z|00031|dpdk|ERR|EAL: Can't write to PCI bar (0) :
offset (14)
2019-10-18T13:20:53.487Z|00032|dpdk|ERR|EAL: Can't write to PCI bar (0) :
offset (e)
2019-10-18T13:20:53.487Z|00033|dpdk|ERR|EAL: Can't read from PCI bar (0) :
offset (c)
2019-10-18T13:20:53.487Z|00034|dpdk|ERR|EAL: Requested device 0000:02:00.0
cannot be used
2019-10-18T13:20:53.487Z|00035|dpdk|INFO|EAL: PCI device 0000:03:00.0 on NUMA
socket -1
2019-10-18T13:20:53.487Z|00036|dpdk|WARN|EAL: Invalid NUMA socket, default to 0
2019-10-18T13:20:53.487Z|00037|dpdk|INFO|EAL: probe driver: 1af4:1041 net_virtio
2019-10-18T13:20:53.488Z|00038|dpdk|INFO|DPDK Enabled - initialized
And from dmesg:
[root@overcloud-computeovsdpdk-0 ~]# dmesg |grep iommu
[ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-3.10.0-1062.1.2.el7.x86_64
root=UUID=07ccf9fd-6946-4d2a-89ba-ff3c7668bd83 ro console=tty0
console=ttyS0,115200n8 crashkernel=auto rhgb quiet default_hugepagesz=1GB
hugepagesz=1G hugepages=2 amd_iommu=on iommu=pt
vfio.enable_unsafe_noiommu_mode=Y skew_tick=1 nohz=on nohz_full=1-3
rcu_nocbs=1-3 tuned.non_isolcpus=00000001 intel_pstate=disable nosoftlockup
[ 0.000000] Kernel command line:
BOOT_IMAGE=/boot/vmlinuz-3.10.0-1062.1.2.el7.x86_64
root=UUID=07ccf9fd-6946-4d2a-89ba-ff3c7668bd83 ro console=tty0
console=ttyS0,115200n8 crashkernel=auto rhgb quiet default_hugepagesz=1GB
hugepagesz=1G hugepages=2 amd_iommu=on iommu=pt
vfio.enable_unsafe_noiommu_mode=Y skew_tick=1 nohz=on nohz_full=1-3
rcu_nocbs=1-3 tuned.non_isolcpus=00000001 intel_pstate=disable nosoftlockup
[ 2.640068] iommu: Adding device 0000:02:00.0 to group 0
[ 2.640072] vfio-pci 0000:02:00.0: Adding kernel taint for vfio-noiommu group
on device
Any ideas of what I'm doing wrong or hints of what to look for are greatly
appreciated (-:
--
David Juran
Sr. Architect
Red Hat
+358-504-766568
_______________________________________________
discuss mailing list
[email protected]
https://mail.openvswitch.org/mailman/listinfo/ovs-discuss
