[Bug 1625542] Re: --vhost-owner --vhost-perm no more transferred to DPDK EAL commandline
After a reboot and restart of ovs-vswitchd I have seen these EAL logs pointing to the problem: EAL: vhost-user socket cannot set permissions to 0664 (Unknown error -1). EAL: vhost-user socket unable to set ownership to libvirt-qemu:kvm (Unknown error -1). VHOST_CONFIG: vhost-user server: socket created, fd: 41 VHOST_CONFIG: bind to /var/run/openvswitch/vhu6ef65d50-d7 Then I looked into vhost-net-user.c:rte_vhost_driver_register(). I have seen that rte_eal_set_socket_permissions(path) is done before the socket actually created and then I moved this call into vhost_user_create_server() after bind() and it started to work. Attached is the patch. I hope that makes sense (also need this in vhost_user_create_client() ?) . After rebuilding dpdk and restart ovs- vswitchd it looks better and nova boot now works. Starting ovs-vswitchd: ::: Zone 0: name:, phys:0x1bfffced40, len:0x30100, virt:0x7f40fffced40, socket_id:1, flags:0 VHOST_CONFIG: vhost-user server: socket created, fd: 41 VHOST_CONFIG: bind to /var/run/openvswitch/vhu6c018db8-c2 EAL: Socket /var/run/openvswitch/vhu6c018db8-c2 changed permissions to 0664 EAL: Socket /var/run/openvswitch/vhu6c018db8-c2 changed ownership to libvirt-qemu:kvm. VHOST_CONFIG: vhost-user server: socket created, fd: 48 VHOST_CONFIG: bind to /var/run/openvswitch/vhu6ef65d50-d7 EAL: Socket /var/run/openvswitch/vhu6ef65d50-d7 changed permissions to 0664 EAL: Socket /var/run/openvswitch/vhu6ef65d50-d7 changed ownership to libvirt-qemu:kvm. root@compute29:~# ll /var/run/openvswitch/ ::: srw-rw-r-- 1 libvirt-qemu kvm 0 Sep 26 11:09 vhu6c018db8-c2= srw-rw-r-- 1 libvirt-qemu kvm 0 Sep 26 11:09 vhu6ef65d50-d7= srw-rw-r-- 1 libvirt-qemu kvm 0 Sep 26 11:16 vhu927b950f-f1= << nova booted new vm ** Patch added: "Moves rte_eal_set_socket_permissions() into vhost_user_create_server()" https://bugs.launchpad.net/ubuntu/+source/dpdk/+bug/1625542/+attachment/4748866/+files/dpdk_vhost_permission_tikoehle.patch -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1625542 Title: --vhost-owner --vhost-perm no more transferred to DPDK EAL commandline To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/dpdk/+bug/1625542/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1629271] Re: ovs-dpdk 2.6 source package linkage broken
** Package changed: dpdk (Ubuntu) => openvswitch-dpdk (Ubuntu) -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1629271 Title: ovs-dpdk 2.6 source package linkage broken To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/openvswitch-dpdk/+bug/1629271/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1629271] [NEW] ovs-dpdk 2.6 source package linkage broken
Public bug reported: I am trying to build dpdk and ovs .deb packages on Ubuntu 16.04, from your latest source at DPDK 16.07: https://launchpad.net/ubuntu/+source/dpdk/16.07-0ubuntu3 OVS 2.6: https://launchpad.net/ubuntu/+source/openvswitch/2.6.0~git20160912.dc61b4e-0ubuntu4 The actual problem is that ovs-vswitchd always links with the dpdk shared libs. Linking against .so I get dpdk0 No such device error. sudo ovs-vsctl show Port "dpdk0" Interface "dpdk0" type: dpdk error: "could not open network device dpdk0 (No such device)" 2016-09-22T16:14:41.425Z|00044|bridge|WARN|could not open network device dpdk0 (No such device) localadmin@compute29:~/ovs-dpdk_backport/debian$ ldd ./debian/openvswitch-switch/usr/lib/openvswitch-switch/ovs-vswitchd linux-vdso.so.1 => (0x7fffadfea000) libssl.so.1.0.0 => /lib/x86_64-linux-gnu/libssl.so.1.0.0 (0x7f0bf7dfc000) libcrypto.so.1.0.0 => /lib/x86_64-linux-gnu/libcrypto.so.1.0.0 (0x7f0bf79a1000) libcap-ng.so.0 => /usr/lib/x86_64-linux-gnu/libcap-ng.so.0 (0x7f0bf779b000) librte_pdump.so.1 => /usr/lib/x86_64-linux-gnu/librte_pdump.so.1 (0x7f0bf7391000) librte_mbuf.so.2 => /usr/lib/x86_64-linux-gnu/librte_mbuf.so.2 (0x7f0bf718e000) librte_vhost.so.3 => /usr/lib/x86_64-linux-gnu/librte_vhost.so.3 (0x7f0bf6f7) librte_pmd_ring.so.2 => /usr/lib/x86_64-linux-gnu/librte_pmd_ring.so.2 (0x7f0bf6d6b000) librte_eal.so.2 => /usr/lib/x86_64-linux-gnu/librte_eal.so.2 (0x7f0bf6b0c000) libethdev.so.4 => /usr/lib/x86_64-linux-gnu/libethdev.so.4 (0x7f0bf687e000) librte_mempool.so.2 => /usr/lib/x86_64-linux-gnu/librte_mempool.so.2 (0x7f0bf6677000) librte_meter.so.1 => /usr/lib/x86_64-linux-gnu/librte_meter.so.1 (0x7f0bf6475000) librte_ring.so.1 => /usr/lib/x86_64-linux-gnu/librte_ring.so.1 (0x7f0bf6271000) libpthread.so.0 => /lib/x86_64-linux-gnu/libpthread.so.0 (0x7f0bf6054000) librt.so.1 => /lib/x86_64-linux-gnu/librt.so.1 (0x7f0bf5e4c000) libm.so.6 => /lib/x86_64-linux-gnu/libm.so.6 (0x7f0bf5b42000) libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6 (0x7f0bf5779000) libdl.so.2 => /lib/x86_64-linux-gnu/libdl.so.2 (0x7f0bf5575000) /lib64/ld-linux-x86-64.so.2 (0x55f29b39) librte_kvargs.so.1 => /usr/lib/x86_64-linux-gnu/librte_kvargs.so.1 (0x7f0bf5371000) ISSUES: #1: The linkage problem and dpdk0 not found. I am aware of http://dpdk.org/ml/archives/dev/2016-September/047832.html If you have a patch already could you let me know please? #2: Is there any way to make the vswitchd link with the static libs? #3: In debian/rules: override_dh_auto_configure I had to add '--with-dpdk' otherwise the ovs-vswitchd in the .deb package is without dpdk support. ** Affects: openvswitch-dpdk (Ubuntu) Importance: Undecided Status: New ** Tags: ovs-dpdk -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1629271 Title: ovs-dpdk 2.6 source package linkage broken To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/openvswitch-dpdk/+bug/1629271/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1629271] Re: ovs-dpdk 2.6 source package linkage broken
Sorry but I can't find a dpdk enabled vswitchd. I am using the latest source package: bzr import-dsc https://launchpad.net/ubuntu/+archive/primary/+files/openvswitch_2.6.0-0ubuntu2.dsc I see both the openvswitch-switch and openvswitch-switch-dpdk .deb are created and I followed the steps to install it, update-alternatives. openvswitch-switch_2.6.0-0ubuntu2_amd64.deb openvswitch-switch-dpdk_2.6.0-0ubuntu2_amd64.deb But the openvswitch-switch-dpdk package only contains usr/share/doc: dpkg -x openvswitch-switch-dpdk_2.6.0-0ubuntu2_amd64.deb tmp cd tmp root@compute29:/home/localadmin/ovs_2.6.0-0ubuntu2/tmp# tree . └── usr └── share └── doc └── openvswitch-switch-dpdk ├── changelog.Debian.gz ├── copyright └── README.Debian The compiled vswitchd under debian and _debian build dirs are not dpdk enabled; I tried all of them. 2016-10-06T11:38:04.926Z|7|dpdk|ERR|DPDK not supported in this copy of Open vSwitch. Is there any DEB_BUILD_OPTIONS required to enable dpdk ? -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1629271 Title: ovs-dpdk 2.6 source package linkage broken To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/openvswitch-dpdk/+bug/1629271/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1629271] Re: ovs-dpdk 2.6 source package linkage broken
Thanks Christian for your continued attention. Regarding #3 I downloaded the wrong source, thanks for pointing it out.. It looks like the fix for 1628419 was just released. I will try it and update this case until Friday this week. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1629271 Title: ovs-dpdk 2.6 source package linkage broken To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/openvswitch-dpdk/+bug/1629271/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1629271] Re: ovs-dpdk 2.6 source package linkage broken
Same problem - no dpdk enabled vswitchd -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1629271 Title: ovs-dpdk 2.6 source package linkage broken To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/openvswitch-dpdk/+bug/1629271/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1629271] Re: ovs-dpdk 2.6 source package linkage broken
Trying with dpdk_16.07-0ubuntu5 because it fixes 1628419. Above attempt was based on dpdk_16.07-0ubuntu4. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1629271 Title: ovs-dpdk 2.6 source package linkage broken To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/openvswitch-dpdk/+bug/1629271/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1625542] Re: --vhost-owner --vhost-perm no more transferred to DPDK EAL commandline
See my results below.
When restarting ovs-vswitchd it complains: unrecognized option '--vhost-owner'
I use ovs master (2.6.90) and dpdk 16.07. Do I still need to apply fix-
vhost-user-socket-permission.patch?
Result:
-
ovs-vsctl --no-wait set Open_vSwitch . other_config:dpdk-extra="--vhost-owner
libvirt-qemu:kvm --vhost-perm 0664"
root@compute29:/var/run/openvswitch# ovs-vsctl get Open_vSwitch . other_config
{dpdk-extra="--vhost-owner libvirt-qemu:kvm --vhost-perm 0664",
dpdk-init="true", dpdk-lcore-mask="0x300", dpdk-socket-mem="4096,4096"}
root@compute29:/var/run/openvswitch# export DB_SOCK=/var/run/openvswitch/db.sock
root@compute29:/var/run/openvswitch# ovs-vswitchd unix:$DB_SOCK -vconsole:emer
-vsyslog:err -vfile:info --mlockall --no-chdir \
> --log-file=/var/log/openvswitch/ovs-vswitchd.log \
> --pidfile=/var/run/openvswitch/ovs-vswitchd.pid \
> --detach \
> --monitor
ovs-vswitchd: unrecognized option '--vhost-owner'
EAL: Detected 32 lcore(s)
ovs-vswitchd: unrecognized option '--vhost-owner'
Versions:
--
root@compute29:/usr/src/ovs# ovs-vsctl --version
ovs-vsctl (Open vSwitch) 2.6.90
DB Schema 7.14.0
dpdk 16.07
(from: http://dpdk.org/browse/dpdk/snapshot/dpdk-16.07.zip)
--
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1625542
Title:
--vhost-owner --vhost-perm no more transferred to DPDK EAL commandline
To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/dpdk/+bug/1625542/+subscriptions
--
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1625542] Re: --vhost-owner --vhost-perm no more transferred to DPDK EAL commandline
Hi Christian, I added the code from fix-vhost-user-socket-permission.patch to my sources above (running into build issues with 2.6.0~git20160912.dc61b4e-0ubuntu4). This fixed the unrecognized option '--vhost-owner'.. issue. But the new code is not used - a new vhu socket is still root:root. I nova booted a vm which creates vhu6ef65d50-d7 but does not change owner and permissions; ovs-vswitchd.log does not show any error. See attachment. Thanks, Timo ** Attachment added: "Mitaka_ovs26_dpdk1607_backport.logs" https://bugs.launchpad.net/ubuntu/+source/dpdk/+bug/1625542/+attachment/4748806/+files/Mitaka_ovs26_dpdk1607_backport.logs -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1625542 Title: --vhost-owner --vhost-perm no more transferred to DPDK EAL commandline To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/dpdk/+bug/1625542/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
