Bug#763428: [ovs-dev] Bug#763428: openvswitch-switch: openvswitch doesn't work anymore since kernel 3.16 update
Monthly ping :). We're ready to test if there's a potential fix. Thanks in advance, Laurent -- To UNSUBSCRIBE, email to debian-bugs-dist-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org
Bug#763428: [ovs-dev] Bug#763428: openvswitch-switch: openvswitch doesn't work anymore since kernel 3.16 update
Hi again, Was the information presented sufficient for reproducing the issue? Thanks for your time, Laurent -- To UNSUBSCRIBE, email to debian-bugs-dist-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org
Bug#763428: openvswitch-switch: openvswitch doesn't work anymore since kernel 3.16 update
-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 I have made some additional testing on a new server that have the same hardware/setup than other I have uncounter the same issue. but in fact, the issue occurs with I use fake-bridge with a vlan. root@stri:~# ovs-vsctl show b7c26499-2586-4dac-a5c0-52d80cb24cd9 Bridge br-eth0 Port vlan3199 tag: 3199 Interface vlan3199 type: internal Port vlan3132 tag: 3132 Interface vlan3132 type: internal Port vlan3175 tag: 3175 Interface vlan3175 type: internal Port br-eth0 Interface br-eth0 type: internal Port eth0 Interface eth0 ovs_version: 2.3.90 # modinfo openvswitch filename: /lib/modules/3.16-2-amd64/updates/dkms/openvswitch.ko version:2.3.90 license:GPL description:Open vSwitch switching datapath srcversion: 3DE816749EC5E2768BB59E1 depends:libcrc32c,vxlan,gre vermagic: 3.16-2-amd64 SMP mod_unload modversions I have used the master branch of openvswitch for userland and kernel land (commit ff601a08a44c37fa8a6e0e569dc00d6731f5 - Fri Oct 10 14:41:10 2014 -0700). root@stri:~# ip a s dev vlan3175 14: vlan3175: BROADCAST,MULTICAST,UP,LOWER_UP mtu 1500 qdisc noqueue state UNKNOWN group default link/ether 62:e7:3c:9e:d4:45 brd ff:ff:ff:ff:ff:ff inet 192.168.3.106/24 scope global vlan3175 valid_lft forever preferred_lft forever inet6 fe80::60e7:3cff:fe9e:d445/64 scope link valid_lft forever preferred_lft forever root@stri:~# ovs-dpctl show system@ovs-system: lookups: hit:22902 missed:3675 lost:0 flows: 3 masks: hit:35144 total:3 hit/pkt:1.32 port 0: ovs-system (internal) port 1: vlan3132 (internal) port 2: vlan3199 (internal) port 3: eth0 port 4: vlan3175 (internal) port 5: br-eth0 (internal) Then I run the ping in background: root@stri:~# ping 192.168.3.101 ... From 192.168.3.106 icmp_seq=187 Destination Host Unreachable From 192.168.3.106 icmp_seq=188 Destination Host Unreachable From 192.168.3.106 icmp_seq=189 Destination Host Unreachable ... And I look at traffic with ovs-dpctl dump-flows and tcpdump root@stri:~# ovs-dpctl dump-flows recirc_id(0),in_port(4),eth(src=62:e7:3c:9e:d4:45,dst=ff:ff:ff:ff:ff:ff),eth_type(0x0806),arp(sip=192.168.3.106,tip=192.168.3.101,op=1/0xff), packets:17, bytes:714, used:0.436s, actions:push_vlan(vid=3175,pcp=0),5,3 recirc_id(0),in_port(1),eth(src=62:e7:3c:9e:d4:45,dst=ff:ff:ff:ff:ff:ff),eth_type(0x0806),arp(sip=89.234.156.234,tip=91.224.149.254,op=1/0xff), packets:234, bytes:9828, used:1.068s, actions:push_vlan(vid=3132,pcp=0),5,3 recirc_id(0),in_port(1),eth(src=62:e7:3c:9e:d4:45,dst=33:33:ff:00:00:31),eth_type(0x86dd),ipv6(frag=no), packets:2, bytes:172, used:1.096s, actions:push_vlan(vid=3132,pcp=0),5,3 Here, they are a first weird thing, openvswitch have created port 1 and port 4 with the same MAC, this is not the case on my other server with kernel 3.14 root@stri:~# tcpdump -eni eth0 '(icmp or arp)' tcpdump: verbose output suppressed, use -v or -vv for full protocol decode listening on eth0, link-type EN10MB (Ethernet), capture size 262144 bytes 01:36:04.924148 62:e7:3c:9e:d4:45 ff:ff:ff:ff:ff:ff, ethertype 802.1Q (0x8100), length 46: vlan 3175, p 0, ethertype ARP, Request who-has 192.168.3.101 tell 192.168.3.106, length 28 01:36:05.922944 62:e7:3c:9e:d4:45 ff:ff:ff:ff:ff:ff, ethertype 802.1Q (0x8100), length 46: vlan 3175, p 0, ethertype ARP, Request who-has 192.168.3.101 tell 192.168.3.106, length 28 01:36:06.922948 62:e7:3c:9e:d4:45 ff:ff:ff:ff:ff:ff, ethertype 802.1Q (0x8100), length 46: vlan 3175, p 0, ethertype ARP, Request who-has 192.168.3.101 tell 192.168.3.106, length 28 01:36:07.940165 62:e7:3c:9e:d4:45 ff:ff:ff:ff:ff:ff, ethertype 802.1Q (0x8100), length 46: vlan 3175, p 0, ethertype ARP, Request who-has 192.168.3.101 tell 192.168.3.106, length 28 ... It seems that the icmp does not succeed because we didn't get the reply for the ARP request. So i'm looking to the destination host of the ping request: # tcpdump -eni eth0 '(icmp or arp) and host 192.168.3.106' tcpdump: verbose output suppressed, use -v or -vv for full protocol decode listening on eth0, link-type EN10MB (Ethernet), capture size 262144 bytes 08:37:40.352416 62:e7:3c:9e:d4:45 ff:ff:ff:ff:ff:ff, ethertype 802.1Q (0x8100), length 64: vlan 3175, p 0, ethertype ARP, Request who-has 192.168.3.101 tell 192.168.3.106, length 46 08:37:40.352434 42:54:b1:1b:15:45 62:e7:3c:9e:d4:45, ethertype 802.1Q (0x8100), length 46: vlan 3175, p 0, ethertype ARP, Reply 192.168.3.101 is-at 42:54:b1:1b:15:45, length 28 08:37:41.370635 62:e7:3c:9e:d4:45 ff:ff:ff:ff:ff:ff, ethertype 802.1Q (0x8100), length 64: vlan 3175, p 0, ethertype ARP, Request who-has 192.168.3.101 tell
Bug#763428: [ovs-dev] Bug#763428: openvswitch-switch: openvswitch doesn't work anymore since kernel 3.16 update
On Wed, 8 Oct 2014 13:02:42 -0700 Ben Pfaff b...@nicira.com wrote: I can't reproduce this problem with OVS master and upstream kernel 3.16, or with OVS branch-2.3 on the commit from which the Debian packages were made. Now I'm downloading a Debian ISO so that I can try it with the exact kernel and OVS packaging against which the bug was reported. Hi, Did you manage to reproduce the bug with debian ISO? Thanks for your time, Laurent -- To UNSUBSCRIBE, email to debian-bugs-dist-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org
Bug#763428: [ovs-dev] Bug#763428: openvswitch-switch: openvswitch doesn't work anymore since kernel 3.16 update
On Mon, Oct 13, 2014 at 10:47:19AM +0200, Laurent GUERBY wrote: On Wed, 8 Oct 2014 13:02:42 -0700 Ben Pfaff b...@nicira.com wrote: I can't reproduce this problem with OVS master and upstream kernel 3.16, or with OVS branch-2.3 on the commit from which the Debian packages were made. Now I'm downloading a Debian ISO so that I can try it with the exact kernel and OVS packaging against which the bug was reported. Did you manage to reproduce the bug with debian ISO? OVS also works OK for me with linux-image-3.16-2-686-pae version 3.16.3-2 and openvswitch-switch 2.3.0+git20140819-2. The configuration I tested was very simple: remove IP address from eth0, create bridge br0 and add eth0 to the bridge, then run dhclient on br0 and verify connectivity. I then verified with ovs-dpctl show and ovs-dpctl dump-flows that traffic was passing through Open vSwitch. With a simple setup like that, does OVS work for you? -- To UNSUBSCRIBE, email to debian-bugs-dist-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org
Bug#763428: openvswitch-switch: openvswitch doesn't work anymore since kernel 3.16 update
-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 Hi, I have retrying from the beginning with a empty ovs database and the ovs module unloaded root@g3:/var/lib/openvswitch dpkg -l | grep openvswitch ii neutron-plugin-openvswitch-agent 2014.1.2-1 all OpenStack virtual network service - Open vSwitch agent ii openvswitch-common 2.3.0+git20140819-2 amd64Open vSwitch common components ii openvswitch-switch 2.3.0+git20140819-2 amd64Open vSwitch switch implementations root@g3:/var/lib/openvswitch# uname -a Linux g3 3.16-2-amd64 #1 SMP Debian 3.16.3-2 (2014-09-20) x86_64 GNU/Linux root@g3:/var/lib/openvswitch# modinfo openvswitch filename: /lib/modules/3.16-2-amd64/kernel/net/openvswitch/openvswitch.ko license:GPL description:Open vSwitch switching datapath depends:libcrc32c,vxlan,gre intree: Y vermagic: 3.16-2-amd64 SMP mod_unload modversions root@g3:/var/lib/openvswitch# /etc/init.d/openvswitch-switch start [ 382.897893] openvswitch: Open vSwitch switching datapath Inserting openvswitch module. /etc/openvswitch/conf.db does not exist ... (warning). Creating empty database /etc/openvswitch/conf.db. Starting ovsdb-server. Configuring Open vSwitch system IDs. Starting ovs-vswitchd. Enabling remote OVSDB managers. root@g3:/var/lib/openvswitch# ovs-vsctl add-br br-eth0 [ 387.549586] device ovs-system entered promiscuous mode [ 387.551218] openvswitch: netlink: Unknown key attribute (type=20, max=19). [ 387.553223] openvswitch: netlink: Unknown key attribute (type=62, max=19). [ 387.568880] device br-eth0 entered promiscuous mode I still have this errors when I create the bridge root@g3:/var/lib/openvswitch# ovs-vsctl add-port br-eth0 eth0 [ 2279.939240] device eth0 entered promiscuous mode root@g3:/var/lib/openvswitch# ip link set eth0 up root@g3:/var/lib/openvswitch# ip link set br-eth0 up # ovs-vsctl show 321f5ebc-adf4-4fe5-ab2c-5ccca143f366 Bridge br-eth0 Port eth0 Interface eth0 Port br-eth0 Interface br-eth0 type: internal ovs_version: 2.3.0 But this bridge doesn't works. I test by just setting a ip on br-eth0 and pinging an other machine on the same lan. The same manipulation with kernel (with builtin ovs module) 3.14 and ovs (userland) 2.3.0 and I have no error message and the bridge works. Tell me if you need a particular command output. - - --- Mehdi Abaakouk mail: sil...@sileht.net irc: sileht Le 2014-10-07 22:52, Ben Pfaff a écrit : On Tue, Sep 30, 2014 at 10:20:31AM +0200, Mehdi Abaakouk wrote: Package: openvswitch-switch Version: 2.3.0+git20140819-2 Severity: important Since the update of kernel in jessie to 3.16, my openvswitch setups won't work anymore, I have to keep the kernel 3.14 to have openvswitch working. That isn't a very helpful bug report, can you please give us more information? Open vSwitch should work fine with Linux 3.16, using the kernel module that accompanies the kernel. -BEGIN PGP SIGNATURE- Version: OpenPGP.js v.1.20131017 Comment: http://openpgpjs.org wsFcBAEBCAAQBQJUNTmDCRAYkrQvzqrryAAAwjEQAKldY3FY3OA+BnCmE3DO I7AtsRT6iv4i5Jcbwo4t0qYBJ/P/usldKdx2EveCbzYqVpGuF9/uJpw5/S9k b9HVUnHFldFo7IV9sjjkwPNUEJ9SsduWePpT7j3W9NxPeVxa4Mnf62qO1tks zLAtnemnh0d7Sk5ekXYNWOrzELLshTvlhoX6ISIn0cBFW8UE5G1yegPzfNFE sb33hmf05bQMOK9Rlrm6+r3VbESi86YV4Iri1kOp7qmigEuSOWajeK3sv6n+ PjOMYyel58F0QPUfLR+O45ld2/K4bG81QeQACylpyb2P4rC3Z2ySPpl3pbwf hwcSUfXuEm2NF6TTqISj6oNc+A4JoLjzFlIMRuqYgWLiQPxEmjgI9ez1L+Fb XfLIfAFm+NfyR9rdLK3xmslzKT+lfREcK5crLzXbHamWgGACF75VGuNtNx6x kj89uhs7QJHOeyflfa5Cxz9KieaWQJ+XgE+I9+cgHwa+bkBMpCmEucfbfK1T udOEqCmGWtMUtkrd/Gn1lCN5c82DEOiG7kDcXk196tF2qXyp+2TzEVXGcuXJ 3+PbiqZQ3hdoqrG1NC/MAGyMDr6USNAH77QcPXLqg4RIh4W+jMupmlvuRiAm K4z3fTP3Hb9MUHU7IYBCVfkGN/6IjmRlDXPY7Mw4l4uJ/ODjZVaDYmu0sYJE Wytt =1i7r -END PGP SIGNATURE- -- To UNSUBSCRIBE, email to debian-bugs-dist-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org
Bug#763428: openvswitch-switch: openvswitch doesn't work anymore since kernel 3.16 update
On Wed, Oct 08, 2014 at 03:17:56PM +0200, Mehdi Abaakouk wrote: root@g3:/var/lib/openvswitch# /etc/init.d/openvswitch-switch start [ 382.897893] openvswitch: Open vSwitch switching datapath Inserting openvswitch module. /etc/openvswitch/conf.db does not exist ... (warning). Creating empty database /etc/openvswitch/conf.db. Starting ovsdb-server. Configuring Open vSwitch system IDs. Starting ovs-vswitchd. Enabling remote OVSDB managers. root@g3:/var/lib/openvswitch# ovs-vsctl add-br br-eth0 [ 387.549586] device ovs-system entered promiscuous mode [ 387.551218] openvswitch: netlink: Unknown key attribute (type=20, max=19). [ 387.553223] openvswitch: netlink: Unknown key attribute (type=62, max=19). [ 387.568880] device br-eth0 entered promiscuous mode I still have this errors when I create the bridge root@g3:/var/lib/openvswitch# ovs-vsctl add-port br-eth0 eth0 [ 2279.939240] device eth0 entered promiscuous mode None of the above messages indicates an error. root@g3:/var/lib/openvswitch# ip link set eth0 up root@g3:/var/lib/openvswitch# ip link set br-eth0 up # ovs-vsctl show 321f5ebc-adf4-4fe5-ab2c-5ccca143f366 Bridge br-eth0 Port eth0 Interface eth0 Port br-eth0 Interface br-eth0 type: internal ovs_version: 2.3.0 But this bridge doesn't works. I test by just setting a ip on br-eth0 and pinging an other machine on the same lan. OK, that is an indication that something is wrong. With the ping ongoing in the background, run ovs-dpctl dump-flows and show us the output. Thanks, Ben. -- To UNSUBSCRIBE, email to debian-bugs-dist-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org
Bug#763428: [ovs-dev] Bug#763428: openvswitch-switch: openvswitch doesn't work anymore since kernel 3.16 update
When I was testing this with 3.17 I had seen similar errors. It was because the kernel module loaded was the one that came with 3.17 kernel and not the one I compiled with the latest ovs. I remember they get installed in different locations. Could you pl check your /lib/modules directory and make sure the right module is getting loaded. I am upgrading my setup to the latest linux-next and should be able to try this out today. Thanks. On Wed, Oct 8, 2014 at 8:09 AM, Ben Pfaff b...@nicira.com wrote: On Wed, Oct 08, 2014 at 03:17:56PM +0200, Mehdi Abaakouk wrote: root@g3:/var/lib/openvswitch# /etc/init.d/openvswitch-switch start [ 382.897893] openvswitch: Open vSwitch switching datapath Inserting openvswitch module. /etc/openvswitch/conf.db does not exist ... (warning). Creating empty database /etc/openvswitch/conf.db. Starting ovsdb-server. Configuring Open vSwitch system IDs. Starting ovs-vswitchd. Enabling remote OVSDB managers. root@g3:/var/lib/openvswitch# ovs-vsctl add-br br-eth0 [ 387.549586] device ovs-system entered promiscuous mode [ 387.551218] openvswitch: netlink: Unknown key attribute (type=20, max=19). [ 387.553223] openvswitch: netlink: Unknown key attribute (type=62, max=19). [ 387.568880] device br-eth0 entered promiscuous mode I still have this errors when I create the bridge root@g3:/var/lib/openvswitch# ovs-vsctl add-port br-eth0 eth0 [ 2279.939240] device eth0 entered promiscuous mode None of the above messages indicates an error. root@g3:/var/lib/openvswitch# ip link set eth0 up root@g3:/var/lib/openvswitch# ip link set br-eth0 up # ovs-vsctl show 321f5ebc-adf4-4fe5-ab2c-5ccca143f366 Bridge br-eth0 Port eth0 Interface eth0 Port br-eth0 Interface br-eth0 type: internal ovs_version: 2.3.0 But this bridge doesn't works. I test by just setting a ip on br-eth0 and pinging an other machine on the same lan. OK, that is an indication that something is wrong. With the ping ongoing in the background, run ovs-dpctl dump-flows and show us the output. Thanks, Ben. ___ dev mailing list d...@openvswitch.org http://openvswitch.org/mailman/listinfo/dev
Bug#763428: [ovs-dev] Bug#763428: openvswitch-switch: openvswitch doesn't work anymore since kernel 3.16 update
On Wed, Oct 08, 2014 at 08:20:25AM -0700, Madhu Challa wrote: When I was testing this with 3.17 I had seen similar errors. It was because the kernel module loaded was the one that came with 3.17 kernel and not the one I compiled with the latest ovs. I remember they get installed in different locations. Could you pl check your /lib/modules directory and make sure the right module is getting loaded. OVS should work with any version of the kernel module. If it doesn't, that's a serious bug (and please report it if you see evidence of it happening). I'll take a look at this myself later today. -- To UNSUBSCRIBE, email to debian-bugs-dist-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org
Bug#763428: [ovs-dev] Bug#763428: Bug#763428: openvswitch-switch: openvswitch doesn't work anymore since kernel 3.16 update
I tried the latest ovs with linux-next openvswitch.ko and the one from latest ovs. I see no errors in when I use the driver from latest ovs. When I use the in kernel driver I see this error : [ 2497.408140] openvswitch: netlink: Key attribute has unexpected length (type=21, length=4, expected=0). when adding the bridge. And this is because in the latest ovs attr 21 is OVS_KEY_ATTR_MPLS whereas with the openvswitch.ko coming from linux-next attr 21 is OVS_KEY_ATTR_TUNNEL_INFO. Note that in the latest ovs attr OVS_KEY_ATTR_TUNNEL_INFO is changed to 22. Thanks. On Wed, Oct 8, 2014 at 8:36 AM, Ben Pfaff b...@nicira.com wrote: On Wed, Oct 08, 2014 at 08:20:25AM -0700, Madhu Challa wrote: When I was testing this with 3.17 I had seen similar errors. It was because the kernel module loaded was the one that came with 3.17 kernel and not the one I compiled with the latest ovs. I remember they get installed in different locations. Could you pl check your /lib/modules directory and make sure the right module is getting loaded. OVS should work with any version of the kernel module. If it doesn't, that's a serious bug (and please report it if you see evidence of it happening). I'll take a look at this myself later today. ___ dev mailing list d...@openvswitch.org http://openvswitch.org/mailman/listinfo/dev
Bug#763428: [ovs-dev] Bug#763428: Bug#763428: openvswitch-switch: openvswitch doesn't work anymore since kernel 3.16 update
On Wed, Oct 08, 2014 at 11:51:25AM -0700, Madhu Challa wrote: I tried the latest ovs with linux-next openvswitch.ko and the one from latest ovs. I see no errors in when I use the driver from latest ovs. When I use the in kernel driver I see this error : [ 2497.408140] openvswitch: netlink: Key attribute has unexpected length (type=21, length=4, expected=0). when adding the bridge. And this is because in the latest ovs attr 21 is OVS_KEY_ATTR_MPLS This is an expected message. It does not indicate a problem. It is suppressed on recent master via a special attribute. whereas with the openvswitch.ko coming from linux-next attr 21 is OVS_KEY_ATTR_TUNNEL_INFO. Note that in the latest ovs attr OVS_KEY_ATTR_TUNNEL_INFO is changed to 22. OVS_KEY_ATTR_TUNNEL_INFO is only used within the kernel module. It's not exported to userspace. -- To UNSUBSCRIBE, email to debian-bugs-dist-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org
Bug#763428: [ovs-dev] Bug#763428: openvswitch-switch: openvswitch doesn't work anymore since kernel 3.16 update
I can't reproduce this problem with OVS master and upstream kernel 3.16, or with OVS branch-2.3 on the commit from which the Debian packages were made. Now I'm downloading a Debian ISO so that I can try it with the exact kernel and OVS packaging against which the bug was reported. -- To UNSUBSCRIBE, email to debian-bugs-dist-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org
Bug#763428: openvswitch-switch: openvswitch doesn't work anymore since kernel 3.16 update
On Tue, Sep 30, 2014 at 10:20:31AM +0200, Mehdi Abaakouk wrote: Package: openvswitch-switch Version: 2.3.0+git20140819-2 Severity: important Since the update of kernel in jessie to 3.16, my openvswitch setups won't work anymore, I have to keep the kernel 3.14 to have openvswitch working. That isn't a very helpful bug report, can you please give us more information? Open vSwitch should work fine with Linux 3.16, using the kernel module that accompanies the kernel. -- To UNSUBSCRIBE, email to debian-bugs-dist-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org
Bug#763428: openvswitch-switch: openvswitch doesn't work anymore since kernel 3.16 update
Package: openvswitch-switch Version: 2.3.0+git20140819-2 Severity: important Dear Maintainer, Since the update of kernel in jessie to 3.16, my openvswitch setups won't work anymore, I have to keep the kernel 3.14 to have openvswitch working. I guess the 3.16 kernel is offically supported only since this ovs commit: https://github.com/openvswitch/ovs/commit/f6a0c895fcece5bdf538f3f0afc13275c062b4d6 I will rebuild a package with the master branch of ovs (commit a2b59fd5bd197bb73bd1d86efa74f171b59ab06d) to ensures that and post a update on this bugs to keep you informed. Regards, -- System Information: Debian Release: jessie/sid APT prefers testing-proposed-updates APT policy: (500, 'testing-proposed-updates'), (500, 'testing'), (20, 'unstable') Architecture: amd64 (x86_64) Kernel: Linux 3.14-2-amd64 (SMP w/4 CPU cores) Locale: LANG=en_US.UTF-8, LC_CTYPE=en_US.UTF-8 (charmap=UTF-8) Shell: /bin/sh linked to /bin/dash -- To UNSUBSCRIBE, email to debian-bugs-dist-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org
