I know very little about the MPLS integration, but I have one thing that might be worth checking. Are you using the OVS kernel module that came with OVS 2.6.1 or the one that comes with Linux 4.2? Linux 4.2 came out a year before OVS 2.6, and 2.6 introduced MPLS TTL. It looks like the kernel datapath is rejecting the attempt to add that flow, so I'd make sure that you're using the kernel datapath that came with the OVS release.
--Justin > On Apr 5, 2017, at 2:29 AM, f 62 <[email protected]> wrote: > > This is the log of ovs-vswitchd: > > 2017-04-05T05:45:45.944Z|00205|dpif(handler14)|WARN|system@ovs-system: failed > to put[create] (Invalid argument) ufid:d62cd3db-17dd-488f-99bc-9da8b7e59c24 > recirc_id(0),dp_hash(0/0),skb_priority(0/0),in_port(10),skb_mark(0/0),ct_state(0/0),ct_zone(0/0),ct_mark(0/0),ct_label(0/0),eth(src=fa:16:3e:7f:19:13,dst=fa:16:3e:78:13:cd),eth_type(0x0800),ipv4(src=51.0.0.4,dst=51.0.0.13,proto=6,tos=0/0xfc,ttl=64,frag=no),tcp(src=48250,dst=80),tcp_flags(0/0), > > actions:set(eth(src=fa:16:3e:7f:19:13,dst=fa:16:3e:48:cd:9e)),set(tunnel(tun_id=0x49,src=192.168.2.91,dst=192.168.2.177,ttl=64,flags(df|key))),push_mpls(label=511,tc=0,ttl=255,bos=1,eth_type=0x8847),9,set(eth(src=fa:16:3e:7f:19:13,dst=fa:16:3e:78:13:cd)),pop_mpls(eth_type=0x800),push_mpls(label=510,tc=0,ttl=254,bos=1,eth_type=0x8847),9 > 2017-04-05T05:45:45.944Z|00206|dpif(handler14)|WARN|system@ovs-system: > execute > set(eth(src=fa:16:3e:7f:19:13,dst=fa:16:3e:48:cd:9e)),set(tunnel(tun_id=0x49,src=192.168.2.91,dst=192.168.2.177,ttl=64,flags(df|key))),push_mpls(label=511,tc=0,ttl=255,bos=1,eth_type=0x8847),9,set(eth(src=fa:16:3e:7f:19:13,dst=fa:16:3e:78:13:cd)),pop_mpls(eth_type=0x800),push_mpls(label=510,tc=0,ttl=254,bos=1,eth_type=0x8847),9 > failed (Invalid argument) on packet > tcp,vlan_tci=0x0000,dl_src=fa:16:3e:7f:19:13,dl_dst=fa:16:3e:78:13:cd,nw_src=51.0.0.4,nw_dst=51.0.0.13,nw_tos=0,nw_ecn=0,nw_ttl=64,tp_src=48250,tp_dst=80,tcp_flags=syn > tcp_csum:91ac > mtu 0 > 2017-04-05T05:45:53.952Z|00207|dpif(handler14)|WARN|system@ovs-system: failed > to put[create] (Invalid argument) ufid:d62cd3db-17dd-488f-99bc-9da8b7e59c24 > recirc_id(0),dp_hash(0/0),skb_priority(0/0),in_port(10),skb_mark(0/0),ct_state(0/0),ct_zone(0/0),ct_mark(0/0),ct_label(0/0),eth(src=fa:16:3e:7f:19:13,dst=fa:16:3e:78:13:cd),eth_type(0x0800),ipv4(src=51.0.0.4,dst=51.0.0.13,proto=6,tos=0/0xfc,ttl=64,frag=no),tcp(src=48250,dst=80),tcp_flags(0/0), > > actions:set(eth(src=fa:16:3e:7f:19:13,dst=fa:16:3e:48:cd:9e)),set(tunnel(tun_id=0x49,src=192.168.2.91,dst=192.168.2.177,ttl=64,flags(df|key))),push_mpls(label=511,tc=0,ttl=255,bos=1,eth_type=0x8847),9,set(eth(src=fa:16:3e:7f:19:13,dst=fa:16:3e:78:13:cd)),pop_mpls(eth_type=0x800),push_mpls(label=510,tc=0,ttl=254,bos=1,eth_type=0x8847),9 > 2017-04-05T05:45:53.952Z|00208|dpif(handler14)|WARN|system@ovs-system: > execute > set(eth(src=fa:16:3e:7f:19:13,dst=fa:16:3e:48:cd:9e)),set(tunnel(tun_id=0x49,src=192.168.2.91,dst=192.168.2.177,ttl=64,flags(df|key))),push_mpls(label=511,tc=0,ttl=255,bos=1,eth_type=0x8847),9,set(eth(src=fa:16:3e:7f:19:13,dst=fa:16:3e:78:13:cd)),pop_mpls(eth_type=0x800),push_mpls(label=510,tc=0,ttl=254,bos=1,eth_type=0x8847),9 > failed (Invalid argument) on packet > tcp,vlan_tci=0x0000,dl_src=fa:16:3e:7f:19:13,dl_dst=fa:16:3e:78:13:cd,nw_src=51.0.0.4,nw_dst=51.0.0.13,nw_tos=0,nw_ecn=0,nw_ttl=64,tp_src=48250,tp_dst=80,tcp_flags=syn > tcp_csum:89da > mtu 0 > 2017-04-05T05:46:09.984Z|00209|dpif(handler14)|WARN|system@ovs-system: failed > to put[create] (Invalid argument) ufid:d62cd3db-17dd-488f-99bc-9da8b7e59c24 > recirc_id(0),dp_hash(0/0),skb_priority(0/0),in_port(10),skb_mark(0/0),ct_state(0/0),ct_zone(0/0),ct_mark(0/0),ct_label(0/0),eth(src=fa:16:3e:7f:19:13,dst=fa:16:3e:78:13:cd),eth_type(0x0800),ipv4(src=51.0.0.4,dst=51.0.0.13,proto=6,tos=0/0xfc,ttl=64,frag=no),tcp(src=48250,dst=80),tcp_flags(0/0), > > actions:set(eth(src=fa:16:3e:7f:19:13,dst=fa:16:3e:48:cd:9e)),set(tunnel(tun_id=0x49,src=192.168.2.91,dst=192.168.2.177,ttl=64,flags(df|key))),push_mpls(label=511,tc=0,ttl=255,bos=1,eth_type=0x8847),9,set(eth(src=fa:16:3e:7f:19:13,dst=fa:16:3e:78:13:cd)),pop_mpls(eth_type=0x800),push_mpls(label=510,tc=0,ttl=254,bos=1,eth_type=0x8847),9 > 2017-04-05T05:46:09.984Z|00210|dpif(handler14)|WARN|system@ovs-system: > execute > set(eth(src=fa:16:3e:7f:19:13,dst=fa:16:3e:48:cd:9e)),set(tunnel(tun_id=0x49,src=192.168.2.91,dst=192.168.2.177,ttl=64,flags(df|key))),push_mpls(label=511,tc=0,ttl=255,bos=1,eth_type=0x8847),9,set(eth(src=fa:16:3e:7f:19:13,dst=fa:16:3e:78:13:cd)),pop_mpls(eth_type=0x800),push_mpls(label=510,tc=0,ttl=254,bos=1,eth_type=0x8847),9 > failed (Invalid argument) on packet > tcp,vlan_tci=0x0000,dl_src=fa:16:3e:7f:19:13,dl_dst=fa:16:3e:78:13:cd,nw_src=51.0.0.4,nw_dst=51.0.0.13,nw_tos=0,nw_ecn=0,nw_ttl=64,tp_src=48250,tp_dst=80,tcp_flags=syn > tcp_csum:7a32 > mtu 0 > > > > On Wed, Apr 5, 2017 at 10:28 AM, f 62 <[email protected]> wrote: > I have configured ovs flows like this on ovs bridge: > > 1. cookie=0x0, duration=2261.104s, table=0, n_packets=23, n_bytes=1702, > idle_age=1877, tcp,in_port=8,nw_src=51.0.0.4 actions=group:1,resubmit(8,7) > > 2. > group_id=1,type=select,bucket=actions=set_field:fa:16:3e:48:cd:9e->eth_dst,resubmit(,5) > > 3. cookie=0xb2c6f4127f2f27cc, duration=24849.587s, table=5, n_packets=303, > n_bytes=22830, idle_age=1940, priority=0,ip,dl_dst=fa:16:3e:48:cd:9e > actions=push_mpls:0x8847,load:0x1ff->OXM_OF_MPLS_LABEL[],set_mpls_ttl(255),mod_vlan_vid:3,output:2 > > 4. cookie=0x0, duration=17142.766s, table=7, n_packets=36, n_bytes=2664, > idle_age=1996, priority=2,ip,dl_dst=fa:16:3e:78:13:cd > actions=push_mpls:0x8847,load:0x1fe->OXM_OF_MPLS_LABEL[],set_mpls_ttl(254),mod_vlan_vid:3,output:2 > > ovs port:2 is patch port to tunnel bridge (another ovs bridge) > > On tunnel bridge, this is the flow: > > 5. cookie=0x0, duration=2465.760s, table=22, n_packets=36, n_bytes=2664, > idle_age=267, priority=1,dl_vlan=3 > actions=strip_vlan,load:0x49->NXM_NX_TUN_ID[],output:2 > > If in (3) and (4) I do not set MPLS fields, traffic works as expected. > > Other relevant info: > cat /proc/version > Linux version 4.2.0-42-generic (buildd@lgw01-55) (gcc version 4.8.4 (Ubuntu > 4.8.4-2ubuntu1~14.04.3) ) #49~14.04.1-Ubuntu SMP Wed Jun 29 20:22:11 UTC 2016 > > ovs-vswitchd --version > ovs-vswitchd (Open vSwitch) 2.6.1 > > sudo ovs-dpctl show > system@ovs-system: > lookups: hit:605248 missed:239296 lost:1270 > flows: 0 > masks: hit:1966804 total:1 hit/pkt:2.33 > port 0: ovs-system (internal) > port 1: br-int (internal) > port 2: br-ex (internal) > port 3: br-tun (internal) > port 4: tape79dba01-eb (internal) > port 5: qr-fc1d6bca-50 (internal) > port 6: qg-27b44ec1-74 (internal) > port 7: qr-1dd26eee-a7 (internal) > port 8: tap29132628-3d (internal) > port 9: vxlan_sys_4789 (vxlan) > port 10: tap605a9cd5-98 > port 11: tapb80b5a72-d7 > port 12: qr-815256d5-48 (internal) > port 13: tap96f28437-46 (internal) > port 14: tap2ad1704d-cd > port 15: qr-fdfee796-74 (internal) > port 16: tapea2cd065-96 > port 17: tapd75ec3fa-97 > port 18: tapa8e07edf-0e > > sudo ovs-vsctl show > 52d8f41f-ba03-4006-b666-6d36c79f32d2 > Manager "ptcp:6640:127.0.0.1" > is_connected: true > Bridge br-ex > Controller "tcp:127.0.0.1:6633" > is_connected: true > fail_mode: secure > Port br-ex > Interface br-ex > type: internal > Port phy-br-ex > Interface phy-br-ex > type: patch > options: {peer=int-br-ex} > Bridge br-int > Controller "tcp:127.0.0.1:6633" > is_connected: true > fail_mode: secure > Port "tap96f28437-46" > tag: 4 > Interface "tap96f28437-46" > type: internal > Port patch-tun > Interface patch-tun > type: patch > options: {peer=patch-int} > Port "tap29132628-3d" > tag: 3 > Interface "tap29132628-3d" > type: internal > Port "qr-fc1d6bca-50" > tag: 1 > Interface "qr-fc1d6bca-50" > type: internal > Port "qr-815256d5-48" > tag: 3 > Interface "qr-815256d5-48" > type: internal > Port "qg-27b44ec1-74" > tag: 2 > Interface "qg-27b44ec1-74" > type: internal > Port int-br-ex > Interface int-br-ex > type: patch > options: {peer=phy-br-ex} > Port "tapea2cd065-96" > tag: 3 > Interface "tapea2cd065-96" > Port "tap605a9cd5-98" > tag: 3 > Interface "tap605a9cd5-98" > Port "tap2ad1704d-cd" > tag: 4 > Interface "tap2ad1704d-cd" > Port br-int > Interface br-int > type: internal > Port "tapa8e07edf-0e" > tag: 3 > Interface "tapa8e07edf-0e" > Port "tape79dba01-eb" > tag: 1 > Interface "tape79dba01-eb" > type: internal > Port "qr-1dd26eee-a7" > tag: 1 > Interface "qr-1dd26eee-a7" > type: internal > Port "qr-fdfee796-74" > tag: 4 > Interface "qr-fdfee796-74" > type: internal > Port "tapb80b5a72-d7" > tag: 3 > Interface "tapb80b5a72-d7" > Port "tapd75ec3fa-97" > tag: 3 > Interface "tapd75ec3fa-97" > Bridge br-tun > Controller "tcp:127.0.0.1:6633" > is_connected: true > fail_mode: secure > Port patch-int > Interface patch-int > type: patch > options: {peer=patch-tun} > Port br-tun > Interface br-tun > type: internal > Port "vxlan-c0a802b1" > Interface "vxlan-c0a802b1" > type: vxlan > options: {df_default="true", in_key=flow, > local_ip="192.168.2.91", out_key=flow, remote_ip="192.168.2.177"} > ovs_version: "2.6.1" > > > _______________________________________________ > discuss mailing list > [email protected] > https://mail.openvswitch.org/mailman/listinfo/ovs-discuss _______________________________________________ discuss mailing list [email protected] https://mail.openvswitch.org/mailman/listinfo/ovs-discuss
