Thanks Justin, Will upgrade kernel.
On Thu, Apr 6, 2017 at 1:30 AM, Justin Pettit <[email protected]> wrote: > I know very little about the MPLS integration, but I have one thing that > might be worth checking. Are you using the OVS kernel module that came > with OVS 2.6.1 or the one that comes with Linux 4.2? Linux 4.2 came out a > year before OVS 2.6, and 2.6 introduced MPLS TTL. It looks like the kernel > datapath is rejecting the attempt to add that flow, so I'd make sure that > you're using the kernel datapath that came with the OVS release. > > --Justin > > > > On Apr 5, 2017, at 2:29 AM, f 62 <[email protected]> wrote: > > > > This is the log of ovs-vswitchd: > > > > 2017-04-05T05:45:45.944Z|00205|dpif(handler14)|WARN|system@ovs-system: > failed to put[create] (Invalid argument) > ufid:d62cd3db-17dd-488f-99bc-9da8b7e59c24 > recirc_id(0),dp_hash(0/0),skb_priority(0/0),in_port(10),skb_ > mark(0/0),ct_state(0/0),ct_zone(0/0),ct_mark(0/0),ct_ > label(0/0),eth(src=fa:16:3e:7f:19:13,dst=fa:16:3e:78:13: > cd),eth_type(0x0800),ipv4(src=51.0.0.4,dst=51.0.0.13,proto= > 6,tos=0/0xfc,ttl=64,frag=no),tcp(src=48250,dst=80),tcp_flags(0/0), > actions:set(eth(src=fa:16:3e:7f:19:13,dst=fa:16:3e:48:cd: > 9e)),set(tunnel(tun_id=0x49,src=192.168.2.91,dst=192.168. > 2.177,ttl=64,flags(df|key))),push_mpls(label=511,tc=0,ttl= > 255,bos=1,eth_type=0x8847),9,set(eth(src=fa:16:3e:7f:19:13, > dst=fa:16:3e:78:13:cd)),pop_mpls(eth_type=0x800),push_ > mpls(label=510,tc=0,ttl=254,bos=1,eth_type=0x8847),9 > > 2017-04-05T05:45:45.944Z|00206|dpif(handler14)|WARN|system@ovs-system: > execute set(eth(src=fa:16:3e:7f:19:13,dst=fa:16:3e:48:cd:9e)),set( > tunnel(tun_id=0x49,src=192.168.2.91,dst=192.168.2.177, > ttl=64,flags(df|key))),push_mpls(label=511,tc=0,ttl=255, > bos=1,eth_type=0x8847),9,set(eth(src=fa:16:3e:7f:19:13,dst= > fa:16:3e:78:13:cd)),pop_mpls(eth_type=0x800),push_mpls( > label=510,tc=0,ttl=254,bos=1,eth_type=0x8847),9 failed (Invalid argument) > on packet tcp,vlan_tci=0x0000,dl_src=fa:16:3e:7f:19:13,dl_dst=fa:16: > 3e:78:13:cd,nw_src=51.0.0.4,nw_dst=51.0.0.13,nw_tos=0,nw_ > ecn=0,nw_ttl=64,tp_src=48250,tp_dst=80,tcp_flags=syn tcp_csum:91ac > > mtu 0 > > 2017-04-05T05:45:53.952Z|00207|dpif(handler14)|WARN|system@ovs-system: > failed to put[create] (Invalid argument) > ufid:d62cd3db-17dd-488f-99bc-9da8b7e59c24 > recirc_id(0),dp_hash(0/0),skb_priority(0/0),in_port(10),skb_ > mark(0/0),ct_state(0/0),ct_zone(0/0),ct_mark(0/0),ct_ > label(0/0),eth(src=fa:16:3e:7f:19:13,dst=fa:16:3e:78:13: > cd),eth_type(0x0800),ipv4(src=51.0.0.4,dst=51.0.0.13,proto= > 6,tos=0/0xfc,ttl=64,frag=no),tcp(src=48250,dst=80),tcp_flags(0/0), > actions:set(eth(src=fa:16:3e:7f:19:13,dst=fa:16:3e:48:cd: > 9e)),set(tunnel(tun_id=0x49,src=192.168.2.91,dst=192.168. > 2.177,ttl=64,flags(df|key))),push_mpls(label=511,tc=0,ttl= > 255,bos=1,eth_type=0x8847),9,set(eth(src=fa:16:3e:7f:19:13, > dst=fa:16:3e:78:13:cd)),pop_mpls(eth_type=0x800),push_ > mpls(label=510,tc=0,ttl=254,bos=1,eth_type=0x8847),9 > > 2017-04-05T05:45:53.952Z|00208|dpif(handler14)|WARN|system@ovs-system: > execute set(eth(src=fa:16:3e:7f:19:13,dst=fa:16:3e:48:cd:9e)),set( > tunnel(tun_id=0x49,src=192.168.2.91,dst=192.168.2.177, > ttl=64,flags(df|key))),push_mpls(label=511,tc=0,ttl=255, > bos=1,eth_type=0x8847),9,set(eth(src=fa:16:3e:7f:19:13,dst= > fa:16:3e:78:13:cd)),pop_mpls(eth_type=0x800),push_mpls( > label=510,tc=0,ttl=254,bos=1,eth_type=0x8847),9 failed (Invalid argument) > on packet tcp,vlan_tci=0x0000,dl_src=fa:16:3e:7f:19:13,dl_dst=fa:16: > 3e:78:13:cd,nw_src=51.0.0.4,nw_dst=51.0.0.13,nw_tos=0,nw_ > ecn=0,nw_ttl=64,tp_src=48250,tp_dst=80,tcp_flags=syn tcp_csum:89da > > mtu 0 > > 2017-04-05T05:46:09.984Z|00209|dpif(handler14)|WARN|system@ovs-system: > failed to put[create] (Invalid argument) > ufid:d62cd3db-17dd-488f-99bc-9da8b7e59c24 > recirc_id(0),dp_hash(0/0),skb_priority(0/0),in_port(10),skb_ > mark(0/0),ct_state(0/0),ct_zone(0/0),ct_mark(0/0),ct_ > label(0/0),eth(src=fa:16:3e:7f:19:13,dst=fa:16:3e:78:13: > cd),eth_type(0x0800),ipv4(src=51.0.0.4,dst=51.0.0.13,proto= > 6,tos=0/0xfc,ttl=64,frag=no),tcp(src=48250,dst=80),tcp_flags(0/0), > actions:set(eth(src=fa:16:3e:7f:19:13,dst=fa:16:3e:48:cd: > 9e)),set(tunnel(tun_id=0x49,src=192.168.2.91,dst=192.168. > 2.177,ttl=64,flags(df|key))),push_mpls(label=511,tc=0,ttl= > 255,bos=1,eth_type=0x8847),9,set(eth(src=fa:16:3e:7f:19:13, > dst=fa:16:3e:78:13:cd)),pop_mpls(eth_type=0x800),push_ > mpls(label=510,tc=0,ttl=254,bos=1,eth_type=0x8847),9 > > 2017-04-05T05:46:09.984Z|00210|dpif(handler14)|WARN|system@ovs-system: > execute set(eth(src=fa:16:3e:7f:19:13,dst=fa:16:3e:48:cd:9e)),set( > tunnel(tun_id=0x49,src=192.168.2.91,dst=192.168.2.177, > ttl=64,flags(df|key))),push_mpls(label=511,tc=0,ttl=255, > bos=1,eth_type=0x8847),9,set(eth(src=fa:16:3e:7f:19:13,dst= > fa:16:3e:78:13:cd)),pop_mpls(eth_type=0x800),push_mpls( > label=510,tc=0,ttl=254,bos=1,eth_type=0x8847),9 failed (Invalid argument) > on packet tcp,vlan_tci=0x0000,dl_src=fa:16:3e:7f:19:13,dl_dst=fa:16: > 3e:78:13:cd,nw_src=51.0.0.4,nw_dst=51.0.0.13,nw_tos=0,nw_ > ecn=0,nw_ttl=64,tp_src=48250,tp_dst=80,tcp_flags=syn tcp_csum:7a32 > > mtu 0 > > > > > > > > On Wed, Apr 5, 2017 at 10:28 AM, f 62 <[email protected]> wrote: > > I have configured ovs flows like this on ovs bridge: > > > > 1. cookie=0x0, duration=2261.104s, table=0, n_packets=23, n_bytes=1702, > idle_age=1877, tcp,in_port=8,nw_src=51.0.0.4 actions=group:1,resubmit(8,7) > > > > 2. group_id=1,type=select,bucket=actions=set_field:fa:16:3e:48: > cd:9e->eth_dst,resubmit(,5) > > > > 3. cookie=0xb2c6f4127f2f27cc, duration=24849.587s, table=5, > n_packets=303, n_bytes=22830, idle_age=1940, > priority=0,ip,dl_dst=fa:16:3e:48:cd:9e > actions=push_mpls:0x8847,load:0x1ff->OXM_OF_MPLS_LABEL[], > set_mpls_ttl(255),mod_vlan_vid:3,output:2 > > > > 4. cookie=0x0, duration=17142.766s, table=7, n_packets=36, n_bytes=2664, > idle_age=1996, priority=2,ip,dl_dst=fa:16:3e:78:13:cd > actions=push_mpls:0x8847,load:0x1fe->OXM_OF_MPLS_LABEL[], > set_mpls_ttl(254),mod_vlan_vid:3,output:2 > > > > ovs port:2 is patch port to tunnel bridge (another ovs bridge) > > > > On tunnel bridge, this is the flow: > > > > 5. cookie=0x0, duration=2465.760s, table=22, n_packets=36, n_bytes=2664, > idle_age=267, priority=1,dl_vlan=3 actions=strip_vlan,load:0x49-> > NXM_NX_TUN_ID[],output:2 > > > > If in (3) and (4) I do not set MPLS fields, traffic works as expected. > > > > Other relevant info: > > cat /proc/version > > Linux version 4.2.0-42-generic (buildd@lgw01-55) (gcc version 4.8.4 > (Ubuntu 4.8.4-2ubuntu1~14.04.3) ) #49~14.04.1-Ubuntu SMP Wed Jun 29 > 20:22:11 UTC 2016 > > > > ovs-vswitchd --version > > ovs-vswitchd (Open vSwitch) 2.6.1 > > > > sudo ovs-dpctl show > > system@ovs-system: > > lookups: hit:605248 missed:239296 lost:1270 > > flows: 0 > > masks: hit:1966804 total:1 hit/pkt:2.33 > > port 0: ovs-system (internal) > > port 1: br-int (internal) > > port 2: br-ex (internal) > > port 3: br-tun (internal) > > port 4: tape79dba01-eb (internal) > > port 5: qr-fc1d6bca-50 (internal) > > port 6: qg-27b44ec1-74 (internal) > > port 7: qr-1dd26eee-a7 (internal) > > port 8: tap29132628-3d (internal) > > port 9: vxlan_sys_4789 (vxlan) > > port 10: tap605a9cd5-98 > > port 11: tapb80b5a72-d7 > > port 12: qr-815256d5-48 (internal) > > port 13: tap96f28437-46 (internal) > > port 14: tap2ad1704d-cd > > port 15: qr-fdfee796-74 (internal) > > port 16: tapea2cd065-96 > > port 17: tapd75ec3fa-97 > > port 18: tapa8e07edf-0e > > > > sudo ovs-vsctl show > > 52d8f41f-ba03-4006-b666-6d36c79f32d2 > > Manager "ptcp:6640:127.0.0.1" > > is_connected: true > > Bridge br-ex > > Controller "tcp:127.0.0.1:6633" > > is_connected: true > > fail_mode: secure > > Port br-ex > > Interface br-ex > > type: internal > > Port phy-br-ex > > Interface phy-br-ex > > type: patch > > options: {peer=int-br-ex} > > Bridge br-int > > Controller "tcp:127.0.0.1:6633" > > is_connected: true > > fail_mode: secure > > Port "tap96f28437-46" > > tag: 4 > > Interface "tap96f28437-46" > > type: internal > > Port patch-tun > > Interface patch-tun > > type: patch > > options: {peer=patch-int} > > Port "tap29132628-3d" > > tag: 3 > > Interface "tap29132628-3d" > > type: internal > > Port "qr-fc1d6bca-50" > > tag: 1 > > Interface "qr-fc1d6bca-50" > > type: internal > > Port "qr-815256d5-48" > > tag: 3 > > Interface "qr-815256d5-48" > > type: internal > > Port "qg-27b44ec1-74" > > tag: 2 > > Interface "qg-27b44ec1-74" > > type: internal > > Port int-br-ex > > Interface int-br-ex > > type: patch > > options: {peer=phy-br-ex} > > Port "tapea2cd065-96" > > tag: 3 > > Interface "tapea2cd065-96" > > Port "tap605a9cd5-98" > > tag: 3 > > Interface "tap605a9cd5-98" > > Port "tap2ad1704d-cd" > > tag: 4 > > Interface "tap2ad1704d-cd" > > Port br-int > > Interface br-int > > type: internal > > Port "tapa8e07edf-0e" > > tag: 3 > > Interface "tapa8e07edf-0e" > > Port "tape79dba01-eb" > > tag: 1 > > Interface "tape79dba01-eb" > > type: internal > > Port "qr-1dd26eee-a7" > > tag: 1 > > Interface "qr-1dd26eee-a7" > > type: internal > > Port "qr-fdfee796-74" > > tag: 4 > > Interface "qr-fdfee796-74" > > type: internal > > Port "tapb80b5a72-d7" > > tag: 3 > > Interface "tapb80b5a72-d7" > > Port "tapd75ec3fa-97" > > tag: 3 > > Interface "tapd75ec3fa-97" > > Bridge br-tun > > Controller "tcp:127.0.0.1:6633" > > is_connected: true > > fail_mode: secure > > Port patch-int > > Interface patch-int > > type: patch > > options: {peer=patch-tun} > > Port br-tun > > Interface br-tun > > type: internal > > Port "vxlan-c0a802b1" > > Interface "vxlan-c0a802b1" > > type: vxlan > > options: {df_default="true", in_key=flow, > local_ip="192.168.2.91", out_key=flow, remote_ip="192.168.2.177"} > > ovs_version: "2.6.1" > > > > > > _______________________________________________ > > discuss mailing list > > [email protected] > > https://mail.openvswitch.org/mailman/listinfo/ovs-discuss > >
_______________________________________________ discuss mailing list [email protected] https://mail.openvswitch.org/mailman/listinfo/ovs-discuss
