Hi James got another crash today with the optimisation disabled package:
here the backtrace (at the end is the one with the debug symbols) Cheers marco root@nuv-vir-kvm-server-2 ~ # ll /var/crash total 696K drwxrwxrwt 2 root root 4.0K Apr 7 11:20 ./ drwxr-xr-x 13 root root 4.0K Mar 19 16:21 ../ -rw-r--r-- 1 root root 272 Apr 7 10:32 kexec_cmd -rw-rw---- 1 root root 0 Apr 7 11:20 .lock -rw-r----- 1 root root 682K Apr 7 11:20 _usr_sbin_ovs-vswitchd.0.crash root@nuv-vir-kvm-server-2 ~ # gdb GNU gdb (Ubuntu 7.7.1-0ubuntu5~14.04.2) 7.7.1 Copyright (C) 2014 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-linux-gnu". Type "show configuration" for configuration details. For bug reporting instructions, please see: <http://www.gnu.org/software/gdb/bugs/>. Find the GDB manual and other documentation resources online at: <http://www.gnu.org/software/gdb/documentation/>. For help, type "help". Type "apropos word" to search for commands related to "word". (gdb) Quit (gdb) quit root@nuv-vir-kvm-server-2 ~ # apport-unpack /var/crash/_usr_sbin_ovs-vswitchd.0.crash /var/crash/ovs root@nuv-vir-kvm-server-2 ~ # gdb /usr/sbin/ovs-vswitchd /var/crash/ovs/CoreDump GNU gdb (Ubuntu 7.7.1-0ubuntu5~14.04.2) 7.7.1 Copyright (C) 2014 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-linux-gnu". Type "show configuration" for configuration details. For bug reporting instructions, please see: <http://www.gnu.org/software/gdb/bugs/>. Find the GDB manual and other documentation resources online at: <http://www.gnu.org/software/gdb/documentation/>. For help, type "help". Type "apropos word" to search for commands related to "word"... Reading symbols from /usr/sbin/ovs-vswitchd...(no debugging symbols found)...done. [New LWP 1262] [New LWP 1268] [New LWP 1274] [New LWP 1264] [New LWP 1277] [New LWP 1280] [New LWP 1289] [New LWP 1283] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". Core was generated by `ovs-vswitchd unix:/var/run/openvswitch/db.sock -vconsole:emer -vsyslog:err -vfi'. Program terminated with signal SIGSEGV, Segmentation fault. #0 0x0000000000459340 in ?? () (gdb) bt #0 0x0000000000459340 in ?? () #1 0x0000000000460473 in ?? () #2 0x0000000000460cd2 in ?? () #3 0x00000000004609d7 in ?? () #4 0x0000000000460fc4 in ?? () #5 0x00000000004609d7 in ?? () #6 0x00000000004450f3 in ?? () #7 0x00000000004453c9 in ?? () #8 0x0000000000445433 in ?? () #9 0x00000000004455ca in ?? () #10 0x000000000041b423 in ?? () #11 0x0000000000420f18 in ?? () #12 0x0000000000422f52 in ?? () #13 0x0000000000424b5a in ?? () #14 0x0000000000425196 in ?? () #15 0x00000000004122cf in ?? () #16 0x00000000004081a5 in ?? () #17 0x00000000004059b6 in ?? () #18 0x00007fabfe617ec5 in __libc_start_main (main=0x405620, argc=11, argv=0x7fff228eef38, init=<optimized out>, fini=<optimized out>, rtld_fini=<optimized out>, stack_end=0x7fff228eef28) at libc-start.c:287 #19 0x0000000000405b19 in ?? () (gdb) Quit (gdb) quit root@nuv-vir-kvm-server-2 ~ # apt-get install openvswitch-switch-dbgsym Reading package lists... Done Building dependency tree Reading state information... Done E: Unable to locate package openvswitch-switch-dbgsym root@nuv-vir-kvm-server-2 ~ # apt-get install openvswitch-switch Display all 45636 possibilities? (y or n) root@nuv-vir-kvm-server-2 ~ # apt-get install openvswitch- openvswitch-common openvswitch-datapath-dkms openvswitch-dbg openvswitch-pki openvswitch-test openvswitch-controller openvswitch-datapath-source openvswitch-ipsec openvswitch-switch root@nuv-vir-kvm-server-2 ~ # apt-get install openvswitch-dbg Reading package lists... Done Building dependency tree Reading state information... Done The following extra packages will be installed: openvswitch-controller openvswitch-pki The following NEW packages will be installed: openvswitch-controller openvswitch-dbg openvswitch-pki 0 upgraded, 3 newly installed, 0 to remove and 3 not upgraded. Need to get 3,833 kB of archives. After this operation, 27.0 MB of additional disk space will be used. Do you want to continue? [Y/n] y Get:1 http://ppa.launchpad.net/james-page/openvswitch/ubuntu/ trusty/main openvswitch-pki all 2.0.2-0ubuntu0.14.04.2~ubuntu14.04.1~ppa1 [27.6 kB] Get:2 http://ppa.launchpad.net/james-page/openvswitch/ubuntu/ trusty/main openvswitch-controller amd64 2.0.2-0ubuntu0.14.04.2~ubuntu14.04.1~ppa1 [281 kB] Get:3 http://ppa.launchpad.net/james-page/openvswitch/ubuntu/ trusty/main openvswitch-dbg amd64 2.0.2-0ubuntu0.14.04.2~ubuntu14.04.1~ppa1 [3,525 kB] Fetched 3,833 kB in 2s (1,876 kB/s) Selecting previously unselected package openvswitch-pki. (Reading database ... 90676 files and directories currently installed.) Preparing to unpack .../openvswitch-pki_2.0.2-0ubuntu0.14.04.2~ubuntu14.04.1~ppa1_all.deb ... Unpacking openvswitch-pki (2.0.2-0ubuntu0.14.04.2~ubuntu14.04.1~ppa1) ... Selecting previously unselected package openvswitch-controller. Preparing to unpack .../openvswitch-controller_2.0.2-0ubuntu0.14.04.2~ubuntu14.04.1~ppa1_amd64.deb ... Unpacking openvswitch-controller (2.0.2-0ubuntu0.14.04.2~ubuntu14.04.1~ppa1) ... Selecting previously unselected package openvswitch-dbg. Preparing to unpack .../openvswitch-dbg_2.0.2-0ubuntu0.14.04.2~ubuntu14.04.1~ppa1_amd64.deb ... Unpacking openvswitch-dbg (2.0.2-0ubuntu0.14.04.2~ubuntu14.04.1~ppa1) ... Processing triggers for man-db (2.6.7.1-1ubuntu1) ... Processing triggers for ureadahead (0.100.0-16) ... ureadahead will be reprofiled on next reboot Setting up openvswitch-pki (2.0.2-0ubuntu0.14.04.2~ubuntu14.04.1~ppa1) ... Creating controllerca... Creating switchca... Setting up openvswitch-controller (2.0.2-0ubuntu0.14.04.2~ubuntu14.04.1~ppa1) ... * Starting ovs-controller ovs-controller 2015-04-07T09:29:42Z|00001|stream_ssl|INFO|Trusting CA cert from /etc/openvswitch-controller/cacert.pem (/C=US/ST=CA/O=Open vSwitch/OU=switchca/CN=OVS switchca CA Certificate (2015 Apr 07 11:29:39)) (fingerprint 7b:f6:88:7c:82:88:61:7f:31:82:c3:79:76:12:83:4a:86:50:4b:ee) [ OK ] Processing triggers for ureadahead (0.100.0-16) ... Setting up openvswitch-dbg (2.0.2-0ubuntu0.14.04.2~ubuntu14.04.1~ppa1) ... root@nuv-vir-kvm-server-2 ~ # gdb /usr/sbin/ovs-vswitchd /var/crash/ovs/CoreDump GNU gdb (Ubuntu 7.7.1-0ubuntu5~14.04.2) 7.7.1 Copyright (C) 2014 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-linux-gnu". Type "show configuration" for configuration details. For bug reporting instructions, please see: <http://www.gnu.org/software/gdb/bugs/>. Find the GDB manual and other documentation resources online at: <http://www.gnu.org/software/gdb/documentation/>. For help, type "help". Type "apropos word" to search for commands related to "word"... Reading symbols from /usr/sbin/ovs-vswitchd...Reading symbols from /usr/lib/debug//usr/sbin/ovs-vswitchd...done. done. [New LWP 1262] [New LWP 1268] [New LWP 1274] [New LWP 1264] [New LWP 1277] [New LWP 1280] [New LWP 1289] [New LWP 1283] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". Core was generated by `ovs-vswitchd unix:/var/run/openvswitch/db.sock -vconsole:emer -vsyslog:err -vfi'. Program terminated with signal SIGSEGV, Segmentation fault. #0 nl_attr_get_size (nla=nla@entry=0x0) at ../lib/netlink.c:506 506 ../lib/netlink.c: No such file or directory. (gdb) bt #0 nl_attr_get_size (nla=nla@entry=0x0) at ../lib/netlink.c:506 #1 0x0000000000460473 in format_generic_odp_key (a=a@entry=0x0, ds=ds@entry=0x7fff228e0520) at ../lib/odp-util.c:767 #2 0x0000000000460cd2 in format_odp_key_attr (a=a@entry=0x1b8cdb4, ma=ma@entry=0x0, ds=ds@entry=0x7fff228e0520, verbose=verbose@entry=true) at ../lib/odp-util.c:1332 #3 0x00000000004609d7 in odp_flow_format (key=<optimized out>, key_len=40, mask=0x0, mask_len=0, ds=0x7fff228e0520, verbose=true) at ../lib/odp-util.c:1402 #4 0x0000000000460fc4 in format_odp_key_attr (a=a@entry=0x1b8cd90, ma=ma@entry=0x0, ds=ds@entry=0x7fff228e0520, verbose=verbose@entry=true) at ../lib/odp-util.c:987 #5 0x00000000004609d7 in odp_flow_format (key=key@entry=0x1b8cd30, key_len=key_len@entry=140, mask=mask@entry=0x0, mask_len=mask_len@entry=0, ds=ds@entry=0x7fff228e0520, verbose=verbose@entry=true) at ../lib/odp-util.c:1402 #6 0x00000000004450f3 in log_flow_message (error=error@entry=2, operation=operation@entry=0x4d0e73 "flow_del", key=0x1b8cd30, key_len=140, mask=mask@entry=0x0, mask_len=mask_len@entry=0, stats=0x0, actions=actions@entry=0x0, actions_len=actions_len@entry=0, dpif=<optimized out>) at ../lib/dpif.c:1354 #7 0x00000000004453c9 in log_flow_del_message (dpif=dpif@entry=0x1b5d4c0, del=del@entry=0x7fff228e05d0, error=error@entry=2) at ../lib/dpif.c:1397 #8 0x0000000000445433 in log_flow_del_message (error=2, del=0x7fff228e05d0, dpif=0x1b5d4c0) at ../lib/dpif.c:1396 #9 dpif_flow_del__ (dpif=0x1b5d4c0, del=del@entry=0x7fff228e05d0) at ../lib/dpif.c:945 #10 0x00000000004455ca in dpif_flow_del (dpif=<optimized out>, key=<optimized out>, key_len=<optimized out>, stats=stats@entry=0x7fff228e0600) at ../lib/dpif.c:965 #11 0x000000000041b423 in subfacet_uninstall (subfacet=0x1b38af0) at ../ofproto/ofproto-dpif.c:4686 #12 0x0000000000420f18 in facet_remove (facet=facet@entry=0x1b386f0) at ../ofproto/ofproto-dpif.c:4014 #13 0x0000000000422f52 in facet_revalidate (facet=facet@entry=0x1b386f0) at ../ofproto/ofproto-dpif.c:4321 #14 0x0000000000424b5a in facet_lookup_valid (flow=0x7fabe8000c68, ofproto=0x1b69e50) at ../ofproto/ofproto-dpif.c:4203 #15 handle_flow_miss (n_ops=<synthetic pointer>, ops=0x7fff228e0cd0, miss=0x7fabe8000c50) at ../ofproto/ofproto-dpif.c:3339 #16 handle_flow_misses (fmb=fmb@entry=0x7fabe80008e0, backer=<optimized out>) at ../ofproto/ofproto-dpif.c:3410 #17 0x0000000000425196 in handle_upcalls (backer=<optimized out>) at ../ofproto/ofproto-dpif.c:3565 #18 dpif_backer_run_fast (backer=<optimized out>) at ../ofproto/ofproto-dpif.c:1007 #19 type_run_fast (type=<optimized out>) at ../ofproto/ofproto-dpif.c:1024 #20 0x00000000004122cf in ofproto_type_run_fast (datapath_type=<optimized out>, datapath_type@entry=0x1ad7540 "system") at ../ofproto/ofproto.c:1326 #21 0x00000000004081a5 in bridge_run_fast () at ../vswitchd/bridge.c:2318 #22 0x00000000004059b6 in main (argc=<optimized out>, argv=<optimized out>) at ../vswitchd/ovs-vswitchd.c:117 (gdb) quit <http://www.nuvula.ch/> Marco Kuendig / CEO / Founder ma...@nuvula.ch <mailto:ma...@nuvula.ch> / +41 78 751 99 71 Marco's Google Hangout <https://plus.google.com/hangouts/_/nuvula.ch/marco> Nuvula AG - Hybrid Clouds Weierbachstrasse 7b 8193 Eglisau Switzerland http://www.nuvula.ch <http://www.nuvula.ch/> > On 04 Apr 2015, at 17:27, James Page <james.p...@ubuntu.com> wrote: > > Sorry - missed that (phone email only this weekend). > > Will look in full next week once I'm fully back online. > > -- > James Page > Technical Lead, OpenStack Engineering Team > Tel: +44 (0)7545 080150 > > > On 4 Apr 2015, at 16:19, Marco Kuendig <ma...@nuvula.ch > <mailto:ma...@nuvula.ch>> wrote: > >> nope, as you can see this is commented out. Did try that once but disabled >> as I recognised that ovs and kernel version have a linkage. >> >> I have kernel 3.13.0.48 >> >> currently all servers run ovs 2.0.2 >> >> <http://www.nuvula.ch/> >> Marco Kuendig / CEO / Founder >> ma...@nuvula.ch <mailto:ma...@nuvula.ch> / +41 78 751 99 71 >> >> Marco's Google Hangout <https://plus.google.com/hangouts/_/nuvula.ch/marco> >> Nuvula AG - Hybrid Clouds >> Weierbachstrasse 7b 8193 Eglisau Switzerland >> http://www.nuvula.ch <http://www.nuvula.ch/> >>> On 04 Apr 2015, at 17:17, James Page <james.p...@ubuntu.com >>> <mailto:james.p...@ubuntu.com>> wrote: >>> >>> >>> I'd missed the fact that you where upgrading to 2.3.1 - which kernel >>> version are you using? >>> >>> -- >>> James Page >>> Technical Lead, OpenStack Engineering Team >>> Tel: +44 (0)7545 080150 >>> >>> >>> On 4 Apr 2015, at 16:04, Marco Kuendig <ma...@nuvula.ch >>> <mailto:ma...@nuvula.ch>> wrote: >>> >>>> # upgrade to 2.3.1 >>>> # cd /tmp >>>> #wget >>>> http://de.archive.ubuntu.com/ubuntu/pool/main/o/openvswitch/openvswitch-common_2.3.1-0ubuntu1_amd64.deb >>>> >>>> <http://de.archive.ubuntu.com/ubuntu/pool/main/o/openvswitch/openvswitch-common_2.3.1-0ubuntu1_amd64.deb> >>>> #wget >>>> http://de.archive.ubuntu.com/ubuntu/pool/main/o/openvswitch/openvswitch-switch_2.3.1-0ubuntu1_amd64.deb >>>> >>>> <http://de.archive.ubuntu.com/ubuntu/pool/main/o/openvswitch/openvswitch-switch_2.3.1-0ubuntu1_amd64.deb> >>>> #dpkg -i openvswitch-common_2.3.1-0ubuntu1_amd64.deb >>>> #dpkg -i openvswitch-switch_2.3.1-0ubuntu1_amd64.deb >>>> apt-get install -f >>
_______________________________________________ discuss mailing list discuss@openvswitch.org http://openvswitch.org/mailman/listinfo/discuss
