Re: FreeBSD 11 Stable on a Xen :: bridge0 crashing server ::
On 20.01.2017 21:10, SK wrote: Note, I'm not a developer nor a committer, just a humble sysadmin. This problem is unrelated. ARP statistics is global and isn't related to some specific interface. IMHO, the kernel panics due to missing VNET context. As I see from the code in sys/dev/xen, it is not capable with VIMAGE. I cannot really look into this right now due to lack of time, but I'm more than happy to review/apply patches in order to fix this. Roger. Further to my previous, since the provider of the VPS confirmed that they could run FreeBSD 10 and use bridge without any issue, I thought I'd have a look. The section from my crash-debug 0x80c2dd93 is in arprequest (/usr/src/sys/netinet/if_ether.c:427). 422 ro.ro_flags = 0; 423 424 m->m_flags |= M_BCAST; 425 m_clrprotoflags(m); /* Avoid confusing lower layers. */ 426 (*ifp->if_output)(ifp, m, , ); 427 ARPSTAT_INC(txrequests); 428 } 429 430 Well, as I said, there is no VNET support in the sys/dev/xen. It may work without problems even if you have compiled it with VIMAGE enabled. But it will crash just after you try to start some VNET-jail. It is just not implemented yet. -- WBR, Andrey V. Elsukov ___ freebsd-virtualization@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscr...@freebsd.org"
Re: FreeBSD 11 Stable on a Xen :: bridge0 crashing server
On Fri, Jan 20, 2017 at 05:36:37PM +, SK wrote: > On 20/01/2017 16:43, The Doctor wrote: > > On Fri, Jan 20, 2017 at 07:20:15PM +0300, Andrey V. Elsukov wrote: > >> On 20.01.2017 18:57, Trond Endrest??l wrote: > Here is the situation: > I have a VPS server from a well reputed provider (and they deserve the > reputation), running FreeBSD 11 stable x64 under Xen Full Virtualization > (HVM). I have the xn0 interface which is working fine. I intend to use > VIMAGE, > so I compiled the kernel, added cloned_interface="bridge0" and restarted > the > server. But as soon as I am attaching the xn0 to bridge0, the kernel is > panicking and the server restarting. > Any suggestion/pointer/test-instruction is highly appreciated. > >>> The code crashes at line 427 of sys/netinet/if_ether.c: > >>> > >>>ARPSTAT_INC(txrequests); > >>> > >>> See > >>> https://svnweb.freebsd.org/base/stable/11/sys/netinet/if_ether.c?view=annotate#l427 > >>> > >>> stable/11 has problems accounting the outgoing octets of any xn > >>> interface, although this isn't connected to your case. > >>> > >>> Just to rule out any uncertainty, try this patch: > >>> > >>> https://svnweb.freebsd.org/base?view=revision=308126 > >>> > >>> See PR 213439, > >>> https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=213439 > >>> > >>> Note, I'm not a developer nor a committer, just a humble sysadmin. > >> This problem is unrelated. ARP statistics is global and isn't related to > >> some specific interface. IMHO, the kernel panics due to missing VNET > >> context. As I see from the code in sys/dev/xen, it is not capable with > >> VIMAGE. > >> > >> -- > >> WBR, Andrey V. Elsukov > > Still we need to address this issue! > > > > Even here in FreeBSD-11 stable I see crashing > > of the bhyve. > > > > What I need to help you is what is needed for running gdb ../bhyve > > ../bhyve.core > > > Apologies, but I might be missing something here. I am not trying to run > bhyve, bhyve is not crashing. FreeBSD 11 in my case (FreeBSD > testBox.test.domain 11.0-STABLE FreeBSD 11.0-STABLE #0 r312349: Fri Jan > 20 12:29:17 GMT 2017 > r...@testbox.test.domain:/usr/obj/usr/src/sys/vnet-test amd64) is > running on a Xen HVM, and as I am trying to attach bridge0 to any > interface (either xn0, or epair0a, or so on), the server is crashing and > rebooting. I had the line ifconfig_bridge0="addm xn0 addm epair0a up" on > the /etc/rc.conf , and the server went into an infinite crash-reboot loop. > > What I would like to have, if possible, is running FreeBSD 11 stable on > the server, use vnet/vimage for my jails so I can isolate each of them > from one another. > > Currently I am building world with the patch suggested by Trond (started > that before I read the mail from Andrey). But if that is unlikely to > bring a solution, that would mean most people on VPS with jails that are > using Xen are going to suffer from any upgrade to 11 (or having new > servers running 11) -- which is definitely undesirable. > > If anyone would like me to run further test on the box, please let me > know what you'd like me to run, and I can come back with the response. > Having a reliable/stable solution is the objective from my end. > > Thanks to all for your suggestions/comments. > > Regards > SK Well in my case using gdb /usr/sbin/bhyve /path/to/bhyve.core I get GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "amd64-marcel-freebsd"... Core was generated by `bhyve'. Program terminated with signal 6, Aborted. Reading symbols from /usr/lib/libvmmapi.so.5...Reading symbols from /usr/lib/debug//usr/lib/libvmmapi.so.5.debug...done. done. Loaded symbols for /usr/lib/libvmmapi.so.5 Reading symbols from /lib/libmd.so.6...Reading symbols from /usr/lib/debug//lib/libmd.so.6.debug...done. done. Loaded symbols for /lib/libmd.so.6 Reading symbols from /lib/libz.so.6...Reading symbols from /usr/lib/debug//lib/libz.so.6.debug...done. done. Loaded symbols for /lib/libz.so.6 Reading symbols from /lib/libthr.so.3...Reading symbols from /usr/lib/debug//lib/libthr.so.3.debug...done. done. Loaded symbols for /lib/libthr.so.3 Reading symbols from /lib/libc.so.7...Reading symbols from /usr/lib/debug//lib/libc.so.7.debug...done. done. Loaded symbols for /lib/libc.so.7 Reading symbols from /lib/libutil.so.9...Reading symbols from /usr/lib/debug//lib/libutil.so.9.debug...done. done. Loaded symbols for /lib/libutil.so.9 Reading symbols from /libexec/ld-elf.so.1...Reading symbols from /usr/lib/debug//libexec/ld-elf.so.1.debug...done. done. Loaded symbols for /libexec/ld-elf.so.1 #0 0x00080119755a in thr_kill () from
Re: FreeBSD 11 Stable on a Xen :: bridge0 crashing server ::
On 20/01/2017 16:44, Roger Pau Monné wrote: On Fri, Jan 20, 2017 at 07:20:15PM +0300, Andrey V. Elsukov wrote: On 20.01.2017 18:57, Trond Endrestøl wrote: Here is the situation: I have a VPS server from a well reputed provider (and they deserve the reputation), running FreeBSD 11 stable x64 under Xen Full Virtualization (HVM). I have the xn0 interface which is working fine. I intend to use VIMAGE, so I compiled the kernel, added cloned_interface="bridge0" and restarted the server. But as soon as I am attaching the xn0 to bridge0, the kernel is panicking and the server restarting. Any suggestion/pointer/test-instruction is highly appreciated. The code crashes at line 427 of sys/netinet/if_ether.c: ARPSTAT_INC(txrequests); See https://svnweb.freebsd.org/base/stable/11/sys/netinet/if_ether.c?view=annotate#l427 stable/11 has problems accounting the outgoing octets of any xn interface, although this isn't connected to your case. Just to rule out any uncertainty, try this patch: https://svnweb.freebsd.org/base?view=revision=308126 See PR 213439, https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=213439 Note, I'm not a developer nor a committer, just a humble sysadmin. This problem is unrelated. ARP statistics is global and isn't related to some specific interface. IMHO, the kernel panics due to missing VNET context. As I see from the code in sys/dev/xen, it is not capable with VIMAGE. I cannot really look into this right now due to lack of time, but I'm more than happy to review/apply patches in order to fix this. Roger. Further to my previous, since the provider of the VPS confirmed that they could run FreeBSD 10 and use bridge without any issue, I thought I'd have a look. The section from my crash-debug 0x80c2dd93 is in arprequest (/usr/src/sys/netinet/if_ether.c:427). 422 ro.ro_flags = 0; 423 424 m->m_flags |= M_BCAST; 425 m_clrprotoflags(m); /* Avoid confusing lower layers. */ 426 (*ifp->if_output)(ifp, m, , ); 427 ARPSTAT_INC(txrequests); 428 } 429 430 I compared the file (if_ether.c) from 10, and it seems that the line 426 is different -- it contains NULL instead of at the end. I did nto see any ro.* (right before this section) on the file in 10 either. Could this be significant? Thanks and regards SK ___ freebsd-virtualization@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscr...@freebsd.org"
Re: FreeBSD 11 Stable on a Xen :: bridge0 crashing server
On 20/01/2017 16:43, The Doctor wrote: On Fri, Jan 20, 2017 at 07:20:15PM +0300, Andrey V. Elsukov wrote: On 20.01.2017 18:57, Trond Endrest??l wrote: Here is the situation: I have a VPS server from a well reputed provider (and they deserve the reputation), running FreeBSD 11 stable x64 under Xen Full Virtualization (HVM). I have the xn0 interface which is working fine. I intend to use VIMAGE, so I compiled the kernel, added cloned_interface="bridge0" and restarted the server. But as soon as I am attaching the xn0 to bridge0, the kernel is panicking and the server restarting. Any suggestion/pointer/test-instruction is highly appreciated. The code crashes at line 427 of sys/netinet/if_ether.c: ARPSTAT_INC(txrequests); See https://svnweb.freebsd.org/base/stable/11/sys/netinet/if_ether.c?view=annotate#l427 stable/11 has problems accounting the outgoing octets of any xn interface, although this isn't connected to your case. Just to rule out any uncertainty, try this patch: https://svnweb.freebsd.org/base?view=revision=308126 See PR 213439, https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=213439 Note, I'm not a developer nor a committer, just a humble sysadmin. This problem is unrelated. ARP statistics is global and isn't related to some specific interface. IMHO, the kernel panics due to missing VNET context. As I see from the code in sys/dev/xen, it is not capable with VIMAGE. -- WBR, Andrey V. Elsukov Still we need to address this issue! Even here in FreeBSD-11 stable I see crashing of the bhyve. What I need to help you is what is needed for running gdb ../bhyve ../bhyve.core Apologies, but I might be missing something here. I am not trying to run bhyve, bhyve is not crashing. FreeBSD 11 in my case (FreeBSD testBox.test.domain 11.0-STABLE FreeBSD 11.0-STABLE #0 r312349: Fri Jan 20 12:29:17 GMT 2017 r...@testbox.test.domain:/usr/obj/usr/src/sys/vnet-test amd64) is running on a Xen HVM, and as I am trying to attach bridge0 to any interface (either xn0, or epair0a, or so on), the server is crashing and rebooting. I had the line ifconfig_bridge0="addm xn0 addm epair0a up" on the /etc/rc.conf , and the server went into an infinite crash-reboot loop. What I would like to have, if possible, is running FreeBSD 11 stable on the server, use vnet/vimage for my jails so I can isolate each of them from one another. Currently I am building world with the patch suggested by Trond (started that before I read the mail from Andrey). But if that is unlikely to bring a solution, that would mean most people on VPS with jails that are using Xen are going to suffer from any upgrade to 11 (or having new servers running 11) -- which is definitely undesirable. If anyone would like me to run further test on the box, please let me know what you'd like me to run, and I can come back with the response. Having a reliable/stable solution is the objective from my end. Thanks to all for your suggestions/comments. Regards SK ___ freebsd-virtualization@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscr...@freebsd.org"
Re: FreeBSD 11 Stable on a Xen :: bridge0 crashing server
On Fri, Jan 20, 2017 at 07:20:15PM +0300, Andrey V. Elsukov wrote: > On 20.01.2017 18:57, Trond Endrestøl wrote: > > > Here is the situation: > > > I have a VPS server from a well reputed provider (and they deserve the > > > reputation), running FreeBSD 11 stable x64 under Xen Full Virtualization > > > (HVM). I have the xn0 interface which is working fine. I intend to use > > > VIMAGE, > > > so I compiled the kernel, added cloned_interface="bridge0" and restarted > > > the > > > server. But as soon as I am attaching the xn0 to bridge0, the kernel is > > > panicking and the server restarting. > > > Any suggestion/pointer/test-instruction is highly appreciated. > > > > The code crashes at line 427 of sys/netinet/if_ether.c: > > > > ARPSTAT_INC(txrequests); > > > > See > > https://svnweb.freebsd.org/base/stable/11/sys/netinet/if_ether.c?view=annotate#l427 > > > > stable/11 has problems accounting the outgoing octets of any xn > > interface, although this isn't connected to your case. > > > > Just to rule out any uncertainty, try this patch: > > > > https://svnweb.freebsd.org/base?view=revision=308126 > > > > See PR 213439, > > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=213439 > > > > Note, I'm not a developer nor a committer, just a humble sysadmin. > > This problem is unrelated. ARP statistics is global and isn't related to > some specific interface. IMHO, the kernel panics due to missing VNET > context. As I see from the code in sys/dev/xen, it is not capable with > VIMAGE. I cannot really look into this right now due to lack of time, but I'm more than happy to review/apply patches in order to fix this. Roger. ___ freebsd-virtualization@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscr...@freebsd.org"
Re: FreeBSD 11 Stable on a Xen :: bridge0 crashing server
On Fri, Jan 20, 2017 at 07:20:15PM +0300, Andrey V. Elsukov wrote: > On 20.01.2017 18:57, Trond Endrest??l wrote: > >> Here is the situation: > >> I have a VPS server from a well reputed provider (and they deserve the > >> reputation), running FreeBSD 11 stable x64 under Xen Full Virtualization > >> (HVM). I have the xn0 interface which is working fine. I intend to use > >> VIMAGE, > >> so I compiled the kernel, added cloned_interface="bridge0" and restarted > >> the > >> server. But as soon as I am attaching the xn0 to bridge0, the kernel is > >> panicking and the server restarting. > >> Any suggestion/pointer/test-instruction is highly appreciated. > > > > The code crashes at line 427 of sys/netinet/if_ether.c: > > > > ARPSTAT_INC(txrequests); > > > > See > > https://svnweb.freebsd.org/base/stable/11/sys/netinet/if_ether.c?view=annotate#l427 > > > > stable/11 has problems accounting the outgoing octets of any xn > > interface, although this isn't connected to your case. > > > > Just to rule out any uncertainty, try this patch: > > > > https://svnweb.freebsd.org/base?view=revision=308126 > > > > See PR 213439, > > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=213439 > > > > Note, I'm not a developer nor a committer, just a humble sysadmin. > > This problem is unrelated. ARP statistics is global and isn't related to > some specific interface. IMHO, the kernel panics due to missing VNET > context. As I see from the code in sys/dev/xen, it is not capable with > VIMAGE. > > -- > WBR, Andrey V. Elsukov Still we need to address this issue! Even here in FreeBSD-11 stable I see crashing of the bhyve. What I need to help you is what is needed for running gdb ../bhyve ../bhyve.core > ___ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to > "freebsd-virtualization-unsubscr...@freebsd.org" -- Member - Liberal International This is doctor@@nl2k.ab.ca Ici doctor@@nl2k.ab.ca God,Queen and country!Never Satan President Republic!Beware AntiChrist rising! http://www.fullyfollow.me/rootnl2k Look at Psalms 14 and 53 on Atheism Birthdate 29 Jan 1969 Redhill Surrey England ___ freebsd-virtualization@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscr...@freebsd.org"
Re: FreeBSD 11 Stable on a Xen :: bridge0 crashing server
On 20.01.2017 18:57, Trond Endrestøl wrote: Here is the situation: I have a VPS server from a well reputed provider (and they deserve the reputation), running FreeBSD 11 stable x64 under Xen Full Virtualization (HVM). I have the xn0 interface which is working fine. I intend to use VIMAGE, so I compiled the kernel, added cloned_interface="bridge0" and restarted the server. But as soon as I am attaching the xn0 to bridge0, the kernel is panicking and the server restarting. Any suggestion/pointer/test-instruction is highly appreciated. The code crashes at line 427 of sys/netinet/if_ether.c: ARPSTAT_INC(txrequests); See https://svnweb.freebsd.org/base/stable/11/sys/netinet/if_ether.c?view=annotate#l427 stable/11 has problems accounting the outgoing octets of any xn interface, although this isn't connected to your case. Just to rule out any uncertainty, try this patch: https://svnweb.freebsd.org/base?view=revision=308126 See PR 213439, https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=213439 Note, I'm not a developer nor a committer, just a humble sysadmin. This problem is unrelated. ARP statistics is global and isn't related to some specific interface. IMHO, the kernel panics due to missing VNET context. As I see from the code in sys/dev/xen, it is not capable with VIMAGE. -- WBR, Andrey V. Elsukov ___ freebsd-virtualization@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscr...@freebsd.org"
Re: FreeBSD 11 Stable on a Xen :: bridge0 crashing server
On Fri, 20 Jan 2017 14:26-, SK wrote: > Dear List members > > Apologies for cross posting to two other lists -- was not sure which one is > more appropriate for this, as it may be related to stable, xen or > virtualization. > > Here is the situation: > I have a VPS server from a well reputed provider (and they deserve the > reputation), running FreeBSD 11 stable x64 under Xen Full Virtualization > (HVM). I have the xn0 interface which is working fine. I intend to use VIMAGE, > so I compiled the kernel, added cloned_interface="bridge0" and restarted the > server. But as soon as I am attaching the xn0 to bridge0, the kernel is > panicking and the server restarting. > > The provider confirmed that they found similar behaviour on a freshly > installed/provisioned FreeBSD 11 x64 system. > > Further to that, the provider ran some tests, and what they are telling me is > if they install/provision FreeBSD 10 x64, there is no problem with attaching > bridge0 to xn0. Then they updated/upgraded that box to FreeBSD 11 x64, and > that too worked when they attached bridge0 to xn0. However, they are yet to > come back with my request to build a custom kernel with options VIMAGE and try > it out. > > In the meanwhile, I took a crash dump and followed the FreeBSD handbook (not > that it gave me much idea, I'm not a programmer nor am at that level of > skillsets). The dump/debug is available at http://pastebin.com/XuWvJHUZ for > anyone who is interested. > > Just wondering how to go about it. I do need to have bridge0 with xn0 and all > the epairs I'm going to use for my jails. > > Any suggestion/pointer/test-instruction is highly appreciated. The code crashes at line 427 of sys/netinet/if_ether.c: ARPSTAT_INC(txrequests); See https://svnweb.freebsd.org/base/stable/11/sys/netinet/if_ether.c?view=annotate#l427 stable/11 has problems accounting the outgoing octets of any xn interface, although this isn't connected to your case. Just to rule out any uncertainty, try this patch: https://svnweb.freebsd.org/base?view=revision=308126 See PR 213439, https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=213439 Note, I'm not a developer nor a committer, just a humble sysadmin. -- +---++ | Vennlig hilsen, | Best regards, | | Trond Endrestøl, | Trond Endrestøl, | | IT-ansvarlig, | System administrator, | | Fagskolen Innlandet, | Gjøvik Technical College, Norway, | | tlf. mob. 952 62 567, | Cellular...: +47 952 62 567, | | sentralbord 61 14 54 00. | Switchboard: +47 61 14 54 00. | +---++ ___ freebsd-virtualization@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscr...@freebsd.org"
FreeBSD 11 Stable on a Xen :: bridge0 crashing server
Dear List members Apologies for cross posting to two other lists -- was not sure which one is more appropriate for this, as it may be related to stable, xen or virtualization. Here is the situation: I have a VPS server from a well reputed provider (and they deserve the reputation), running FreeBSD 11 stable x64 under Xen Full Virtualization (HVM). I have the xn0 interface which is working fine. I intend to use VIMAGE, so I compiled the kernel, added cloned_interface="bridge0" and restarted the server. But as soon as I am attaching the xn0 to bridge0, the kernel is panicking and the server restarting. The provider confirmed that they found similar behaviour on a freshly installed/provisioned FreeBSD 11 x64 system. Further to that, the provider ran some tests, and what they are telling me is if they install/provision FreeBSD 10 x64, there is no problem with attaching bridge0 to xn0. Then they updated/upgraded that box to FreeBSD 11 x64, and that too worked when they attached bridge0 to xn0. However, they are yet to come back with my request to build a custom kernel with options VIMAGE and try it out. In the meanwhile, I took a crash dump and followed the FreeBSD handbook (not that it gave me much idea, I'm not a programmer nor am at that level of skillsets). The dump/debug is available at http://pastebin.com/XuWvJHUZ for anyone who is interested. Just wondering how to go about it. I do need to have bridge0 with xn0 and all the epairs I'm going to use for my jails. Any suggestion/pointer/test-instruction is highly appreciated. Best regards SK ___ freebsd-virtualization@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization To unsubscribe, send any mail to "freebsd-virtualization-unsubscr...@freebsd.org"
