Hi Daniel.

bgpd crashed, watchfrr restarted it; bgpd crashed again, rinse, repeat.

Journalctl shows:

Jul 25 16:32:43 ivernia watchfrr[1226]: [T58XM-TP956][EC 268435457] bgpd state 
-> unresponsive : no response yet to ping sent 90 seconds ago
Jul 25 16:32:43 ivernia watchfrr[1226]: [YFT0P-5Q5YX] Forked background command 
[pid 39662]: /usr/lib/frr/watchfrr.sh restart bgpd
Jul 25 16:33:13 ivernia watchfrr[1226]: [HD38Q-0HBRT][EC 268435457] bgpd state 
-> down : unexpected read error: Connection reset by peer
Jul 25 16:33:13 ivernia frrinit.sh[1249]: bgpd: showing active allocations in 
memory group libfrr
Jul 25 16:33:13 ivernia frrinit.sh[1249]: bgpd: memstats:  Hash                 
         :     20 * (variably sized)
Jul 25 16:33:13 ivernia frrinit.sh[1249]: bgpd: memstats:  Hash Index           
         :     10 * (variably sized)
Jul 25 16:33:13 ivernia frrinit.sh[1249]: bgpd: memstats:  Link List            
         :     14 *         40
Jul 25 16:33:13 ivernia frrinit.sh[1249]: bgpd: memstats:  Link Node            
         :     16 *         24
Jul 25 16:33:13 ivernia frrinit.sh[1249]: bgpd: memstats:  Ring buffer          
         :     12 * (variably sized)
Jul 25 16:33:13 ivernia frrinit.sh[1249]: bgpd: memstats:  Stream FIFO          
         :     12 *         72
Jul 25 16:33:13 ivernia frrinit.sh[1249]: bgpd: memstats:  Route table          
         :     66 *         56
Jul 25 16:33:13 ivernia frrinit.sh[1249]: bgpd: memstats:  Route node           
         : 2008999 *        120
Jul 25 16:33:13 ivernia frrinit.sh[1249]: bgpd: memstats:  Typed-hash bucket    
         :      2 * (variably sized)
Jul 25 16:33:13 ivernia frrinit.sh[1249]: bgpd: memstats:  Work queue           
         :      6 *        144
Jul 25 16:33:13 ivernia frrinit.sh[1249]: bgpd: memstats:  Work queue item      
         : 2832564 *         24
Jul 25 16:33:13 ivernia frrinit.sh[1249]: bgpd: memstats:  Work queue name 
string        :      6 * (variably sized)
Jul 25 16:33:13 ivernia frrinit.sh[1249]: bgpd: showing active allocations in 
memory group bgpd
Jul 25 16:33:13 ivernia frrinit.sh[1249]: bgpd: memstats:  BGP EVPN instance 
information :      1 *         64
Jul 25 16:33:13 ivernia frrinit.sh[1249]: bgpd: memstats:  BGP instance         
         :      1 *      12496
Jul 25 16:33:13 ivernia frrinit.sh[1249]: bgpd: memstats:  BGP Name data        
         :      7 * (variably sized)
Jul 25 16:33:13 ivernia frrinit.sh[1249]: bgpd: memstats:  BGP peer             
         :      6 *      24056
Jul 25 16:33:13 ivernia frrinit.sh[1249]: bgpd: memstats:  BGP peer connection  
         :      6 *        360
Jul 25 16:33:13 ivernia frrinit.sh[1249]: bgpd: memstats:  BGP peer hostname    
         :      6 * (variably sized)
Jul 25 16:33:13 ivernia frrinit.sh[1249]: bgpd: memstats:  Peer description     
         :      5 * (variably sized)
Jul 25 16:33:13 ivernia frrinit.sh[1249]: bgpd: memstats:  BGP table            
         :     66 *         56
Jul 25 16:33:13 ivernia frrinit.sh[1249]: bgpd: memstats:  BGP node             
         : 1095682 *        128
Jul 25 16:33:13 ivernia frrinit.sh[1249]: bgpd: memstats:  BGP connected        
         :      2 *          4
Jul 25 16:33:13 ivernia frrinit.sh[1249]: bgpd: memstats:  BGP node clear queue 
         : 2832564 *          8
Jul 25 16:33:13 ivernia frrinit.sh[1249]: bgpd: memstats:  BGP PBR Context      
         :      1 *         32
Jul 25 16:33:13 ivernia frrinit.sh[1249]: bgpd: memstats:  BGP MetaQ            
         :      4 * (variably sized)
Jul 25 16:33:13 ivernia frrinit.sh[39663]: /etc/frr/frr.conf does not exist; 
skipping config apply
Jul 25 16:33:13 ivernia watchfrr[1226]: [QDG3Y-BY5TN] bgpd state -> up : 
connect succeeded
Jul 25 16:33:14 ivernia watchfrr[1226]: [HD38Q-0HBRT][EC 268435457] bgpd state 
-> down : read returned EOF
Jul 25 16:33:14 ivernia watchfrr[1226]: [QDG3Y-BY5TN] bgpd state -> up : 
connect succeeded
Jul 25 16:33:14 ivernia watchfrr[1226]: [HD38Q-0HBRT][EC 268435457] bgpd state 
-> down : unexpected read error: Connection reset by peer
Jul 25 16:34:14 ivernia watchfrr[1226]: [YFT0P-5Q5YX] Forked background command 
[pid 40037]: /usr/lib/frr/watchfrr.sh restart bgpd
Jul 25 16:34:14 ivernia frrinit.sh[40038]: Cannot stop bgpd: pid 39992 not 
running
Jul 25 16:34:14 ivernia frrinit.sh[40038]: /etc/frr/frr.conf does not exist; 
skipping config apply
Jul 25 16:34:14 ivernia watchfrr[1226]: [QDG3Y-BY5TN] bgpd state -> up : 
connect succeeded
Jul 25 16:34:14 ivernia watchfrr[1226]: [HD38Q-0HBRT][EC 268435457] bgpd state 
-> down : read returned EOF

And from there it just keeps crashing and restarting until I did a systemctl restart frr:

Jul 27 09:58:34 ivernia watchfrr[1226]: [QDG3Y-BY5TN] bgpd state -> up : 
connect succeeded
Jul 27 09:58:34 ivernia watchfrr[1226]: [HD38Q-0HBRT][EC 268435457] bgpd state 
-> down : read returned EOF
Jul 27 10:08:39 ivernia watchfrr[1226]: [YFT0P-5Q5YX] Forked background command 
[pid 238320]: /usr/lib/frr/watchfrr.sh restart bgpd
Jul 27 10:08:39 ivernia frrinit.sh[238321]: Cannot stop bgpd: pid 236766 not 
running
Jul 27 10:08:39 ivernia frrinit.sh[238321]: /etc/frr/frr.conf does not exist; 
skipping config apply
Jul 27 10:08:39 ivernia watchfrr[1226]: [QDG3Y-BY5TN] bgpd state -> up : 
connect succeeded
Jul 27 10:08:39 ivernia watchfrr[1226]: [HD38Q-0HBRT][EC 268435457] bgpd state 
-> down : read returned EOF
Jul 27 10:08:55 ivernia systemd[1]: Stopping frr.service - FRRouting...
Jul 27 10:08:55 ivernia watchfrr[1226]: [NG1AJ-FP2TQ] Terminating on signal
Jul 27 10:08:56 ivernia frrinit.sh[238339]: Stopped watchfrr.
Jul 27 10:08:56 ivernia frrinit.sh[238368]: Cannot stop bgpd: pid 238329 not 
running ... failed!
Jul 27 10:08:56 ivernia frrinit.sh[238369]: Stopped zebra.
Jul 27 10:08:56 ivernia frrinit.sh[238367]: Stopped staticd.
Jul 27 10:08:56 ivernia frrinit.sh[238371]: Stopped mgmtd.
Jul 27 10:08:56 ivernia systemd[1]: frr.service: Deactivated successfully.
Jul 27 10:08:56 ivernia systemd[1]: Stopped frr.service - FRRouting.
Jul 27 10:08:56 ivernia systemd[1]: frr.service: Consumed 17h 8min 57.650s CPU 
time, 2.5G memory peak.
Jul 27 10:08:56 ivernia systemd[1]: Starting frr.service - FRRouting...
Jul 27 10:08:56 ivernia frrinit.sh[238383]: Starting watchfrr with command: '  
/usr/lib/frr/watchfrr  -d   mgmtd zebra bgpd staticd'.
Jul 27 10:08:56 ivernia watchfrr[238393]: [T83RR-8SM5G] watchfrr 10.6.1 
starting: vty@0
Jul 27 10:08:56 ivernia watchfrr[238393]: [ZCJ3S-SPH5S] mgmtd state -> down : 
initial connection attempt failed
Jul 27 10:08:56 ivernia watchfrr[238393]: [ZCJ3S-SPH5S] zebra state -> down : 
initial connection attempt failed
Jul 27 10:08:56 ivernia watchfrr[238393]: [ZCJ3S-SPH5S] bgpd state -> down : 
initial connection attempt failed
Jul 27 10:08:56 ivernia watchfrr[238393]: [ZCJ3S-SPH5S] staticd state -> down : 
initial connection attempt failed
Jul 27 10:08:56 ivernia watchfrr[238393]: [YFT0P-5Q5YX] Forked background 
command [pid 238394]: /usr/lib/frr/watchfrr.sh restart all
Jul 27 10:08:56 ivernia frrinit.sh[238406]: 2026/07/27 10:08:56 ZEBRA: 
[QBKSZ-0KHCW][EC 4043309138] Disabling MPLS support (no kernel support)
Jul 27 10:08:56 ivernia frrinit.sh[238395]: /etc/frr/frr.conf does not exist; 
skipping config apply
Jul 27 10:08:56 ivernia watchfrr.sh[238431]: /etc/frr/frr.conf does not exist; 
skipping config apply
Jul 27 10:08:56 ivernia watchfrr[238393]: [QDG3Y-BY5TN] mgmtd state -> up : 
connect succeeded
Jul 27 10:08:56 ivernia watchfrr[238393]: [QDG3Y-BY5TN] zebra state -> up : 
connect succeeded
Jul 27 10:08:56 ivernia watchfrr[238393]: [QDG3Y-BY5TN] bgpd state -> up : 
connect succeeded
Jul 27 10:08:56 ivernia watchfrr[238393]: [QDG3Y-BY5TN] staticd state -> up : 
connect succeeded
Jul 27 10:08:56 ivernia watchfrr[238393]: [KWE5Q-QNGFC] all daemons up, doing 
startup-complete notify
Jul 27 10:08:56 ivernia frrinit.sh[238383]: Started watchfrr.
Jul 27 10:08:56 ivernia systemd[1]: Started frr.service - FRRouting.

Now it all seems to be running ok.

At the same time I find this in the bgpd.log:

2026/07/25 16:32:58 BGP: [ZW1GY-R46JE] Terminating on signal
2026/07/25 16:32:59 BGP: [PXVXG-TFNNT] %ADJCHANGE: neighbor 10.27.255.29(bgpd) 
in vrf default Down Neighbor deleted
2026/07/25 16:32:59 BGP: [PXVXG-TFNNT] %ADJCHANGE: neighbor 
89.202.138.113(Unknown) in vrf default Down Neighbor deleted
2026/07/25 16:33:00 BGP: [PXVXG-TFNNT] %ADJCHANGE: neighbor 
192.168.130.254(bgpd) in vrf default Down Neighbor deleted
2026/07/25 16:33:01 BGP: [PXVXG-TFNNT] %ADJCHANGE: neighbor 
193.188.249.254(bgpd) in vrf default Down Neighbor deleted
2026/07/25 16:33:02 BGP: [PXVXG-TFNNT] %ADJCHANGE: neighbor 
217.117.144.57(Unknown) in vrf default Down Neighbor deleted
2026/07/25 16:33:13 BGP: [SHWNK-NWT5S][EC 100663304] Command returned 
Incomplete on config line 11: no debug bgp
2026/07/25 16:33:13 BGP: [SHWNK-NWT5S][EC 100663304] No such command on config 
line 60:  no synchronization
2026/07/25 16:33:13 BGP: [S48XV-GT1WC][EC 100663311] stream_get2: Attempt to 
get out of bounds
2026/07/25 16:33:13 BGP: [RF6RD-ZCBTC][EC 100663311] &(struct stream): 
0x561da35ca660, size: 165016, getp: 81, endp: 84
2026/07/25 16:33:13 BGP: Backtrace:
2026/07/25 16:33:14 BGP: stream_get2+0x101                  7f6d88f1a2f1     
7ffe517d4170 /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0 (mapped at 
0x7f6d88e00000)
2026/07/25 16:33:14 BGP: ?                                  7f6d88f3ca4a     
7ffe517d41a0 /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0 (mapped at 
0x7f6d88e00000)
2026/07/25 16:33:14 BGP: ?                                  7f6d88f3cb00     
7ffe517d41e0 /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0 (mapped at 
0x7f6d88e00000)
2026/07/25 16:33:14 BGP: ?                                  7f6d88f3da1c     
7ffe517d4230 /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0 (mapped at 
0x7f6d88e00000)
2026/07/25 16:33:14 BGP: event_call+0xac                    7f6d88f27f1c     
7ffe517d4280 /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0 (mapped at 
0x7f6d88e00000)
2026/07/25 16:33:14 BGP: frr_run+0xc0                       7f6d88ec6510     
7ffe517d43c0 /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0 (mapped at 
0x7f6d88e00000)
2026/07/25 16:33:14 BGP: main+0x3d6                         561d72be1c46     
7ffe517d44e0 /usr/lib/frr/bgpd (mapped at 0x561d72af3000)
2026/07/25 16:33:14 BGP: ?                                  7f6d88c21ca8     
7ffe517d4570 /lib/x86_64-linux-gnu/libc.so.6 (mapped at 0x7f6d88bf8000)
2026/07/25 16:33:14 BGP: __libc_start_main+0x85             7f6d88c21d65     
7ffe517d4610 /lib/x86_64-linux-gnu/libc.so.6 (mapped at 0x7f6d88bf8000)
2026/07/25 16:33:14 BGP: _start+0x21                        561d72be4db1     
7ffe517d4660 /usr/lib/frr/bgpd (mapped at 0x561d72af3000)
2026/07/25 16:33:14 BGP: [ND9C6-S6XT9] Could not parse interface values; 
aborting
2026/07/25 16:33:14 BGP: ../lib/zclient.c:3090: zebra_interface_if_set_value(): assertion 
(!"Failed to parse interface values") failed
BGP: Received signal 6 at 1784989994 (si_addr 0x7200009c38, PC 0x7f6d88c8c95c); 
aborting...
BGP: zlog_signal+0xf7                   7f6d88ecf8c7     7ffe517d3770 
/usr/lib/x86_64-linux-gnu/frr/libfrr.so.0 (mapped at 0x7f6d88e00000)
BGP: ?                                  7f6d88f14063     7ffe517d38b0 
/usr/lib/x86_64-linux-gnu/frr/libfrr.so.0 (mapped at 0x7f6d88e00000)
BGP: ?                                  7f6d88c37df0     7ffe517d3a00 
/lib/x86_64-linux-gnu/libc.so.6 (mapped at 0x7f6d88bf8000)
BGP:     ---- signal ----
BGP: ?                                  7f6d88c8c95c     7ffe517d3fa0 
/lib/x86_64-linux-gnu/libc.so.6 (mapped at 0x7f6d88bf8000)
BGP: gsignal+0x12                       7f6d88c37cc2     7ffe517d3fe0 
/lib/x86_64-linux-gnu/libc.so.6 (mapped at 0x7f6d88bf8000)
BGP: abort+0x22                         7f6d88c204ac     7ffe517d3ff0 
/lib/x86_64-linux-gnu/libc.so.6 (mapped at 0x7f6d88bf8000)
BGP: _zlog_assert_failed+0xed           7f6d88f4783d     7ffe517d40b0 
/usr/lib/x86_64-linux-gnu/frr/libfrr.so.0 (mapped at 0x7f6d88e00000)
BGP: ?                                  7f6d88f3ca73     7ffe517d41a0 
/usr/lib/x86_64-linux-gnu/frr/libfrr.so.0 (mapped at 0x7f6d88e00000)
BGP: ?                                  7f6d88f3cb00     7ffe517d41e0 
/usr/lib/x86_64-linux-gnu/frr/libfrr.so.0 (mapped at 0x7f6d88e00000)
BGP: ?                                  7f6d88f3da1c     7ffe517d4230 
/usr/lib/x86_64-linux-gnu/frr/libfrr.so.0 (mapped at 0x7f6d88e00000)
BGP: event_call+0xac                    7f6d88f27f1c     7ffe517d4280 
/usr/lib/x86_64-linux-gnu/frr/libfrr.so.0 (mapped at 0x7f6d88e00000)
BGP: frr_run+0xc0                       7f6d88ec6510     7ffe517d43c0 
/usr/lib/x86_64-linux-gnu/frr/libfrr.so.0 (mapped at 0x7f6d88e00000)
BGP: main+0x3d6                         561d72be1c46     7ffe517d44e0 
/usr/lib/frr/bgpd (mapped at 0x561d72af3000)
BGP: ?                                  7f6d88c21ca8     7ffe517d4570 
/lib/x86_64-linux-gnu/libc.so.6 (mapped at 0x7f6d88bf8000)
BGP: __libc_start_main+0x85             7f6d88c21d65     7ffe517d4610 
/lib/x86_64-linux-gnu/libc.so.6 (mapped at 0x7f6d88bf8000)
BGP: _start+0x21                        561d72be4db1     7ffe517d4660 
/usr/lib/frr/bgpd (mapped at 0x561d72af3000)
BGP: in thread zclient_read scheduled from ../lib/zclient.c:5021 zclient_event()

The "stream_get2: Attempt to get out of bounds" crash happens every time bgpd is restarted:

2026/07/25 16:33:13 BGP: [S48XV-GT1WC][EC 100663311] stream_get2: Attempt to 
get out of bounds
2026/07/25 16:34:14 BGP: [S48XV-GT1WC][EC 100663311] stream_get2: Attempt to 
get out of bounds
2026/07/25 16:36:19 BGP: [S48XV-GT1WC][EC 100663311] stream_get2: Attempt to 
get out of bounds
...
2026/07/26 23:46:15 BGP: [S48XV-GT1WC][EC 100663311] stream_get2: Attempt to 
get out of bounds
2026/07/26 23:56:15 BGP: [S48XV-GT1WC][EC 100663311] stream_get2: Attempt to 
get out of bounds
2026/07/27 00:06:16 BGP: [S48XV-GT1WC][EC 100663311] stream_get2: Attempt to 
get out of bounds
2026/07/27 00:16:17 BGP: [S48XV-GT1WC][EC 100663311] stream_get2: Attempt to 
get out of bounds
...

Until I restart frr.

--
John Hughes, CalvaEDI -- an Esker company.

Reply via email to