On Mon, Nov 27, 2023 at 04:57:35PM +0100, Laurent CARON wrote: > Hi, > > I'm currently migrating a BGPd server. > > Specs of "old" machine: > > - Dell R720 with Intel(R) Xeon(R) CPU E5-2637 v2and 16GB RAM > > - SMP Kernel (default) > > - BGPd runs fine with 5 full views > > - X710 NIC (ixl) 4 port interface > > Specs of "new" machine: > > - Dell R750xs with Intel(R) Xeon(R) Gold 6334 CPU @ 3.60GHz and 128GB RAM > > - SMP Kernel (default) > > - X710 NIC (ixl) 2 nics with 2 ports each > > - BGPd crashes with "panic: malloc: out of space in kmem_map" (please see > screenshot). > > - When launching 'bgpd -dv' on the console, logs are showing: > > send_rtmsg: action 1, prefix 179.62.148.0/24: No buffer space available > send_rtmsg: action 1, prefix 176.59.72.0/23: No buffer space available > send_rtmsg: action 1, prefix 176.59.70.0/23: No buffer space available > send_rtmsg: action 1, prefix 176.59.74.0/23: No buffer space available > send_rtmsg: action 1, prefix 185.78.92.0/22: No buffer space available > send_rtmsg: action 1, prefix 176.59.64.0/23: No buffer space available > send_rtmsg: action 1, prefix 176.59.66.0/23: No buffer space available > > ..... > > send_rtmsg: action 1, prefix 31.132.21.0/24: No buffer space available > send_rtmsg: action 1, prefix 38.94.167.0/24: No buffer space available > > then the machine crashes after having processed a few thousands prefixes. > > When using the SP (boot /bsd.sp) kernel, the issue doesn't arise. > > Do you have any pointer to solve this issue ?
Please send vmstat -m output of the affected machine. The problem is probably the multiqueue support in ixl(4) that consumes too much memory. -- :wq Claudio
