Hoi, It could be that it's the stats-seg that is running out. I found that with >1M routes in FIB, we need a bit more memory. For our routers, startup.conf has: statseg { size 1G page-size default-hugepage per-node-counters off }
And with this: pim@nlams0:~$ vppctl show memory stats-segment Stats segment base 0x7f73e5e01000, size 1023.99m, locked, name 'stat segment' total: 1023.99M, used: 155.05M, free: 868.95M, trimmable: 831.34M free chunks 103 free fastbin blks 0 max total allocated 1023.99M And this machine has ~1.1M routes in the FIB: pim@nlams0:~$ vppctl show ip fib summary | awk '{ total += $2 } END { print total }' 925672 pim@nlams0:~$ vppctl show ip6 fib summary | awk '{ total += $2 } END { print total }' 157334 Perhaps this helps you. groet, Pim On Thu, Sep 15, 2022 at 7:48 PM Andrew Yourtchenko <ayour...@gmail.com> wrote: > Hi, > > I think you might find the thread in > https://www.mail-archive.com/vpp-dev@lists.fd.io/msg16302.html useful. > > --a > > On 15 Sep 2022, at 17:39, yxm...@case.edu wrote: > > Hello, > > I am trying to evaluate the forwarding efficiency of VPP with large > FIB/RIB, like millions of entries. > > However, the VPP crashes when inserting routing entries of more than 310k. > The exact number varies across different routing rulesets but should be > around 320k. (One test is 319,739, and another is 320,065). > Is there any limit on VPP so we cannot insert too many rules? How could we > increase the limit? > > Also, the VPP memory is insufficient for testing when inserting the > routing entries. For example, when inserting 300K routing entries, the > memory consumption is as follows (with Python API for rule installation): > > vpp# show memory main-heap > Thread 0 vpp_main > base 0x7f054b0d4000, size 1g, locked, unmap-on-destroy, name 'main heap' > page stats: page-size 4K, total 262144, mapped 170037, not-mapped 92107 > numa 0: 170037 pages, 664.21m bytes > total: 1023.99M, used: 642.88M, free: 381.12M, trimmable: 359.79M > > I am using a single-thread VPP, by the way... > > VPP could not receive more than 600K routing entries under this > configuration. Is there any way we could increase the memory that VPP could > use? > > Thanks in advance! > > > > > > > -- Pim van Pelt <p...@ipng.nl> PBVP1-RIPE - http://www.ipng.nl/
-=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#21891): https://lists.fd.io/g/vpp-dev/message/21891 Mute This Topic: https://lists.fd.io/mt/93702879/21656 Mute #vpp_papi:https://lists.fd.io/g/vpp-dev/mutehashtag/vpp_papi Mute #vapi:https://lists.fd.io/g/vpp-dev/mutehashtag/vapi Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/leave/1480452/21656/631435203/xyzzy [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-