Hoi,

It could be that it's the stats-seg that is running out. I found that with
>1M routes in FIB, we need a bit more memory. For our routers, startup.conf
has:
statseg {
  size 1G
  page-size default-hugepage
  per-node-counters off
}

And with this:
pim@nlams0:~$ vppctl show memory stats-segment
Stats segment
base 0x7f73e5e01000, size 1023.99m, locked, name 'stat segment'
  total: 1023.99M, used: 155.05M, free: 868.95M, trimmable: 831.34M
    free chunks 103 free fastbin blks 0
    max total allocated 1023.99M

And this machine has ~1.1M routes in the FIB:
pim@nlams0:~$ vppctl show ip fib summary | awk '{ total += $2 } END { print
total }'
925672
pim@nlams0:~$ vppctl show ip6 fib summary | awk '{ total += $2 } END {
print total }'
157334

Perhaps this helps you.

groet,
Pim


On Thu, Sep 15, 2022 at 7:48 PM Andrew Yourtchenko <ayour...@gmail.com>
wrote:

> Hi,
>
> I think you might find the thread in
> https://www.mail-archive.com/vpp-dev@lists.fd.io/msg16302.html useful.
>
> --a
>
> On 15 Sep 2022, at 17:39, yxm...@case.edu wrote:
>
> Hello,
>
> I am trying to evaluate the forwarding efficiency of VPP with large
> FIB/RIB, like millions of entries.
>
> However, the VPP crashes when inserting routing entries of more than 310k.
> The exact number varies across different routing rulesets but should be
> around 320k. (One test is 319,739, and another is 320,065).
> Is there any limit on VPP so we cannot insert too many rules? How could we
> increase the limit?
>
> Also, the VPP memory is insufficient for testing when inserting the
> routing entries. For example, when inserting 300K routing entries, the
> memory consumption is as follows (with Python API for rule installation):
>
> vpp# show memory main-heap
> Thread 0 vpp_main
>   base 0x7f054b0d4000, size 1g, locked, unmap-on-destroy, name 'main heap'
>     page stats: page-size 4K, total 262144, mapped 170037, not-mapped 92107
>       numa 0: 170037 pages, 664.21m bytes
>     total: 1023.99M, used: 642.88M, free: 381.12M, trimmable: 359.79M
>
> I am using a single-thread VPP, by the way...
>
> VPP could not receive more than 600K routing entries under this
> configuration. Is there any way we could increase the memory that VPP could
> use?
>
> Thanks in advance!
>
>
>
>
> 
>
>

-- 
Pim van Pelt <p...@ipng.nl>
PBVP1-RIPE - http://www.ipng.nl/
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#21891): https://lists.fd.io/g/vpp-dev/message/21891
Mute This Topic: https://lists.fd.io/mt/93702879/21656
Mute #vpp_papi:https://lists.fd.io/g/vpp-dev/mutehashtag/vpp_papi
Mute #vapi:https://lists.fd.io/g/vpp-dev/mutehashtag/vapi
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/leave/1480452/21656/631435203/xyzzy 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Reply via email to