Hi, I am currently experiencing an issue with VPP where the service continuously restarts with the error attached below. At the moment, I am still investigating the root cause and am unsure why this behavior is occurring.
For reference, I also have another device running the same VPP version without any issues. However, there is a difference in the FRR version and hardware platform between the two devices. To provide better context, I have included the specifications below. *Affected Device* * VPP Version: 25.02 * FRR Version: 9.1.3 * CPU: Intel(R) Xeon(R) Gold 6338N *Working Device* * VPP Version: 25.02 * FRR Version: 9.1.2 * CPU: AMD EPYC 7542 The error I am encountering is shown below. If anyone could help explain the possible cause or provide guidance on troubleshooting this issue, I would greatly appreciate it. > > > > > vpp[15485]: vpp[15485]: received signal SIGABRT, PC 0x7fe32b0da00b > vpp[15485]: received signal SIGABRT, PC 0x7fe32b0da00b > vpp[15485]: vpp[15485]: Code: 48 8b 84 24 08 01 00 00 64 48 33 04 25 28 > 00 00 00 75 26 44 > vpp[15485]: Code: 48 8b 84 24 08 01 00 00 64 48 33 04 25 28 00 00 00 75 > 26 44 > vpp[15485]: vpp[15485]: #0 0x00007fe32b0da00b gsignal + 0xcb > vpp[15485]: vpp[15485]: from /lib/x86_64-linux-gnu/libc.so.6 > vpp[15485]: #0 0x00007fe32b0da00b gsignal + 0xcb > vpp[15485]: from /lib/x86_64-linux-gnu/libc.so.6 > vpp[15485]: vpp[15485]: #1 0x00007fe32b0b9859 abort + 0x12b > vpp[15485]: vpp[15485]: from /lib/x86_64-linux-gnu/libc.so.6 > vpp[15485]: #1 0x00007fe32b0b9859 abort + 0x12b > vpp[15485]: vpp[15485]: #2 0x0000000000406a50 os_panic + 0x10 > vpp[15485]: vpp[15485]: from /usr/bin/vpp > vpp[15485]: from /lib/x86_64-linux-gnu/libc.so.6 > vpp[15485]: #2 0x0000000000406a50 os_panic + 0x10 > vpp[15485]: from /usr/bin/vpp > vpp[15485]: vpp[15485]: #3 0x00007fe32b42eb26 > clib_mem_heap_realloc_aligned + 0x3f6 > vpp[15485]: vpp[15485]: from > /lib/x86_64-linux-gnu/libvppinfra.so.25.02.0 > vpp[15485]: #3 0x00007fe32b42eb26 clib_mem_heap_realloc_aligned + 0x3f6 > vpp[15485]: from /lib/x86_64-linux-gnu/libvppinfra.so.25.02.0 > vpp[15485]: vpp[15485]: #4 0x00007fe32b46bab9 _vec_realloc_internal + > 0x89 > vpp[15485]: vpp[15485]: from > /lib/x86_64-linux-gnu/libvppinfra.so.25.02.0 > vpp[15485]: #4 0x00007fe32b46bab9 _vec_realloc_internal + 0x89 > vpp[15485]: from /lib/x86_64-linux-gnu/libvppinfra.so.25.02.0 > vpp[15485]: vpp[15485]: #5 0x00007fe32b55f576 vlib_stats_validate + 0x5d6 > > vpp[15485]: vpp[15485]: from /lib/x86_64-linux-gnu/libvlib.so.25.02.0 > > vpp[15485]: #5 0x00007fe32b55f576 vlib_stats_validate + 0x5d6 > vpp[15485]: from /lib/x86_64-linux-gnu/libvlib.so.25.02.0 > vpp[15485]: vpp[15485]: #6 0x00007fe32b4fdaf6 > vlib_validate_combined_counter + 0x56 > vpp[15485]: vpp[15485]: from /lib/x86_64-linux-gnu/libvlib.so.25.02.0 > > vpp[15485]: #6 0x00007fe32b4fdaf6 vlib_validate_combined_counter + 0x56 > vpp[15485]: from /lib/x86_64-linux-gnu/libvlib.so.25.02.0 > vpp[15485]: vpp[15485]: #7 0x00007fe32c07a513 load_balance_create + 0x353 > > vpp[15485]: vpp[15485]: from /lib/x86_64-linux-gnu/libvnet.so.25.02.0 > > vpp[15485]: #7 0x00007fe32c07a513 load_balance_create + 0x353 > vpp[15485]: from /lib/x86_64-linux-gnu/libvnet.so.25.02.0 > vpp[15485]: #8 0x00007fe32c057404 fib_entry_src_mk_lb + 0x264 > vpp[15485]: vpp[15485]: #8 0x00007fe32c057404 fib_entry_src_mk_lb + 0x264 > > vpp[15485]: vpp[15485]: from /lib/x86_64-linux-gnu/libvnet.so.25.02.0 > > vpp[15485]: vpp[15485]: #9 0x00007fe32c057785 > fib_entry_src_action_install + 0x45 > vpp[15485]: vpp[15485]: from /lib/x86_64-linux-gnu/libvnet.so.25.02.0 > > vpp[15485]: vpp[15485]: #10 0x00007fe32c057ec3 > fib_entry_src_action_activate + 0x1d3 > vpp[15485]: vpp[15485]: from /lib/x86_64-linux-gnu/libvnet.so.25.02.0 > > vpp[15485]: vpp[15485]: #11 0x00007fe32c054140 fib_entry_create + 0x70 > vpp[15485]: vpp[15485]: from /lib/x86_64-linux-gnu/libvnet.so.25.02.0 > > vpp[15485]: vpp[15485]: #12 0x00007fe32c04a739 fib_table_entry_path_add2 + > 0x1c9 > vpp[15485]: vpp[15485]: from /lib/x86_64-linux-gnu/libvnet.so.25.02.0 > > vpp[15485]: vpp[15485]: #13 0x00007fdf2798920e > vpp[15485]: vpp[15485]: from > /usr/lib/x86_64-linux-gnu/vpp_plugins/linux_nl_plugin.so > vpp[15485]: vpp[15485]: #14 0x00007fdf279927e6 > vpp[15485]: vpp[15485]: from > /usr/lib/x86_64-linux-gnu/vpp_plugins/linux_nl_plugin.so > vpp[15485]: vpp[15485]: #15 0x00007fdf27a20f52 nl_cb_overwrite_send + 0x22 > > vpp[15485]: vpp[15485]: from /lib/x86_64-linux-gnu/libnl-3.so.200 > vpp[15485]: vpp[15485]: #16 0x00007fdf279e0419 > rtnl_qdisc_tbf_get_peakrate_cell + 0xc9 > vpp[15485]: vpp[15485]: from > /lib/x86_64-linux-gnu/libnl-route-3.so.200 > vpp[15485]: vpp[15485]: #17 0x00007fdf27a1db52 nl_cache_parse + 0x62 > vpp[15485]: vpp[15485]: from /lib/x86_64-linux-gnu/libnl-3.so.200 > vpp[15485]: vpp[15485]: #18 0x00007fdf27a22984 nl_msg_parse + 0x84 > vpp[15485]: vpp[15485]: from /lib/x86_64-linux-gnu/libnl-3.so.200 > vpp[15485]: vpp[15485]: #19 0x00007fdf27991b33 > vpp[15485]: vpp[15485]: from > /usr/lib/x86_64-linux-gnu/vpp_plugins/linux_nl_plugin.so > vpp[15485]: vpp[15485]: #20 0x00007fe32b519e27 vlib_exit_with_status + > 0x527 > vpp[15485]: vpp[15485]: from /lib/x86_64-linux-gnu/libvlib.so.25.02.0 > > vpp[15485]: vpp[15485]: #21 0x00007fe32b428ea8 clib_calljmp + 0x18 > vpp[15485]: vpp[15485]: from > /lib/x86_64-linux-gnu/libvppinfra.so.25.02.0 > vpp[15485]: from /lib/x86_64-linux-gnu/libvnet.so.25.02.0 > vpp[15485]: #9 0x00007fe32c057785 fib_entry_src_action_install + 0x45 > vpp[15485]: from /lib/x86_64-linux-gnu/libvnet.so.25.02.0 > vpp[15485]: #10 0x00007fe32c057ec3 fib_entry_src_action_activate + 0x1d3 > vpp[15485]: from /lib/x86_64-linux-gnu/libvnet.so.25.02.0 > vpp[15485]: #11 0x00007fe32c054140 fib_entry_create + 0x70 > vpp[15485]: from /lib/x86_64-linux-gnu/libvnet.so.25.02.0 > vpp[15485]: #12 0x00007fe32c04a739 fib_table_entry_path_add2 + 0x1c9 > vpp[15485]: from /lib/x86_64-linux-gnu/libvnet.so.25.02.0 > vpp[15485]: #13 0x00007fdf2798920e > vpp[15485]: from > /usr/lib/x86_64-linux-gnu/vpp_plugins/linux_nl_plugin.so > vpp[15485]: #14 0x00007fdf279927e6 > vpp[15485]: from > /usr/lib/x86_64-linux-gnu/vpp_plugins/linux_nl_plugin.so > vpp[15485]: #15 0x00007fdf27a20f52 nl_cb_overwrite_send + 0x22 > vpp[15485]: from /lib/x86_64-linux-gnu/libnl-3.so.200 > vpp[15485]: #16 0x00007fdf279e0419 rtnl_qdisc_tbf_get_peakrate_cell + 0xc9 > > vpp[15485]: from /lib/x86_64-linux-gnu/libnl-route-3.so.200 > vpp[15485]: #17 0x00007fdf27a1db52 nl_cache_parse + 0x62 > vpp[15485]: from /lib/x86_64-linux-gnu/libnl-3.so.200 > vpp[15485]: #18 0x00007fdf27a22984 nl_msg_parse + 0x84 > vpp[15485]: from /lib/x86_64-linux-gnu/libnl-3.so.200 > vpp[15485]: #19 0x00007fdf27991b33 > vpp[15485]: from > /usr/lib/x86_64-linux-gnu/vpp_plugins/linux_nl_plugin.so > vpp[15485]: #20 0x00007fe32b519e27 vlib_exit_with_status + 0x527 > vpp[15485]: from /lib/x86_64-linux-gnu/libvlib.so.25.02.0 > vpp[15485]: #21 0x00007fe32b428ea8 clib_calljmp + 0x18 > vpp[15485]: from /lib/x86_64-linux-gnu/libvppinfra.so.25.02.0 > systemd[1]: vpp.service: Main process exited, code=dumped, status=6/ABRT > systemd[1]: vpp.service: Failed with result 'core-dump'. > systemd[1]: vpp.service: Scheduled restart job, restart counter is at 1. > systemd[1]: Stopped vector packet processing engine. > systemd[1]: Starting vector packet processing engine... > systemd[1]: Started vector packet processing engine. > vpp[15928]: unix_config:461: couldn't open log '/var/log/vpp/vpp.log' > vpp[15928]: vpp[15928]: perfmon: skipping source 'intel-uncore' - > intel_uncore_init: no uncore units found > vpp[15928]: perfmon: skipping source 'intel-uncore' - intel_uncore_init: > no uncore units found > vpp[15928]: vpp[15928]: vat-plug/load: vat_plugin_register: oddbuf plugin > not loaded... > vpp[15928]: vat-plug/load: vat_plugin_register: oddbuf plugin not > loaded... > vpp[15928]: vpp[15928]: vat-plug/load: vat_plugin_register: idpf plugin > not loaded... > vpp[15928]: vat-plug/load: vat_plugin_register: idpf plugin not loaded... > vpp[15928]: vpp[15928]: dpdk: rte_eth_xstats_get(3) returned 105/73 stats. > Resetting counters. > vpp[15928]: dpdk: rte_eth_xstats_get(3) returned 105/73 stats. Resetting > counters. > vpp[15928]: vpp[15928]: dpdk: rte_eth_xstats_get(4) returned 105/73 stats. > Resetting counters. > vpp[15928]: dpdk: rte_eth_xstats_get(4) returned 105/73 stats. Resetting > counters. > > > > Thank you in advance for your assistance. - Excel
-=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#27074): https://lists.fd.io/g/vpp-dev/message/27074 Mute This Topic: https://lists.fd.io/mt/119935551/21656 Group Owner: [email protected] Unsubscribe: https://lists.fd.io/g/vpp-dev/leave/14379924/21656/631435203/xyzzy [[email protected]] -=-=-=-=-=-=-=-=-=-=-=-
