Hi Sudhir, Is your issue resolved?
Actually we are facing same issue on vpp.2106. In our case "api-rx-ring" is not getting called. in our usecase workers are calling some functions in main-thread context leading to RPC message and memory is allocated from api section. This leads to Api-segment memory is used fully and leads to crash. Thanks, Chetan On Mon, Feb 20, 2023, 18:24 Sudhir CR via lists.fd.io <sudhir= rtbrick....@lists.fd.io> wrote: > Hi Dave, > Thank you very much for your inputs. I will try this out and get back to > you with the results. > > Regards, > Sudhir > > On Mon, Feb 20, 2023 at 6:01 PM Dave Barach <v...@barachs.net> wrote: > >> Please try something like this, to eliminate the possibility that some >> bit of code is sending this process an event. It’s not a good idea to skip >> the vec_reset_length (event_data) step. >> >> >> >> while (1) >> >> { >> >> uword event_type, * event_data = 0; >> >> int i; >> >> >> >> vlib_process_wait_for_event_or_clock (vm, 1e-2 /* 10 ms */); >> >> >> >> event_type = vlib_process_get_events (vm, &event_data); >> >> >> >> switch (event_type) { >> >> case ~0: /* handle timer expirations */ >> >> rtb_event_loop_run_once (); >> >> break; >> >> >> >> default: /* bug! */ >> >> ASSERT (0); >> >> } >> >> >> >> vec_reset_length(event_data); >> >> } >> >> >> >> *From:* vpp-dev@lists.fd.io <vpp-dev@lists.fd.io> *On Behalf Of *Sudhir >> CR via lists.fd.io >> *Sent:* Monday, February 20, 2023 4:02 AM >> *To:* vpp-dev@lists.fd.io >> *Subject:* Re: [vpp-dev] process node suspended indefinitely >> >> >> >> Hi Dave, >> Thank you for your response and help. >> >> >> >> Please find the additional details below. >> >> VPP Version *21.10* >> >> >> We are creating a process node* rtb-vpp-epoll-process *to handle control >> plane events like interface add/delete, route add/delete. >> This process node waits for *10ms* of time (Not Interested in any events >> ) once 10ms is expired it will process control plane events mentioned above. >> >> code snippet looks like below >> >> >> >> ``` >> >> static uword >> rtb_vpp_epoll_process (vlib_main_t *vm, >> vlib_node_runtime_t *rt, >> vlib_frame_t *f) >> { >> >> ... >> ... >> while (1) { >> vlib_process_wait_for_event_or_clock (vm, 10e-3); >> vlib_process_get_events (vm, NULL); >> >> rtb_event_loop_run_once(); *<---- controlplane events handling* >> >> } >> } >> ``` >> >> What we observed is that sometimes (when there is a high controlplane >> load like request to install more routes) "rtb-vpp-epoll-process" is >> suspended and not scheduled furever. this we found by using "show runtime >> rtb-vpp-epoll-process"* (*in "show runtime rtb-vpp-epoll-process" >> command output suspends counter is not incrementing.) >> >> *show runtime output in working case :* >> >> >> ``` >> DBGvpp# show runtime rtb-vpp-epoll-process >> Name State Calls Vectors >> *Suspends* Clocks Vectors/Call >> rtb-vpp-epoll-process any wait 0 >> 0 *192246* 1.91e6 0.00 >> DBGvpp# >> >> DBGvpp# show runtime rtb-vpp-epoll-process >> Name State Calls Vectors >> *Suspends* Clocks Vectors/Call >> rtb-vpp-epoll-process any wait 0 >> 0 *193634* 1.89e6 0.00 >> DBGvpp# >> >> ``` >> >> >> *show runtime output in issue case :```* >> >> DBGvpp# show runtime rtb-vpp-epoll-process >> >> Name State Calls Vectors >> *Suspends* Clocks Vectors/Call >> >> rtb-vpp-epoll-process any wait 0 0 >> *81477* 7.08e6 0.00 >> >> DBGvpp# show runtime rtb-vpp-epoll-process >> >> Name State Calls Vectors >> *Suspends * Clocks Vectors/Call >> >> rtb-vpp-epoll-process any wait 0 0 >> *81477* 7.08e6 0.00 >> >> *```* >> >> Other process nodes like lldp-process, >> ip4-neighbor-age-process, ip6-ra-process running without any issue. only >> "rtb-vpp-epoll-process" process node suspended forever. >> >> >> >> Please let me know if any additional information is required. >> >> Hi Jinsh, >> Thanks for pointing me to the issue you faced. The issue I am facing >> looks similar. >> I will verify with the given patch. >> >> >> Thanks and Regards, >> >> Sudhir >> >> >> >> On Sun, Feb 19, 2023 at 6:19 AM jinsh11 <jins...@chinatelecom.cn> wrote: >> >> HI: >> >> >> - I have the same problem, >> >> bfd process node stop running. I raised this issue, >> >> https://lists.fd.io/g/vpp-dev/message/22380 >> I think there is a problem with the porcess scheduling module when using >> the time wheel. >> >> >> >> >> >> NOTICE TO RECIPIENT This e-mail message and any attachments are >> confidential and may be privileged. If you received this e-mail in error, >> any review, use, dissemination, distribution, or copying of this e-mail is >> strictly prohibited. Please notify us immediately of the error by return >> e-mail and please delete this message from your system. For more >> information about Rtbrick, please visit us at www.rtbrick.com >> >> >> >> > NOTICE TO RECIPIENT This e-mail message and any attachments are > confidential and may be privileged. If you received this e-mail in error, > any review, use, dissemination, distribution, or copying of this e-mail is > strictly prohibited. Please notify us immediately of the error by return > e-mail and please delete this message from your system. For more > information about Rtbrick, please visit us at www.rtbrick.com > > > >
-=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#22658): https://lists.fd.io/g/vpp-dev/message/22658 Mute This Topic: https://lists.fd.io/mt/97032803/21656 Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/leave/1480452/21656/631435203/xyzzy [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-