Morgan, I just updated the Jira ticket for this issue. I’m not sure if this is related to the memory growth issue, but I did find the reason why the vf-module unassign is failing, which is most likely a tuning problem (related to what’s called a CircuitBreaker timeout in akka). If you can please rerun that test, I’d like to keep an eye on memory and on the logs as it occurs to see if we can see a clear correlation between the vf-module unassign failure and the memory issue.
The file that needs to be updated for that tuning change is already being provided as part of our OOM configuration. So, I believe I should be able to edit the SDNC stateful set to make those tuning changes so that we can make those changes in the lab and see if that clears the memory issue. Dan From: "TIMONEY, DAN" <dt5...@att.com> Date: Thursday, January 7, 2021 at 8:17 AM To: "morgan.richo...@orange.com" <morgan.richo...@orange.com>, onap-discuss <onap-discuss@lists.onap.org> Cc: Ali Akbar Hemmati <hemmati.al...@gmail.com> Subject: Re: [ONAP] [Azure Staging lab] lab reinstallation completed Morgan, Thanks! I confirmed that I’m able to get to that lab. Yes, if you could please launch that basic_vm test in a loop to recreate that error, I’d appreciate it. I took a quick look and I see that we’re already getting quite a few log errors, but I’m not seeing that memory spike – or at least I’m not seeing it with kubectl top (which I’d imagine would be the same data you’re seeing). If you can let me know when that’s started, I’ll get on and try to keep an eye to see if I can see what’s happening as its happening. Thanks! Dan From: "morgan.richo...@orange.com" <morgan.richo...@orange.com> Date: Tuesday, January 5, 2021 at 11:41 AM To: onap-discuss <onap-discuss@lists.onap.org> Cc: "TIMONEY, DAN" <dt5...@att.com>, Ali Akbar Hemmati <hemmati.al...@gmail.com> Subject: [ONAP] [Azure Staging lab] lab reinstallation completed Hi for information the ONAP staging lab on Azure has been successfully re-installed. https://logs.onap.org/onap-integration/daily/onap_oom_staging_azure_1/01-05-2021_13-01/<https://urldefense.com/v3/__https:/logs.onap.org/onap-integration/daily/onap_oom_staging_azure_1/01-05-2021_13-01/__;!!BhdT!wh5A5xA6gQ4UNU_KY9yuvhuc2uutPlcQFz1pSjoXgfJeC1XVYQal67nZZgs5YA$> all the tests except 1 part of cmpv2 were OK. The versions of the different dockers is given in the page: https://logs.onap.org/onap-integration/daily/onap_oom_staging_azure_1/01-05-2021_13-01/infrastructure-healthcheck/k8s/kubernetes-status/versions.html<https://urldefense.com/v3/__https:/logs.onap.org/onap-integration/daily/onap_oom_staging_azure_1/01-05-2021_13-01/infrastructure-healthcheck/k8s/kubernetes-status/versions.html__;!!BhdT!wh5A5xA6gQ4UNU_KY9yuvhuc2uutPlcQFz1pSjoXgfJeC1XVYQal67mS365P3Q$> ALl the existing keys have been re-pushed, you shall then be able to reconnect to this lab as usual ssh -i <your key> cl...@staging-1-onap.francecentral.cloudapp.azure.com @Dan You should have access to this lab (your key was already referenced) I usually reinstall this lab every week and it is a shared lab but it is not forbidden to run stability tests Do you want me to launch the basic_vm in loop in order to reproduce the error on SDNC after several hours this week? I can set up the env and run that tomorrow if you want. /Morgan _________________________________________________________________________________________________________________________ Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration, Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci. This message and its attachments may contain confidential or privileged information that may be protected by law; they should not be distributed, used or copied without authorisation. If you have received this email in error, please notify the sender and delete this message and its attachments. As emails may be altered, Orange is not liable for messages that have been modified, changed or falsified. Thank you. -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#22703): https://lists.onap.org/g/onap-discuss/message/22703 Mute This Topic: https://lists.onap.org/mt/79453866/21656 Group Owner: onap-discuss+ow...@lists.onap.org Unsubscribe: https://lists.onap.org/g/onap-discuss/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
