Hi for the healthcheck, in our daily CI/CD chains, we use the Robot labels core, small, medium corresponding to a min, small, medium or full (no label) configuration of ONAP.
We consider that "small" correponds the minium acceptable quality level. it means that if one the the healthcheck tests labelled "core" or "small" is FAIL, we stop and consider the deployment as FAIL yesterday, it was the case due to Basic Multicloud-starlingx API Health Check (added 40h ago) [cid:[email protected]] Error from the Test DB 15 status "FAIL" name "Basic Multicloud-starlingx API Health Check" parent "Health-Check" text "502 != 200" elapsedtime 17 critical true starttime "20190125 14:33:55.663" endtime "20190125 14:33:55.680" At the end this new feature broke the gate and prevented to perform further VNF testing (as the deployment was considered as Fail) At the moment all the multicloud tests are considered for ONAP "small" configuration. https://git.onap.org/testsuite/tree/robot/testsuites/health-check.robot?id=ea7b4f7200dcffb9ef5ff9400841a2cc137a4e4d As this API feature is new, and until we put in place some efficient gating, which would have given some feedback to the commiter, I see several options: - consider "full" for all the new features in healthcheck until it is OK in CI/CD chains (candidate feature) - it means concretely removing any label "core", "small" or "medium" for new tests - for multicloud, keep only Ocata and Pike API for "small" configuration and set all the others API (starlingx and titaniumcloud - which are based on OpenStack) in "full" AFAIK starlinX is OpenSource, I am not sure for Titanium, non Open Source API shall be in "full" like third party VNFM drivers what is your view? Until the test is fixed, it will keep on braking our gates... /Morgan _________________________________________________________________________________________________________________________ Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration, Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci. This message and its attachments may contain confidential or privileged information that may be protected by law; they should not be distributed, used or copied without authorisation. If you have received this email in error, please notify the sender and delete this message and its attachments. As emails may be altered, Orange is not liable for messages that have been modified, changed or falsified. Thank you. -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#15168): https://lists.onap.org/g/onap-discuss/message/15168 Mute This Topic: https://lists.onap.org/mt/29539689/21656 Group Owner: [email protected] Unsubscribe: https://lists.onap.org/g/onap-discuss/unsub [[email protected]] -=-=-=-=-=-=-=-=-=-=-=-
