Hi David, I am a bit surprised as we both attended a session dealing with xtesting in Paris during the last plugfest. (http://testresults.opnfv.org/functest/functest2019/) xtesting is an old OPNFV project: https://git.opnfv.org/functest-xtesting/ I found the support used for Los Angeles ONS last year: http://testresults.opnfv.org/functest/xtesting/ But it has been used by Functest for a long time (Danube or Euphrates) and it leverages concepts (dockerization based on alpine, clean dependency management, test case abstraction) and implementations (test DB/Test API) coming from the OPNFV early ages (Serena, José or myself) but strongly consolidated by Cedric's team.
It is not a testing framework in a sense that it does not provide new test cases. It is more a Testing/CI framework simplifying the integration of upstream test cases and harmonizing the way the are processed and the way the results are collected and stored). In ONAP I referenced only the files needed to use xtesting (seen as a simple python package): https://git.onap.org/integration/tree/test/xtesting I encourage you to discuss with OPNFV Functest developers to get more information. /Morgan Le vendredi 29 mars 2019 à 11:41 -0700, David McBride a écrit : Thanks, Morgan. Sorry for my ignorance. This is obviously something that I should know more about. Is xtesting a project within ONAP? I'm not aware of such a project in OPNFV. You mentioned the OPNFV Test API, what frameworks does xtesting make use of (e.g., Functest, Yardstick, Bottlenecks)? Thanks. David On Fri, Mar 29, 2019 at 10:48 AM <[email protected]<mailto:[email protected]>> wrote: Hi David for information, the xtesting framework (from OPNFV) is already used for ONAP Gating today (pre merge checks). we use it to run the upstream ONAP healthcheck tests + model distribution tests. I also re-used this framework to implement VNF End to End tests. We shared this on the 2 last ONS (Los Angeles and Amsterdam) See https://events.linuxfoundation.org/wp-content/uploads/2017/12/LFN-Xcommunities-Testing-Morgan-Richomme-Cedric-Ollivier-Orange.pdf for details. xtesting is easy to consume (pip or docker) the results are natively pushed in a test DB through the test API (developped in OPNFV) http://testresults.opnfv.org/onap/api/v1/results?pod_name=onap_oom_gating_pod4-OPNFV-oom&last=50 I will not attend San Jose, but Cedric will be there, do not hesitate to ask him for details. I also may notice that we are running OPNFV Functest (healthcheck/smoke/benchmarking/VNF) weekly on our ONAP POD in order to trust the infrastructure...before running orchestration tests. Cedric also discussed with Akraino for the reuse of xtesting and maybe some interesting demo on ODL as well. Enjoy San Jose /Morgan Le vendredi 29 mars 2019 à 10:02 -0700, David McBride a écrit : ONAP community, OPNFV is offering an unconference session at ONS next week that I wanted to share with you. The topic is leveraging OPNFV test frameworks for use in other communities, such as ONAP. OPNFV has several test frameworks that we believe could be useful to ONAP. The question is, how do we package and deploy those test frameworks so that they are easily consumable by other communities. We would like to get input from the ONAP team and discuss ways that we may collaborate. If interested, please add your name to the session<https://wiki.lfnetworking.org/display/LN/Open+Networking+Summit+North+America+2019+-+Un-conference+Topic+Proposals#OpenNetworkingSummitNorthAmerica2019-Un-conferenceTopicProposals-LeverageOPNFVTestFrameworks>. David _________________________________________________________________________________________________________________________ Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration, Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci. This message and its attachments may contain confidential or privileged information that may be protected by law; they should not be distributed, used or copied without authorisation. If you have received this email in error, please notify the sender and delete this message and its attachments. As emails may be altered, Orange is not liable for messages that have been modified, changed or falsified. Thank you. _________________________________________________________________________________________________________________________ Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration, Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci. This message and its attachments may contain confidential or privileged information that may be protected by law; they should not be distributed, used or copied without authorisation. If you have received this email in error, please notify the sender and delete this message and its attachments. As emails may be altered, Orange is not liable for messages that have been modified, changed or falsified. Thank you. -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#16422): https://lists.onap.org/g/onap-discuss/message/16422 Mute This Topic: https://lists.onap.org/mt/30824891/21656 Mute #ons: https://lists.onap.org/mk?hashtag=ons&subid=2740164 Mute #unconference: https://lists.onap.org/mk?hashtag=unconference&subid=2740164 Mute #test: https://lists.onap.org/mk?hashtag=test&subid=2740164 Mute #opnfv: https://lists.onap.org/mk?hashtag=opnfv&subid=2740164 Group Owner: [email protected] Unsubscribe: https://lists.onap.org/g/onap-discuss/unsub [[email protected]] -=-=-=-=-=-=-=-=-=-=-=-
