Thanks, Morgan. Has xtesting been applied to other test frameworks other than Functest? What we're really looking for is a packaging and deployment solution that accommodates multiple OPNFV test frameworks. If xtesting can do that, and ONAP is already using it, then it seems like a good place to start.
David On Sun, Mar 31, 2019 at 11:27 PM <[email protected]> wrote: > Hi David, > > I am a bit surprised as we both attended a session dealing with xtesting > in Paris during the last plugfest. ( > http://testresults.opnfv.org/functest/functest2019/) > xtesting is an old OPNFV project: https://git.opnfv.org/functest-xtesting/ > I found the support used for Los Angeles ONS last year: > http://testresults.opnfv.org/functest/xtesting/ > But it has been used by Functest for a long time (Danube or Euphrates) and > it leverages concepts (dockerization based on alpine, clean dependency > management, test case abstraction) and implementations (test DB/Test API) > coming from the OPNFV early ages (Serena, José or myself) but strongly > consolidated by Cedric's team. > > It is not a testing framework in a sense that it does not provide new test > cases. > It is more a Testing/CI framework simplifying the integration of upstream > test cases and harmonizing the way the are processed and the way the > results are collected and stored). > > In ONAP I referenced only the files needed to use xtesting (seen as a > simple python package): > https://git.onap.org/integration/tree/test/xtesting > > I encourage you to discuss with OPNFV Functest developers to get more > information. > > /Morgan > > > > > Le vendredi 29 mars 2019 à 11:41 -0700, David McBride a écrit : > > Thanks, Morgan. > > Sorry for my ignorance. This is obviously something that I should know > more about. Is xtesting a project within ONAP? I'm not aware of such a > project in OPNFV. You mentioned the OPNFV Test API, what frameworks does > xtesting make use of (e.g., Functest, Yardstick, Bottlenecks)? Thanks. > > David > > On Fri, Mar 29, 2019 at 10:48 AM <[email protected]> wrote: > > Hi David > > for information, the xtesting framework (from OPNFV) is already used for > ONAP Gating today (pre merge checks). > we use it to run the upstream ONAP healthcheck tests + model distribution > tests. > I also re-used this framework to implement VNF End to End tests. > We shared this on the 2 last ONS (Los Angeles and Amsterdam) > > See > https://events.linuxfoundation.org/wp-content/uploads/2017/12/LFN-Xcommunities-Testing-Morgan-Richomme-Cedric-Ollivier-Orange.pdf > for details. > > xtesting is easy to consume (pip or docker) > the results are natively pushed in a test DB through the test API > (developped in OPNFV) > > http://testresults.opnfv.org/onap/api/v1/results?pod_name=onap_oom_gating_pod4-OPNFV-oom&last=50 > > I will not attend San Jose, but Cedric will be there, do not hesitate to > ask him for details. > > I also may notice that we are running OPNFV Functest > (healthcheck/smoke/benchmarking/VNF) weekly on our ONAP POD in order to > trust the infrastructure...before running orchestration tests. > > Cedric also discussed with Akraino for the reuse of xtesting and maybe > some interesting demo on ODL as well. > > Enjoy San Jose > > /Morgan > > Le vendredi 29 mars 2019 à 10:02 -0700, David McBride a écrit : > > ONAP community, > > OPNFV is offering an unconference session at ONS next week that I wanted > to share with you. The topic is leveraging OPNFV test frameworks for use > in other communities, such as ONAP. > > OPNFV has several test frameworks that we believe could be useful to > ONAP. The question is, how do we package and deploy those test frameworks > so that they are easily consumable by other communities. We would like to > get input from the ONAP team and discuss ways that we may collaborate. > > If interested, please add your name to the session > <https://wiki.lfnetworking.org/display/LN/Open+Networking+Summit+North+America+2019+-+Un-conference+Topic+Proposals#OpenNetworkingSummitNorthAmerica2019-Un-conferenceTopicProposals-LeverageOPNFVTestFrameworks> > . > > David > > _________________________________________________________________________________________________________________________ > > > Ce message et ses pieces jointes peuvent contenir des informations > confidentielles ou privilegiees et ne doivent donc > > pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu > ce message par erreur, veuillez le signaler > > a l'expediteur et le detruire ainsi que les pieces jointes. Les messages > electroniques etant susceptibles d'alteration, > > Orange decline toute responsabilite si ce message a ete altere, deforme ou > falsifie. Merci. > > > This message and its attachments may contain confidential or privileged > information that may be protected by law; > > they should not be distributed, used or copied without authorisation. > > If you have received this email in error, please notify the sender and delete > this message and its attachments. > > As emails may be altered, Orange is not liable for messages that have been > modified, changed or falsified. > > Thank you. > > > > _________________________________________________________________________________________________________________________ > > Ce message et ses pieces jointes peuvent contenir des informations > confidentielles ou privilegiees et ne doivent donc > pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu > ce message par erreur, veuillez le signaler > a l'expediteur et le detruire ainsi que les pieces jointes. Les messages > electroniques etant susceptibles d'alteration, > Orange decline toute responsabilite si ce message a ete altere, deforme ou > falsifie. Merci. > > This message and its attachments may contain confidential or privileged > information that may be protected by law; > they should not be distributed, used or copied without authorisation. > If you have received this email in error, please notify the sender and delete > this message and its attachments. > As emails may be altered, Orange is not liable for messages that have been > modified, changed or falsified. > Thank you. > > -- *David McBride* Release Manager, OPNFV Mobile: +1.805.276.8018 Email/Google Talk: [email protected] Skype: davidjmcbride1 IRC: dmcbride -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#16426): https://lists.onap.org/g/onap-discuss/message/16426 Mute This Topic: https://lists.onap.org/mt/30824891/21656 Mute #ons: https://lists.onap.org/mk?hashtag=ons&subid=2740164 Mute #unconference: https://lists.onap.org/mk?hashtag=unconference&subid=2740164 Mute #test: https://lists.onap.org/mk?hashtag=test&subid=2740164 Mute #opnfv: https://lists.onap.org/mk?hashtag=opnfv&subid=2740164 Group Owner: [email protected] Unsubscribe: https://lists.onap.org/g/onap-discuss/unsub [[email protected]] -=-=-=-=-=-=-=-=-=-=-=-
