On Wed, Oct 3, 2018 at 3:51 PM Dafna Ron <[email protected]> wrote: > > Hi All, > > I was reviewing the upgrade suites in ost and there are some issues that I am > seeing in the suite tests-scenarios which I want to discuss and decide the > future of. > > At it current state, I think we should remove the upgrade suite or most of > the post test-scenarios as it is not testing what it should.
Nothing at all, of what it should? Or not enough? > > The tests currently only test engine upgrade and basic sanity after the > upgrade. > This is problematic in a few ways: > > 1. upgrade should test the upgrade of rhv and not just a clean engine upgrade > (i.e host, storage, vm). This sounds to me like missing functionality, not a reason to remove it altogether. > 2. as we have limited resources I do not think that the upgrade suite should > be longer then the basic suite (and as we are currently running the basic > suite after the upgrade it is longer) How often do we run it? If it's a significant burden on the CI systems, perhaps run it only once per day, or even less. > > That brings me to question what should be essential to test in upgrade in the > CI? That's a very good question, but not sure it's related to the previous point. If you think we need more functionality, and I think I agree, open a bug. If current suite causes too much load, run it less frequently. > I would also need someone in dev to volunteer and take ownership of the > testing scenarios for upgrade - is there anyone that can help? I guess I can try looking after the current suite (mainly testing engine-setup's upgrade functionality). Not sure about new functionality (hosts, storage etc). > > Thanks, > Dafna > > > > > > > _______________________________________________ > Infra mailing list -- [email protected] > To unsubscribe send an email to [email protected] > Privacy Statement: https://www.ovirt.org/site/privacy-policy/ > oVirt Code of Conduct: > https://www.ovirt.org/community/about/community-guidelines/ > List Archives: > https://lists.ovirt.org/archives/list/[email protected]/message/IMWTTWFIGJM3OBBOO6WVFSWMGHNPLOPF/ -- Didi _______________________________________________ Infra mailing list -- [email protected] To unsubscribe send an email to [email protected] Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/[email protected]/message/GTUFYRH23OKAAEZCAQEA5BOPNSEXGBGU/
