Hi All Yuriy, If you leave tests without deployment tag - they will be discovered all time
Tanya Отправлено с iPhone > 2 дек. 2013, в 13:22, Yuriy Yekovenko <[email protected]> написал(а): > > Mike, > > At the moment sanity suite contains one basic verification for heat (it was > implemented in release 3.2). So, I'm actually fine with keeping all more > complicated heat tests on Platform group. > The main question I'd want to clarify is: will heat tests be discovered by > OSTF engine in platform_tests directory if the user deploys OpenStack without > any additional components (e.g., Murano, Savanna)? > For now I'm not able to check it by myself so decided to ask you. > > Regarding " it must explicitly show that there is no required image and not > to fail in random unknown state" - yes, of course. I've added this > verification as the 1st step in the test-case. > > > Best regards, > Yuriy Yekovenko > > >> On Mon, Dec 2, 2013 at 12:13 PM, Mike Scherbakov <[email protected]> >> wrote: >> Yuriy, >> I wish to keep Sanity checks as fast as possible, and smoke is Ok to run a >> bit longer, let's say around 5 min. >> If we add any other tests which requires at least 5 min - I would consider >> this to move to Platform or even create another test run. >> >> In this particular case I would move basic Heat checks to Sanity (or Smoke >> if takes more than 15-30 sec), and add another test to Platform, which takes >> 5 min. Also, if there is no image in Glance and test depends on it, it must >> explicitly show that there is no required image and not to fail in random >> unknown state. >> >> Would this work for you? >> >> Thanks, >> >> >>> On Fri, Nov 29, 2013 at 3:02 PM, Yuriy Yekovenko <[email protected]> >>> wrote: >>> Hi All, >>> >>> I'd want to raise a question about "location" of Heat OSTF tests in Fuel >>> 4.0. >>> >>> Heat tests were added to Fuel Health Check starting from 3.2 release. In >>> that release Heat was just a dependency for Murano, so Heat tests were >>> placed in "platform_tests" directory (but not in "smoke" one). Accordingly, >>> Heat tests were displayed in Health Check tab only of Murano option was >>> selected when OpenStack was deployed. >>> >>> In Fuel 4.0 Heat is provided as independent component and is installed >>> every time OpenStack is deployed. So, Heat OSTF tests should be present on >>> Health Check tab always, not depending on Murano option. >>> I suppose it will require to move Heat tests from "platform_tests" to >>> "smoke" or some other directory (or maybe to change some other settings of >>> tests visibility). >>> >>> Also, I'd like to mention that additional Heat tests that I'm going to >>> commit take more than 5 minutes to run and one of tests (test of >>> autoscaling) requires Fedora image to be imported to Glance manually. If >>> it's not desirable to make Smoke tests so long-running, we should decide >>> where to put Heat tests and maybe to implement option for running/skipping >>> these tests. >>> >>> Please let me know what you think about it or if something is unclear in my >>> message. >>> >>> Best regards, >>> Yuriy Yekovenko >>> >>> -- >>> Mailing list: https://launchpad.net/~fuel-dev >>> Post to : [email protected] >>> Unsubscribe : https://launchpad.net/~fuel-dev >>> More help : https://help.launchpad.net/ListHelp >> >> >> >> -- >> Mike Scherbakov >> #mihgen >
-- Mailing list: https://launchpad.net/~fuel-dev Post to : [email protected] Unsubscribe : https://launchpad.net/~fuel-dev More help : https://help.launchpad.net/ListHelp
