Re: [openstack-dev] [devstack] plugin: Giving ability for plugin repo to override tempest tests

Tue, 14 Apr 2015 22:53:46 -0700

Hi,
 
We have similar situation with our stackforge/ec2-api project.
Patches in openstack repos can break our plugin.
But I don't see any possibility until our project not in OpenStack repo.
And I don't understand how plugins for tempest can help to us.
 
My thoughts is only ec2-api gating jobs(this is implemented now in our gating):
- make own tempest job with plugin definition and restrict tempest with regex 
 
but inserting regex in plugin can restrict to have several tempest jobs
and not all gating job requires tempest
 
Kind regards,
Andrey.
 
15.04.2015, 08:24, "Deepak Shetty" <[email protected]>:
Hi Stackers,
   devstack-plugin doesn't have ability to override tempest settings. Currently it only
provides a way to override localrc settings, but over time we have seen that many CI jobs
fail due to many different issues (lack of support, new tempest test enabled recently which fails for a particular backend etc) and there is no way for the plugin to override tempest tests using
its stackforge/{plugin} repo

   Recently GlusterFS hit upon a issue due to enablement of test_volume_boot_pattern test
for which we needed to skip this test (until the issue gets fixed) and sent patch [1] but it was shot down (see [1]'s comments) and hence we sent another patch to disable it using tempest regex filter to project-config [2] ) Since devstack-plugin uses common template for all 3rd party CI jobs, it becomes a bit messy to skip for backend specific only.

  It would good and ideal to have plugin be able to do the same via stackforge/{plugin} repo
that ways the CI job can be tested with the tempest changes well before it run against cinder patches.  Something liek tempest/settings in plugin repo and change devstack-gate-wrap.sh ? to source tempest regex from plugin repo and pass on to the tempest cmdline ?

Thoughts ?

thanx,
deepak


,

__________________________________________________________________________
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: [email protected]?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

__________________________________________________________________________
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: [email protected]?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Reply via email to