I nearly opened a spec for this, but I'd really like to get some feedback 
first. One of the challenges I've seen lately for Nova teams not using KVM or 
Xen (Ironic and LXC are just a few) is how to properly run the subset of 
Compute tests that will run for their hypervisor or driver. Regexes are what 
Ironic went with, but I'm not sure how well that will work long term since it's 
very much dependent on naming conventions. The good thing is that the 
capabilities for each hypervisor/driver are well defined 
(https://wiki.openstack.org/wiki/HypervisorSupportMatrix), so it's just a 
matter of how to convey that information. I see a few ways forward from here:


1.       Expand the compute_features_group config section to include all 
Compute actions and make sure all tests that require specific capabilities have 
skipIfs or raise a skipException. This options seems it would require the least 
work within Tempest, but the size of the config will continue to grow as more 
Nova actions are added.

2.       Create a new decorator class like was done with service tags that 
defines what drivers the test does or does not work for, and have the 
definitions of the different driver capabilities be referenced by the 
decorator. This is nice because it gets rid of the config creep, but it's also 
yet another decorator, which may not be desirable.

I'm going to continue working through both of these possibilities, but any 
feedback either solution would be appreciated.

Daryl


_______________________________________________
OpenStack-dev mailing list
[email protected]
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Reply via email to