On 03/17/2014 03:22 PM, Joe Gordon wrote: > > > > On Mon, Mar 17, 2014 at 11:55 AM, Matthew Treinish <[email protected] > <mailto:[email protected]>> wrote: > > Hi everyone, > > So a little while ago we noticed that in all the gate runs one of > the ceilometer > cli tests is consistently in the list of slowest tests. (and often > the slowest) > This was a bit surprising given the nature of the cli tests we > expect them to > execute very quickly. > > test_ceilometer_resource_list which just calls ceilometer > resource_list from the > CLI once is taking >=2 min to respond. For example: > > http://logs.openstack.org/68/80168/3/gate/gate-tempest-dsvm-postgres-full/07ab7f5/logs/tempest.txt.gz#_2014-03-17_17_08_25_003 > (where it takes > 3min) > > The cli tests are supposed to be quick read-only sanity checks of > the cli > functionality and really shouldn't ever be on the list of slowest > tests for a > gate run. I think there was possibly a performance regression > recently in > ceilometer because from I can tell this test used to normally take > ~60 sec. > (which honestly is probably too slow for a cli test too) but it is > currently > much slower than that. > > > Sounds like we should add another round of sanity checking to the CLI > tests: make sure all commands return within x seconds. As a first pass > we can say x=60 and than crank it down in the future.
So, the last thing I want to do is trigger a race here by us
artificially timing out on tests. However I do think cli tests should be
returning in < 2s otherwise they are not simple readonly tests.
-Sean
--
Sean Dague
Samsung Research America
[email protected] / [email protected]
http://dague.net
signature.asc
Description: OpenPGP digital signature
_______________________________________________ OpenStack-dev mailing list [email protected] http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
