[openstack-dev] [qa] [Solum] [tempest] Use of pecan test framework in functional tests

2013-12-10 Thread Georgy Okrokvertskhov
Hi, In Solum project we are currently creating tests environments for future test. We split unit tests and functional tests in order to use tempest framework from the beginning. Tempest framework assumes that you run your service and test APi endpoints by sending HTTP requests. Solum uses Pecan

Re: [openstack-dev] [qa] [Solum] [tempest] Use of pecan test framework in functional tests

2013-12-10 Thread Russell Bryant
On 12/10/2013 04:10 PM, Georgy Okrokvertskhov wrote: Hi, In Solum project we are currently creating tests environments for future test. We split unit tests and functional tests in order to use tempest framework from the beginning. Tempest framework assumes that you run your service and

Re: [openstack-dev] [qa] [Solum] [tempest] Use of pecan test framework in functional tests

2013-12-10 Thread Ryan Petrello
My opinion is that there’s value in both. Writing functional tests for Solum’s test suite using WebTest can be pretty useful for testing the API’s logic without having to involve HTTP (to e.g., call API endpoints with certain POST arguments and assert that certain mocked functions end up being

Re: [openstack-dev] [qa] [Solum] [tempest] Use of pecan test framework in functional tests

2013-12-10 Thread David Kranz
On 12/10/2013 04:12 PM, Russell Bryant wrote: On 12/10/2013 04:10 PM, Georgy Okrokvertskhov wrote: Hi, In Solum project we are currently creating tests environments for future test. We split unit tests and functional tests in order to use tempest framework from the beginning. Tempest

Re: [openstack-dev] [qa] [Solum] [tempest] Use of pecan test framework in functional tests

2013-12-10 Thread Sean Dague
Pretty much 100% agree with Russell and Ryan. Webtest is interesting for in tree testing with Solum, because it's specifically *not* bringing up the full stack. When it comes to Tempest, you are hitting a live OpenStack cloud, most likely not on the same machine as Tempest is on (not true in the

Re: [openstack-dev] [qa] [Solum] [tempest] Use of pecan test framework in functional tests

2013-12-10 Thread Georgy Okrokvertskhov
Thanks everyone for feedback. Will follow the standard approach with HTTP requests in tempest tests. Thanks Georgy On Tue, Dec 10, 2013 at 2:47 PM, Sean Dague s...@dague.net wrote: Pretty much 100% agree with Russell and Ryan. Webtest is interesting for in tree testing with Solum, because

Re: [openstack-dev] [qa] [Solum] [tempest] Use of pecan test framework in functional tests

2013-12-10 Thread Adrian Otto
On Dec 10, 2013, at 3:12 PM, Russell Bryant rbry...@redhat.com wrote: On 12/10/2013 04:10 PM, Georgy Okrokvertskhov wrote: Hi, In Solum project we are currently creating tests environments for future test. We split unit tests and functional tests in order to use tempest framework from the