On Thu, Jun 1, 2017 at 9:46 AM, Matthew Treinish <[email protected]> wrote: > On Wed, May 31, 2017 at 04:24:14PM +0000, Jeremy Stanley wrote: >> On 2017-05-31 17:18:54 +0100 (+0100), Graham Hayes wrote: >> [...] >> > Trademark programs are trademark programs - we should have a unified >> > process for all of them. Let's not make the same mistakes again by >> > creating classes of projects / programs. I do not want this to be >> > a distinction as we move forward. >> >> This I agree with. However I'll be surprised if a majority of the QA >> team disagree on this point (logistic concerns with how to curate >> this over time I can understand, but that just means they need to >> interest some people in working on a manageable solution). > > +1 I don't think anyone disagrees with this. There is a logistical concern > with the way the new proposed programs are going to be introduced. Quite > frankly it's too varied and broad and I don't think we'll have enough people > working on this space to help maintain it in the same manner. > > It's the same reason we worked on the plugin decomposition in the first place. > You can easily look at the numbers of tests to see this: > > https://raw.githubusercontent.com/mtreinish/qa-in-the-open/lca2017/tests_per_proj.png > > Which shows things before the plugin decomposition (and before the big tent) > Just > because we said we'd support all the incubated and integrated projects in > tempest > didn't mean people were contributing and/or the tests were well maintained. > > But, as I said elsewhere in this thread this is a bit too early to have the > conversation because the new interop programs don't actually exist yet.
Yes, there is no question on goal to have a unified process for all. As Jeremy, Matthew mentioned, key things here is manageability issues. We know contributors in QA are reducing cycle by cycle. I might be thinking over but I thought about QA team situation when we have around 30-40 trademark projects and all tests on Tempest repo.Personally I am ok to have tests in Tempest repo or a dedicated interop plugin repo which can be controlled by QA at some level But we need dedicated participation from interop + projects liason (I am not sure that worked well in pass but if with TC help it might work :)). I can recall that, QA team has many patches on plugin side to improve them or fix them but may of them has no active reviews or much attentions from project team. I am afraid about same case for trademark projects also. May be broad direction on trademark program and scope of it can help to imagine the quantity of programs and tests which QA teams need to maintain. -gmann > > -Matt Treinish > > __________________________________________________________________________ > OpenStack Development Mailing List (not for usage questions) > Unsubscribe: [email protected]?subject:unsubscribe > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev > __________________________________________________________________________ OpenStack Development Mailing List (not for usage questions) Unsubscribe: [email protected]?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
