On 08/28/2014 11:14 AM, Doug Hellmann wrote: > Before Juno we set a deprecation policy for graduating libraries that said > the incubated versions of the modules would stay in the incubator repository > for one full cycle after graduation. This gives projects time to adopt the > libraries and still receive bug fixes to the incubated version (see > https://wiki.openstack.org/wiki/Oslo#Graduation). > > That policy worked well early on, but has recently introduced some challenges > with the low level modules. Other modules in the incubator are still > importing the incubated versions of, for example, timeutils, and so tests > that rely on mocking out or modifying the behavior of timeutils do not work > as expected when different parts of the application code end up calling > different versions of timeutils. We had similar issues with the notifiers and > RPC code, and I expect to find other cases as we continue with the > graduations. > > To deal with this problem, I propose that for Kilo we delete graduating > modules as soon as the new library is released, rather than waiting to the > end of the cycle. We can update the other incubated modules at the same time, > so that the incubator will always use the new libraries and be consistent.
So from a consumer perspective, this means projects will need to sync from stable/juno until they adopt the new libs and then they need to sync from master, which will also be using the new libs. One thing I think is worth noting is the fact that this will require projects to adopt all of the libs at once (or at least all of the libs that need to match incubator, but that's not always obvious so probably safest to just say "all"). It might be possible to sync some modules from master and some from stable, but that sounds like a mess waiting to happen. :-) I guess my concern here is that I don't think projects have been adopting all of the oslo libs at once, so if, for example, a project was looking at adopting oslo.i18n and oslo.utils they may have to do both at the same time since adopting one will require them to start syncing from master, and then they won't have the ability to use the graduated modules anymore. This may be a necessary evil, but it does raise the short-term bar for adopting any oslo lib, even if the end result will be the same (all of the released libs adopted). > > We have not had a lot of patches where backports were necessary, but there > have been a few important ones, so we need to retain the ability to handle > them and allow projects to adopt libraries at a reasonable pace. To handle > backports cleanly, we can “freeze” all changes to the master branch version > of modules slated for graduation during Kilo (we would need to make a good > list very early in the cycle), and use the stable/juno branch for backports. > > The new process would be: > > 1. Declare which modules we expect to graduate during Kilo. > 2. Changes to those pre-graduation modules could be made in the master branch > before their library is released, as long as the change is also backported to > the stable/juno branch at the same time (we should enforce this by having > both patches submitted before accepting either). > 3. When graduation for a library starts, freeze those modules in all branches > until the library is released. > 4. Remove modules from the incubator’s master branch after the library is > released. > 5. Land changes in the library first. > 6. Backport changes, as needed, to stable/juno instead of master. > > It would be better to begin the export/import process as early as possible in > Kilo to keep the window where point 2 applies very short. > > If there are objections to using stable/juno, we could introduce a new branch > with a name like backports/kilo, but I am afraid having the extra branch to > manage would just cause confusion. > > I would like to move ahead with this plan by creating the stable/juno branch > and starting to update the incubator as soon as the oslo.log repository is > imported (https://review.openstack.org/116934). > > Thoughts? I think the obvious concern for me is the extra overhead of trying to keep one more branch in sync with all the others. With this we will require two commits for each change to incubator code that isn't graduating. Backporting to Havana would require four changes. I guess this is no worse than the situation with graduating code (one commit to the lib and one to incubator), but that's temporary pain for specific files. This would continue indefinitely for all files in incubator. We could probably help this by requiring changes to be linked in their commit messages so reviewers can vote on both changes at once, but it's still additional work for everyone so I think it's worth bringing up. I don't have a better solution to the incubator-lib mismatch issue so I'm okay with going forward on this, but it will introduce some new issues that I think we should be aware of going in. > > Doug > > > _______________________________________________ > OpenStack-dev mailing list > OpenStackfirstname.lastname@example.org > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev > _______________________________________________ OpenStack-dev mailing list OpenStackemail@example.com http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev