Re: [NOTICE] - Moving and Upgrading of Buildbot Jobs
Hi All, Dropping all cc's for this Subversion specific reply. I have created a Jira ticket to track, add any notes there. Let me know when I can proceed with the migration. Thanks https://issues.apache.org/jira/browse/INFRA-22277 On Wed, Aug 18, 2021 at 3:29 AM Daniel Shahaf wrote: > Daniel Sahlberg wrote on Tue, 17 Aug 2021 11:20 +00:00: > > Den tis 17 aug. 2021 kl 05:47 skrev Daniel Shahaf < > d...@daniel.shahaf.name>: > > > [ Correcting the list's address. Sorry for the duplicate. ] > > > > > > Daniel Shahaf wrote on Tue, 17 Aug 2021 03:44 +00:00: > > > > Gavin McDonald wrote on Sun, Aug 15, 2021 at 10:44:51 +0200: > > > > > Unless you state otherwise - your config will be moved to a new > SVN [1] or > > > > > GIT [2] area > > > > > depending on whether you primarily use SVN or GIT. > > > > > > > > > > [1] - https://svn.apache.org/repos/infra/infrastructure/buildbot2 > > > > > [2] - https://github.com/apache/infrastructure-bb2 > > > > > > > > What's the authz on [1]? Is it still @committers=rw like the old > > > > location is/was? > > > > > > > > > For those of you with nightly builds that use > ci.apache.org/projects/* - > > > > > please note that this service is deprecated and will NOT be > available going > > > > > forward. Instead, your jobs should be changed to upload to > > > > > https://nightlies.apache.org/$project/* instead. Please request > if you want > > > > > your existing content migrated over otherwise we will not do so. > > > > > > > > I assume we'd like both the build task and the past content migrated, > > > > please, to facilitate bisects down the road. Our tarballs are pretty > > > > small. If keeping them all is not an option, I assume we'd like to > keep > > > > at least some of them, say, every Nth one. > > > > > > > > Is this mail enough, or should we jira this? > > > > > > > > https://subversion.apache.org/source-code.html#nightlies > > > > It was discussed in July 2020 > > Thanks for bringing this up. I'd forgotten about that thread. > Obviously, whatever a thread consensed on has precedence over my remarks > from yesterday. > -- *Gavin McDonald* Systems Administrator ASF Infrastructure Team
Re: [NOTICE] - Moving and Upgrading of Buildbot Jobs
Daniel Sahlberg wrote on Tue, 17 Aug 2021 11:20 +00:00: > Den tis 17 aug. 2021 kl 05:47 skrev Daniel Shahaf : > > [ Correcting the list's address. Sorry for the duplicate. ] > > > > Daniel Shahaf wrote on Tue, 17 Aug 2021 03:44 +00:00: > > > Gavin McDonald wrote on Sun, Aug 15, 2021 at 10:44:51 +0200: > > > > Unless you state otherwise - your config will be moved to a new SVN [1] > > > > or > > > > GIT [2] area > > > > depending on whether you primarily use SVN or GIT. > > > > > > > > [1] - https://svn.apache.org/repos/infra/infrastructure/buildbot2 > > > > [2] - https://github.com/apache/infrastructure-bb2 > > > > > > What's the authz on [1]? Is it still @committers=rw like the old > > > location is/was? > > > > > > > For those of you with nightly builds that use ci.apache.org/projects/* - > > > > please note that this service is deprecated and will NOT be available > > > > going > > > > forward. Instead, your jobs should be changed to upload to > > > > https://nightlies.apache.org/$project/* instead. Please request if you > > > > want > > > > your existing content migrated over otherwise we will not do so. > > > > > > I assume we'd like both the build task and the past content migrated, > > > please, to facilitate bisects down the road. Our tarballs are pretty > > > small. If keeping them all is not an option, I assume we'd like to keep > > > at least some of them, say, every Nth one. > > > > > > Is this mail enough, or should we jira this? > > > > > > https://subversion.apache.org/source-code.html#nightlies > > It was discussed in July 2020 Thanks for bringing this up. I'd forgotten about that thread. Obviously, whatever a thread consensed on has precedence over my remarks from yesterday.
Re: [NOTICE] - Moving and Upgrading of Buildbot Jobs
Den tis 17 aug. 2021 kl 05:47 skrev Daniel Shahaf : > [ Correcting the list's address. Sorry for the duplicate. ] > > Daniel Shahaf wrote on Tue, 17 Aug 2021 03:44 +00:00: > > Gavin McDonald wrote on Sun, Aug 15, 2021 at 10:44:51 +0200: > > > Unless you state otherwise - your config will be moved to a new SVN > [1] or > > > GIT [2] area > > > depending on whether you primarily use SVN or GIT. > > > > > > [1] - https://svn.apache.org/repos/infra/infrastructure/buildbot2 > > > [2] - https://github.com/apache/infrastructure-bb2 > > > > What's the authz on [1]? Is it still @committers=rw like the old > > location is/was? > > > > > For those of you with nightly builds that use ci.apache.org/projects/* > - > > > please note that this service is deprecated and will NOT be available > going > > > forward. Instead, your jobs should be changed to upload to > > > https://nightlies.apache.org/$project/* instead. Please request if > you want > > > your existing content migrated over otherwise we will not do so. > > > > I assume we'd like both the build task and the past content migrated, > > please, to facilitate bisects down the road. Our tarballs are pretty > > small. If keeping them all is not an option, I assume we'd like to keep > > at least some of them, say, every Nth one. > > > > Is this mail enough, or should we jira this? > > > > https://subversion.apache.org/source-code.html#nightlies It was discussed in July 2020 in a thread started by Greg Stein ( http://mail-archives.apache.org/mod_mbox/subversion-dev/202007.mbox/%3CCABD8fLVBXN511AyCL1ihQH3GCNR4yYdN-uWzJ_BDfR6a7graCQ%40mail.gmail.com%3E). Greg suggested to keep only the last 7 days, later modified to last 7 distinct builds on the suggestion of Mark Phippard. Danielsh had a suggestion to also consider that they were from different months. There was a conclusion in that thread that the nightlies doesn't even generate anymore. If I'm digging in the right place, the nightlies are created by the buildbot config script ( https://svn.apache.org/repos/infra/infrastructure/buildbot/aegis/buildmaster/master1/projects/subversion.conf) however these steps were disabled by gmcdonald in r1007392 without any explaination so I don't know if it was unintentional or not. Mark suggested to delete all old nightlies (at that point +3 years, now +4 years old), but it doesn't seem that anything was done. I'm suggesting to implement Mark's idea and drop all the old nightlies. We can then proceed to discuss if we should restore the buildbot configuration that creates new nightlies (and the archival policy for these). > > > > After migration: Once everybody is off of the old Buildbot 0.8 - we > will > > > change ci.apache.org to point to the new 3.2 instance. We will also > put in > > > a redirect for ci.apache.org/projects/$project/* to point to your new > > > location at nightlies.apache.org/$project/* > > > > dev@: We may need to update the waterfall redirects in our .htaccess. > > > > Cheers, > > > > Daniel > > > > > > > Please let us know if you have any questions. Either Drew Foulks or > myself > > > will perform your migration. > > > > > > Kind Regards. > > > > > > -- > > > > > > *Gavin McDonald* > > > Systems Administrator > > > ASF Infrastructure Team > > Kind regards, Daniel Sahlberg
Re: [NOTICE] - Moving and Upgrading of Buildbot Jobs
[ Correcting the list's address. Sorry for the duplicate. ] Daniel Shahaf wrote on Tue, 17 Aug 2021 03:44 +00:00: > Gavin McDonald wrote on Sun, Aug 15, 2021 at 10:44:51 +0200: > > Unless you state otherwise - your config will be moved to a new SVN [1] or > > GIT [2] area > > depending on whether you primarily use SVN or GIT. > > > > [1] - https://svn.apache.org/repos/infra/infrastructure/buildbot2 > > [2] - https://github.com/apache/infrastructure-bb2 > > What's the authz on [1]? Is it still @committers=rw like the old > location is/was? > > > For those of you with nightly builds that use ci.apache.org/projects/* - > > please note that this service is deprecated and will NOT be available going > > forward. Instead, your jobs should be changed to upload to > > https://nightlies.apache.org/$project/* instead. Please request if you want > > your existing content migrated over otherwise we will not do so. > > I assume we'd like both the build task and the past content migrated, > please, to facilitate bisects down the road. Our tarballs are pretty > small. If keeping them all is not an option, I assume we'd like to keep > at least some of them, say, every Nth one. > > Is this mail enough, or should we jira this? > > https://subversion.apache.org/source-code.html#nightlies > > > After migration: Once everybody is off of the old Buildbot 0.8 - we will > > change ci.apache.org to point to the new 3.2 instance. We will also put in > > a redirect for ci.apache.org/projects/$project/* to point to your new > > location at nightlies.apache.org/$project/* > > dev@: We may need to update the waterfall redirects in our .htaccess. > > Cheers, > > Daniel > > > > Please let us know if you have any questions. Either Drew Foulks or myself > > will perform your migration. > > > > Kind Regards. > > > > -- > > > > *Gavin McDonald* > > Systems Administrator > > ASF Infrastructure Team >
