On Mon, 2 Nov 2020 22:44:07 -0500 Matt Turner <matts...@gentoo.org> wrote:
> The catalyst-auto automation scripts live in a repo separate from > catalyst. That increases the difficulty of changing catalyst's > interface, and it doesn't seem to offer any advantages otherwise. > (Keeping build specs in a separate repo allows them to be updated > independent of catalyst and that is valuable). Additionally, since the > primary way catalyst is used is via this automation, it makes sense to > support this workflow in catalyst directly. > > But to get there, there are some changes to catalyst that I think are > improvements on their own and simplify the path to integrating > automation capabilities directly into catalyst. That's what I'd like > to discuss here. > I have been thinking for the past few years that the automation could benefit from using a buildbot to run the stages. In that way it would set the required variables, run the stages in sequence. Upon failure, buildbot makes it easy to re-run failed steps from where they left off. Or initiate unscheduled builds. It also makes it easy to see detailed logs (by anyone with a browser if the buildbot is public viewable) of the various steps for debugging, etc.. Perhaps with your new spec file, you add a varialbe that lists the stages to run in sequence. In that way it would preserve the old capability of running single stages independantly or a full sequence. Or perhaps a cli option to override the setting on an unedited spec file. ie: [build.stages] stage1 stage2 stage3 livecd1 livecd2 sorry, not familiar with toml In that way a spec file could be edited simply to restart from any point with a single variable edit without removing unused [build.???] definitions for the full run. This would be particularly useful when troubleshooting hidden/delayed stage build fails. Overall, I do agree that the releng automation scripts capabilities should be part of the caltlyst repo in order for them to be up-to-date with catalyst code. I have limited time and resources lately, so can't help out much until I get back home (probably Xmas) largely due to covid... I only have this small laptop and my eyes are not that good to be doing lots of work on a tiny 14 inch screen and a stage run to take hours instead of minutes... (yes, I got spoiled with 2 28 inch 4K displays, 16-core 128k ram system at home...) Brian Dolbec <dol...@gentoo.org>
