Re: Release criteria proposal: first boot experience
On Tue, Sep 1, 2020 at 10:24 PM Michael Catanzaro wrote: > Hi, > > We currently have a bug where the Online Accounts page in initial setup > is nonfunctional. [1] This doesn't violate any current release > criterion, but surely we don't want to release with a broken initial > setup experience. So let's add a new requirement for that. How about > something like: > > "If an initial setup utility is run or intended to be run after the > first boot of the installed system, then it must start successfully and > each page or panel of the initial setup utility should withstand a > basic functionality test." > > OK that's pretty basic, but it gets the point across. I think this can > be a final requirement, not necessarily important enough to be a beta > requirement. Bikeshed away! > > [1] https://bugzilla.redhat.com/show_bug.cgi?id=1870476 This criterion is now live: https://fedoraproject.org/wiki/Fedora_33_Final_Release_Criteria#First_boot_experience https://fedoraproject.org/w/index.php?title=QA%3ATestcase_base_initial_setup=revision=588239=491757 https://fedoraproject.org/w/index.php?title=Template%3ABase_test_matrix=revision=588240=581773 Thanks everyone involved. ___ test mailing list -- test@lists.fedoraproject.org To unsubscribe send an email to test-le...@lists.fedoraproject.org Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/test@lists.fedoraproject.org
Re: Release criteria proposal: first boot experience
On Mon, Sep 7, 2020 at 2:24 AM Kamil Paral wrote: > > On Fri, Sep 4, 2020 at 8:17 PM Adam Williamson > wrote: >> >> On Fri, 2020-09-04 at 12:12 -0500, Michael Catanzaro wrote: >> > On Wed, Sep 2, 2020 at 12:57 pm, Kamil Paral wrote: >> > > Overall I find the criterion reasonable and useful and I'm +1 to >> > > incorporating it. Its current phrasing seems fine to me. >> > >> > So how does the process of adding the new criterion work? I guess we >> > should leave the weekend for additional comment, in case anybody wants >> > to suggest improvements, but it'd be nice to get this incorporated into >> > the release criteria and repropose the gnome-initial-setup bug. >> >> To be honest it's something we've never had the roundtuits to write up >> in a nice clean policy. The convention is basically: once a draft has >> been up for a while (say, a week or two, depending on urgency) without >> significant objections, you just go ahead and add it to the wiki. i.e. >> it's a fuzzy consensus system. :) > > > Yes, but I find it concerning that I was the only one who provided feedback > to this proposal. It might have been partially caused by the fact that it > wasn't sent to the test list. I urge everyone who has some opinion on this to > provide it, at least in the form of a thumbs up. Thanks. :thumbsup: -- Chris Murphy ___ test mailing list -- test@lists.fedoraproject.org To unsubscribe send an email to test-le...@lists.fedoraproject.org Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/test@lists.fedoraproject.org
Re: Release criteria proposal: first boot experience
On Fri, Sep 4, 2020 at 8:17 PM Adam Williamson wrote: > On Fri, 2020-09-04 at 12:12 -0500, Michael Catanzaro wrote: > > On Wed, Sep 2, 2020 at 12:57 pm, Kamil Paral wrote: > > > Overall I find the criterion reasonable and useful and I'm +1 to > > > incorporating it. Its current phrasing seems fine to me. > > > > So how does the process of adding the new criterion work? I guess we > > should leave the weekend for additional comment, in case anybody wants > > to suggest improvements, but it'd be nice to get this incorporated into > > the release criteria and repropose the gnome-initial-setup bug. > > To be honest it's something we've never had the roundtuits to write up > in a nice clean policy. The convention is basically: once a draft has > been up for a while (say, a week or two, depending on urgency) without > significant objections, you just go ahead and add it to the wiki. i.e. > it's a fuzzy consensus system. :) > Yes, but I find it concerning that I was the only one who provided feedback to this proposal. It might have been partially caused by the fact that it wasn't sent to the test list. I urge everyone who has some opinion on this to provide it, at least in the form of a thumbs up. Thanks. ___ test mailing list -- test@lists.fedoraproject.org To unsubscribe send an email to test-le...@lists.fedoraproject.org Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/test@lists.fedoraproject.org
Re: Release criteria proposal: first boot experience
On Fri, 2020-09-04 at 12:12 -0500, Michael Catanzaro wrote: > On Wed, Sep 2, 2020 at 12:57 pm, Kamil Paral wrote: > > Overall I find the criterion reasonable and useful and I'm +1 to > > incorporating it. Its current phrasing seems fine to me. > > So how does the process of adding the new criterion work? I guess we > should leave the weekend for additional comment, in case anybody wants > to suggest improvements, but it'd be nice to get this incorporated into > the release criteria and repropose the gnome-initial-setup bug. To be honest it's something we've never had the roundtuits to write up in a nice clean policy. The convention is basically: once a draft has been up for a while (say, a week or two, depending on urgency) without significant objections, you just go ahead and add it to the wiki. i.e. it's a fuzzy consensus system. :) I do keep meaning to write it up a bit more formally, but never get enough round tuits... -- Adam Williamson Fedora QA Community Monkey IRC: adamw | Twitter: AdamW_Fedora | XMPP: adamw AT happyassassin . net http://www.happyassassin.net ___ test mailing list -- test@lists.fedoraproject.org To unsubscribe send an email to test-le...@lists.fedoraproject.org Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/test@lists.fedoraproject.org
Re: Release criteria proposal: first boot experience
On Tue, Sep 1, 2020 at 10:24 PM Michael Catanzaro wrote: > Hi, > > We currently have a bug where the Online Accounts page in initial setup > is nonfunctional. [1] This doesn't violate any current release > criterion, but surely we don't want to release with a broken initial > setup experience. So let's add a new requirement for that. How about > something like: > > "If an initial setup utility is run or intended to be run after the > first boot of the installed system, then it must start successfully and > each page or panel of the initial setup utility should withstand a > basic functionality test." > > OK that's pretty basic, but it gets the point across. I think this can > be a final requirement, not necessarily important enough to be a beta > requirement. Bikeshed away! > > [1] https://bugzilla.redhat.com/show_bug.cgi?id=1870476 Hey Michael, all criteria proposals should definitely (also) go to the test list, adding into CC. Just to put everyone on the same page, we already have this Basic criterion: "A system installed with a release-blocking desktop must boot to a log in screen where it is possible to log in to a working desktop using a user account created during installation or a 'first boot' utility." https://fedoraproject.org/wiki/Basic_Release_Criteria#Expected_installed_system_boot_behavior That means that user creation is already guaranteed to be functional (but might be rough around the edges). Of course that doesn't cover any other actions available in the initial setup. Therefore your proposal (targeting the Final milestone, which seems sensible) makes sense in this regard. There are the screens in the initial setup: 1. Welcome 2. Privacy (Location Services, Automatic Problem Reporting) 3. Online Accounts (Google, Nextcloud, Microsoft, Facebook) 4. About You (Name, Username, Enterprise Login) 5. Password 6. Done Since every screen contains just a couple of things, the "basic functionality test" as you phrased it seems to cover essentially everything that is present in there, with one arguable exception of the Enterprise Login functionality. Do you have the same impression? This will also cover the other initial setup screen that is visible for KDE and other desktops (does it run also for ARM text installs? I'm not sure). That one contains: 1. User Creation (Name, Username, Password, Make admin, Advanced) And that was all (at least for my KDE install during which I didn't create a regular user). Overall I find the criterion reasonable and useful and I'm +1 to incorporating it. Its current phrasing seems fine to me. ___ test mailing list -- test@lists.fedoraproject.org To unsubscribe send an email to test-le...@lists.fedoraproject.org Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/test@lists.fedoraproject.org
