On Fri, Apr 20, 2018, 5:01 AM <qa-requ...@lists.wikimedia.org> wrote:
> Send QA mailing list submissions to > qa@lists.wikimedia.org > > To subscribe or unsubscribe via the World Wide Web, visit > https://lists.wikimedia.org/mailman/listinfo/qa > or, via email, send a message with subject or body 'help' to > qa-requ...@lists.wikimedia.org > > You can reach the person managing the list at > qa-ow...@lists.wikimedia.org > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of QA digest..." > > > Today's Topics: > > 1. Re: Helper to run MediaWiki tests (Antoine Musso) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Thu, 19 Apr 2018 23:28:59 +0200 > From: Antoine Musso <hashar+...@free.fr> > To: qa@lists.wikimedia.org > Subject: Re: [QA] Helper to run MediaWiki tests > Message-ID: <pbb1io$kdr$1...@blaine.gmane.org> > Content-Type: text/plain; charset=utf-8 > > On 13/04/2018 10:48, Kunal Mehta wrote: > > I LOVE IT > > > > But really, I was failing to reproduce a test failure[1] locally and I > > gave quibble a try and it failed! After a bit of playing around I was > > able to do a full git bisect, pinpointing the problem. > > > > My main feature request would be to be able to run each "stage" > > independently, e.g. --stage=qunit or --stage=phpunit or > > --stage=composer-test, etc. I'd think we'd need that anyways to keep our > > current parallelization of jobs. > > > > [1] https://phabricator.wikimedia.org/T191863 > > Thank you Kunal for your reply last week, that has encouraged me all > week long (as well as Timo praised). > > Quibble 0.0.8 has your patch to select which test command to run using > --run. That is definitely an improvement when testing locally, I had > just commented out blocks here and there in cmd.py :-/ > > > We run tests against several environments varying based on the php > flavor, database or vendor vs composer. I thought about having a > reference environment for a given branch, and when varying when of the > input (eg: database = sqlite), only run commands it affects. > > I did a very basic pass https://gerrit.wikimedia.org/r/#/c/427099/ which > more or less let us handle the variations and skip unwanted commands. It > is not any ready though and I am not sure where I am going on that front. > > Side note: I have added quibble to mediawiki/core yesterday/today. Going > to announce it to wikitech-l right now. > > > -- > Antoine "hashar" Musso > > > > > ------------------------------ > > Subject: Digest Footer > > _______________________________________________ > QA mailing list > QA@lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/qa > > > ------------------------------ > > End of QA Digest, Vol 59, Issue 3 > ********************************* >
_______________________________________________ QA mailing list QA@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/qa