[Bug 39473] Running parser test files with phpunit.php should behave like running them with parserTests.php
https://bugzilla.wikimedia.org/show_bug.cgi?id=39473 Andre Klapper aklap...@wikimedia.org changed: What|Removed |Added Priority|Unprioritized |Normal -- You are receiving this mail because: You are the assignee for the bug. You are watching all bug changes. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 39473] Running parser test files with phpunit.php should behave like running them with parserTests.php
https://bugzilla.wikimedia.org/show_bug.cgi?id=39473 --- Comment #7 from Antoine hashar Musso has...@free.fr 2012-11-17 09:13:01 UTC --- parserTests.php is the old, stable and fast implementation. I use it locally whenever I review a parser change. NewParserTest is a a new, unstable, slow implementation with lot of code copy pasted and a full initialization being run on each test. BUT, it uses PHPUnit which is nice for Jenkins. So we need both for now. My preference would go to make the old parserTests.php to be able to output Junit results which is all what is needed by Jenkins and drop the buggy NewParserTest. -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 39473] Running parser test files with phpunit.php should behave like running them with parserTests.php
https://bugzilla.wikimedia.org/show_bug.cgi?id=39473 --- Comment #8 from Daniel Werner daniel.wer...@wikimedia.de 2012-11-17 18:47:19 UTC --- I think Daniel F. points are convincing. This is blocking me and improvement of parser testing system. Right now it is simply not possible to write parser tests for certain cases and it seems not possible to implement this in both, PHPUnit parser test testing and parserTests.php. So, why not teach Jenkins to execute parserTests.php and stop executing them together with unit tests. This would finally free the way to improve parser testing and I could finally release some of the tests for some of my extensions. -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 39473] Running parser test files with phpunit.php should behave like running them with parserTests.php
https://bugzilla.wikimedia.org/show_bug.cgi?id=39473 --- Comment #6 from Daniel Friesen mediawiki-b...@nadir-seen-fire.com 2012-11-16 04:14:01 UTC --- (In reply to comment #1) It would also be nice to get (very far) away from the current yet-another-syntax and replace parserTests.txt with standard data providers and sane ways (= standard PHP) to set input and check output. What is so wrong about using a custom syntax? DSLs are a perfectly respectable way to handle this kind of case. They make tests more concise and easier to write. (In reply to comment #3) Why do we even need parserTests.php? We don't use it in Jenkins, and the PHPUnit tests for the Parser seem good enough (and can be improved if not). parserTests.php has the following features that PHPUnit does not appear to have (and the majority of them I do not believe are possible to implement within PHPUnit): - Better error output; The opening of PHPUnit's failure output includes a pile of garbage, basically an opaque serialized set of arguments before it even gets to the diff. While parserTests is mostly concise. The test name is easy to see. And the diffs are coloured. - More control over test output format. - Tests can be filtered down to specific files; Useful for working on an extension to restrict to it's own parser tests. In fact you can use parserTests.php on a parser test file before you even register it. Making it very useful for adding tests to an extension for the first time. - Tests can be filtered by regexp; Useful to re-run the same set of tests over and over when you are debugging something specific. - I haven't tried it yet. But apparently parserTests.php can record to a database and compare against it. From what I understand, useful to check for fixes/regressions. - parserTests.php can run disabled tests. Useful to check for tests that were once disabled but happen to have been fixed by some recent commit. - parserTests.php runs in around 30s. While the PHPUnit parser tests take about 3m to run (perhaps due to fuzz tests). This can make a really big difference with you running tests over and over during development. So basically in practice I find that the PHPUnit implementation's one purpose is Jenkins integration. While parserTests is superior in every way for use during actual development. -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 39473] Running parser test files with phpunit.php should behave like running them with parserTests.php
https://bugzilla.wikimedia.org/show_bug.cgi?id=39473 --- Comment #5 from Daniel Werner daniel.wer...@wikimedia.de 2012-11-13 17:39:53 UTC --- Actually, from the current state I would rather prefer to drop phpunit.php being smart and executing parser tests. It seems that this has a somewhat poorer implementation compared with the parserTests.php, parserTests.php seems more flexible to me. On the other hand, it's nice having them executed automatically with unit tests. If anyone wants to keep parserTests.php for some reason, we should try to make a common base. And when we have that, we should try to make it more flexible again, stuff like not being able to create upper case articles within those tests and articles being created in the beginning and not in a sequential order really sucks. -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 39473] Running parser test files with phpunit.php should behave like running them with parserTests.php
https://bugzilla.wikimedia.org/show_bug.cgi?id=39473 --- Comment #3 from Krinkle krinklem...@gmail.com 2012-11-12 13:01:54 UTC --- Why do we even need parserTests.php? We don't use it in Jenkins, and the PHPUnit tests for the Parser seem good enough (and can be improved if not). -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 39473] Running parser test files with phpunit.php should behave like running them with parserTests.php
https://bugzilla.wikimedia.org/show_bug.cgi?id=39473 --- Comment #4 from Krinkle krinklem...@gmail.com 2012-11-12 13:02:10 UTC --- See also bug 41989. -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 39473] Running parser test files with phpunit.php should behave like running them with parserTests.php
https://bugzilla.wikimedia.org/show_bug.cgi?id=39473 Daniel Werner daniel.wer...@wikimedia.de changed: What|Removed |Added Blocks||39461 -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 39473] Running parser test files with phpunit.php should behave like running them with parserTests.php
https://bugzilla.wikimedia.org/show_bug.cgi?id=39473 --- Comment #2 from Daniel Werner danwe...@web.de 2012-10-04 19:16:17 UTC --- Mmh, no strong opinion about that right now. You might want to file a separate bug for this. Even though it is somewhat related. Perhaps this should be discussed on wikitech to see peoples reactions. -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 39473] Running parser test files with phpunit.php should behave like running them with parserTests.php
https://bugzilla.wikimedia.org/show_bug.cgi?id=39473 Tim Landscheidt t...@tim-landscheidt.de changed: What|Removed |Added CC||t...@tim-landscheidt.de --- Comment #1 from Tim Landscheidt t...@tim-landscheidt.de 2012-10-03 23:36:43 UTC --- It would also be nice to get (very far) away from the current yet-another-syntax and replace parserTests.txt with standard data providers and sane ways (= standard PHP) to set input and check output. -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
