[Bug 50513] VisualEditor: Set up mass round-trip testing infrastructure on real content
https://bugzilla.wikimedia.org/show_bug.cgi?id=50513 James Forrester changed: What|Removed |Added Priority|Low |High -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 50513] VisualEditor: Set up mass round-trip testing infrastructure on real content
https://bugzilla.wikimedia.org/show_bug.cgi?id=50513 Krinkle changed: What|Removed |Added Priority|High|Low -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 50513] VisualEditor: Set up mass round-trip testing infrastructure on real content
https://bugzilla.wikimedia.org/show_bug.cgi?id=50513 --- Comment #6 from James Forrester --- *** Bug 56330 has been marked as a duplicate of this bug. *** -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 50513] VisualEditor: Set up mass round-trip testing infrastructure on real content
https://bugzilla.wikimedia.org/show_bug.cgi?id=50513 James Forrester changed: What|Removed |Added CC||roan.katt...@gmail.com, ||ryasm...@wikimedia.org, ||tpars...@wikimedia.org Component|General |MediaWiki integration -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 50513] VisualEditor: Set up mass round-trip testing infrastructure on real content
https://bugzilla.wikimedia.org/show_bug.cgi?id=50513 --- Comment #5 from James Forrester --- (In reply to comment #4) > So based on discussions with Gabriel: > > * Parsoid has a better organised infrastructure for this than we do, so let's > use that as a base. Right now they periodically run their sets of roundtrip > tests on a certain set of articles. > > 1) Change that set of articles to include and/or match James' specification. Include, not switch, please; the stuff that Parsoid is doing for RT tests should also be expanded, IMO. -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 50513] VisualEditor: Set up mass round-trip testing infrastructure on real content
https://bugzilla.wikimedia.org/show_bug.cgi?id=50513 --- Comment #4 from Krinkle --- So based on discussions with Gabriel: * Parsoid has a better organised infrastructure for this than we do, so let's use that as a base. Right now they periodically run their sets of roundtrip tests on a certain set of articles. 1) Change that set of articles to include and/or match James' specification. 2) Improve ve-dirtydiffbot to not just do parsoid-ve-ve-parsoid roundtrip but also parsoid-ve-ve rountrip (e.g. parsoid dom > ve linmod > ve dom; "sanity check") 2) Extend the test runner to include 2 pieces of information for each article in addition to the data parsoid gathers: - result of parsoid-dom > ve linmod > ve dom ("sanity check") - diff of parsoid-dom > ve linmod > ve dom > parsoid dom ("full wikitext roundtrip")[1] [1] this is the one that ve-dirtydiffbot is currently doing. -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 50513] VisualEditor: Set up mass round-trip testing infrastructure on real content
https://bugzilla.wikimedia.org/show_bug.cgi?id=50513 --- Comment #3 from James Forrester --- (In reply to comment #2) > (In reply to comment #1) > ... > > * {en,fr,de,it,es,nl,he,ru,ar,ja,ko,vi}wiki ~ 5k random articles > Could you add also 'pt' to this list? Sure. It was just writing a quick list rather than setting it in stone. When we expand to cover language variants we'll want to expand the list further - for example, zh. :-) -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 50513] VisualEditor: Set up mass round-trip testing infrastructure on real content
https://bugzilla.wikimedia.org/show_bug.cgi?id=50513 --- Comment #2 from Helder --- (In reply to comment #1) ... > * {en,fr,de,it,es,nl,he,ru,ar,ja,ko,vi}wiki ~ 5k random articles Could you add also 'pt' to this list? -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 50513] VisualEditor: Set up mass round-trip testing infrastructure on real content
https://bugzilla.wikimedia.org/show_bug.cgi?id=50513 James Forrester changed: What|Removed |Added Priority|Unprioritized |High Status|NEW |ASSIGNED Assignee|jforres...@wikimedia.org|krinklem...@gmail.com --- Comment #1 from James Forrester --- Timo, Let's use this bug for what we discussed. As I suggested, we should probably run on: * enwiki featured articles (~ 4k), fixed revision (so if we regress we notice) * enwiki ~ 5k most recently-changed articles (Special:RecentChanges) * {en,fr,de,it,es,nl,he,ru,ar,ja,ko,vi}wiki ~ 5k random articles (Special:Random) Thoughts? -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l