On Mon, 2014-10-13 at 23:59 -0700, Adam Williamson wrote: > 21's Install/Installation results are a bit messy because of the > extensive changes to that page during Alpha and Beta (it was renamed > from Install to Installation, for a start...); tomorrow I'll spend a bit > of time modifying the pre-Beta TC2 pages to match the current format, so > relval's results look nicer. I *did* do some mental design on a sort of > pre-processor function which would try to handle changes to the page > layout, but it got very complex in a hurry and I figured it makes more > sense to just clean up the pages when this sort of thing happens.
So I had another idea for cleaning results at the pool today and thought, what the hell, I'll write it. And it works! testcase_stats.py now has a post_process() function which does some crazy voodoo magic to clean up the results before they're fed into the HTML renderer. It merges tests which moved around the page between composes, and re-sorts the tests into sections, which cleans up the cases where new tests and sections got added in later composes and otherwise would wind up stuck on the bottom of the results page, with duplicated sections. There's a rather heroic docstring which explains all the magic. You can also pass --nopostproc to turn the post-processor off (it's designed to drop right out) and compare the results you get. I've uploaded results for every release from 12 to 21 - with the post-processor enabled - to https://www.happyassassin.net/testcase_stats/ . They look pretty good to me. I really should stop twiddling with this now, and do some real work :) (this code is just in git master for now, not released. it required changes to both relval and wikitcms). -- Adam Williamson Fedora QA Community Monkey IRC: adamw | Twitter: AdamW_Fedora | XMPP: adamw AT happyassassin . net http://www.happyassassin.net _______________________________________________ qa-devel mailing list [email protected] https://admin.fedoraproject.org/mailman/listinfo/qa-devel
