[Bug 46197] Dump stats: automated validation of new monthly dump stats

2014-03-11 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=46197

Erik Zachte ezac...@wikimedia.org changed:

   What|Removed |Added

   Priority|Unprioritized   |Low
 CC|dvanli...@gmail.com |

--- Comment #2 from Erik Zachte ezac...@wikimedia.org ---
Would be nice. But would be incomplete at best, and possibly a major task,
depending on ambition level, as there are many metrics, and plausible rate of
change could differ per project. It also could create lots of false positives,
depending on thresholds chosen. 

BTW manual vetting is mostly quick comparison of key metrics on old and new
reports for some wikis (mostly English Wikipedia) to see if these metrics are
ballpark within expected range. Other than that many eyeballs keep Wikistats
under scrutiny. 

Background: Several years ago there was a major bug that caused all article
counts to be twice as high (redirects were not recognized, or something of that
nature). Given that Wikistats regenerates all historic months on every run that
gave the impression of a complete overhaul of Wikistats methodology and caused
some turmoil. Given the high stability of the wikistats scripts (after 10 years
of operation few operational errors has skewed stats) the fact that any
software can fail in changing circumstances came as a surprise to some users.

-- 
You are receiving this mail because:
You are the assignee for the bug.
You are on the CC list for the bug.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l


[Bug 46197] Dump stats: automated validation of new monthly dump stats

2013-03-16 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=46197

--- Comment #1 from Erik Zachte ezac...@wikimedia.org ---
https://mingle.corp.wikimedia.org/projects/analytics/cards/331

-- 
You are receiving this mail because:
You are on the CC list for the bug.
You are the assignee for the bug.
You are watching all bug changes.
___
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l