[Wikitech-l] Revision scoring weekly update
Hey folks, This is the 7th weekly update for the revision scoring team that we have sent to this mailing list. *New developments:* - The production version of ORES (ores.wikimedia.org) is live! We are still testing and it might break sometimes. [1] - Norwegian basic support is completed. We deploy this very soon. [2] [3] - ores-experiment.wmflabs.org is a new setup to run experimental models. [4] - We implemented a demo of dependent task in celery, our distributed processing environment [5] which brings us closer to a key performance improvement [6] *Maintenance and robustness:* - We deprecated flower in favor of grafana ( https://grafana.wikimedia.org/dashboard/db/ores ) [7] - Intermittent performance issues with wikilabels are now solved [8] 1. https://phabricator.wikimedia.org/T106867 2. https://phabricator.wikimedia.org/T131856 3. https://phabricator.wikimedia.org/T131855 4. https://ores-experiment.wmflabs.org/ 5. https://phabricator.wikimedia.org/T136875 6. https://phabricator.wikimedia.org/T134606 7. https://phabricator.wikimedia.org/T137003 8. https://phabricator.wikimedia.org/T130872 Sincerly -Amir ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
[Wikitech-l] Revision Scoring weekly update
Hey, Here is the weekly update for the Revision Scoring project for the week of May 9th through May 15th. *New developments:* - We do have a dedicated help page on how to request that we add support for new languages[1] - We deployed new version of revscoring and ORES, The biggest improvement is speed. Improvments may vary in different wikis but for English Wikipedia is about 20% [2] - We are pre-generating list of bad words for different langauges. [3] - shinken and icinga now report outages and recovery on #wikimedia-ai -- our main work channel[4] *Maintenance and robustness:* - Soon, Your unlabeled edits in Wikilabels will be made available to others after 24 hours. [5] - We improved logging of scoring errors in ORES [6] 1. https://phabricator.wikimedia.org/T135179 2. https://phabricator.wikimedia.org/T135381 3. https://phabricator.wikimedia.org/T134629 4. https://phabricator.wikimedia.org/T134726 5. https://phabricator.wikimedia.org/T134619 6. https://phabricator.wikimedia.org/T135399 ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
[Wikitech-l] Revision Scoring weekly update
Hey folks, This is the weekly update for the Revision Scoring project for the week of April 2nd through April 8th. *New developments:* - Solved some issues that block a major performance improvement for score requests using multiple models[2] - Improved the performance of feature extraction for features that use mwparserfromhell[3,4] - We applied regex performance optimizations to badwords and informal word detection for many languages[9] *Maintenance and robustness:* - Solved a regression in ScoredRevisions that caused most revisions in RecentChanges to not be scored[1] - Set ORES load balancer to rebalance on 500 responses from a web node[5] - Enabled CORS for error responses from ORES -- this makes it easier to report errors from a gadget on a wiki[6] - Sade the staging instance of Wikilabels[7] look a lot more like the production instance[8] 1. https://phabricator.wikimedia.org/T134601 2. https://phabricator.wikimedia.org/T134781 3. https://mwparserfromhell.readthedocs.io 4. https://phabricator.wikimedia.org/T134780 5. https://phabricator.wikimedia.org/T111806 6. https://phabricator.wikimedia.org/T119325 7. https://labels-staging.wmflabs.org/gadget/ 8. https://phabricator.wikimedia.org/T134627 9. https://phabricator.wikimedia.org/T134267 Stay tuned! --Aaron ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
