bd808 created this task. bd808 added projects: Beta-Cluster-Infrastructure, Pywikibot-tests, Pywikibot. Restricted Application added subscribers: pywikibot-bugs-list, Aklapper.
TASK DESCRIPTION #pywikibot <https://phabricator.wikimedia.org/tag/pywikibot/> runs a relatively large set of post-merge tests via GitHub Actions. Some of these tests use Beta Cluster wikis as their target for end-to-end testing of various features. The efforts to exclude unwanted bots from T393487: 2025 tracking task for Beta Cluster (deployment-prep) traffic overload protection (blocking unwanted crawlers) <https://phabricator.wikimedia.org/T393487> have recently blocked some of the IP addresses used by GitHub Actions. GitHub Actions uses Microsoft Azure to host many (all?) of it's runners. There are over 5000 (!) IP ranges listed at https://api.github.com/meta that GitHub Actions might make requests from. Some potential options: - Allowlist 5000+ CIDR ranges and keep that list updated. - Setup self-hosted GitHub runners <https://docs.github.com/en/actions/how-tos/hosting-your-own-runners> for use by https://github.com/wikimedia/ organization projects. - Add a SOCKS5 proxy to the appropriate test suites to tunnel traffic to an exit that is unlikely to be blocked - Migrate all of these tests to a CI platform that is "in-house" (Zuul or GitLab CI) and unlikely to be blocked See also: - T399367: CI tests fails with TimeoutError when userinfo is retrieved <https://phabricator.wikimedia.org/T399367> - T399415: Unable to generate family for wpbeta:zh with github action (ClientError: (403) Request forbidden) <https://phabricator.wikimedia.org/T399415> TASK DETAIL https://phabricator.wikimedia.org/T399485 WORKBOARD https://phabricator.wikimedia.org/project/board/497/ EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/
_______________________________________________ pywikibot-bugs mailing list -- [email protected] To unsubscribe send an email to [email protected]
