Petr & others,

a few suggestions regarding git.openwrt.org load:

Should we try to decrease our own load to git.openwrt.org by

a) setting feeds.conf.default to point to the actual root feeds at GitHub (e.g. https://github.com/openwrt/packages) instead of the git.openwrt.org mirror?   Or alternatively, set feeds.conf.default to point to the new git.cdn.openwrt.org?

b) Set buildbot to fetch sources from git.cdn.openwrt.org (and also do the changes to the feeds locations def...)


Hannu


Petr Štetiar kirjoitti 4.12.2024 klo 15.07:
Hi,

git.openwrt.org is currently served by a single VPS server, which is no longer
suitable in this age of AI scraping. That server is being overloaded on daily
basis with spikes of requests, leading quite often to 500s, causing build
failures on our buildbots during feed syncs.

As a first quick fix attempt, I've prepared git.cdn.openwrt.org, which is a
Fastly CDN-backed mirror of git.openwrt.org and would like to serve all the
traffic via Fastly CDN which I hope should alleviate the gitweb based load on
the server as it could be served from the CDN cache.

The CDN is generously provided by Fastly, without any cost to us. If we decide
to keep using this service, we're going to put information about it somewhere
on the gitweb page.

The setup is going to use Fastly's relatively recent CA Certainly[1], using
certs with 30-day certificate validity.

In case you bump into any issues, please let us know via standard channels
(lists, IRC, GitHub issues, etc.) so we can address them or eventually revert
the change.


1.  
https://www.fastly.com/blog/announcing-certainly-fastlys-own-tls-certification-authority


Happy Git cloning!

Cheers,

Petr

_______________________________________________
openwrt-adm mailing list
openwrt-...@lists.openwrt.org
https://lists.openwrt.org/mailman/listinfo/openwrt-adm



_______________________________________________
openwrt-devel mailing list
openwrt-devel@lists.openwrt.org
https://lists.openwrt.org/mailman/listinfo/openwrt-devel

Reply via email to