On Wed, Jun 17, 2020, at 13:45, Janne Johansson wrote: > > Now if someone invents a decent piece of code to use http connection pooling, > quic/http3/rsync or whatever to speed up getting the required info, I'm sure > we mirror admins would be happy to add/edit our server programs to serve it. >
Welp, I got a nice taste of what taking advantage of http-keepalives can do, and it is indeed quite a bit faster. Here's all I did (a bit overkill, but a neat proof-of-concept): # pkg_add squid # rcctl start squid # export http_server=http://localhost:3128/ # pkg_add -u squid by default uses keepalives on both the client and server connections. It seems that the server closes our connections several times during the transfers anyway (I assume either a max request limit or keepalive timeout), but it's much better than starting a new connection every time. I'd be really interested to see what something like quic can do.

