Re: Do substitutes download slowly for you? / Speeding up substitute delivery/mirrors
Luis Felipe writes: > Hi Chris, > > El 31/05/23 a las 10:48, Christopher Baines escribió: >> Luis Felipe writes: >> >>> Another (faster) test from a different machine with Guix System 020184f, >>> same place and network (60 Mbps): >> Thanks for the information, although it looks like you're not well >> connected to any of the three machines. >> >> The Singapore mirror is hosted by Vultr, and they do have some locations >> closer to you, I'd be interested to see what speeds you get downloading >> these files? >> >> https://sao-br-ping.vultr.com/vultr.com.100MB.bin >> https://mex-mx-ping.vultr.com/vultr.com.100MB.bin >> https://scl-cl-ping.vultr.com/vultr.com.100MB.bin > > It feels faster downloading from those locations. Good to know, so to summarise a US mirror is helpful for some people at least in South America, but closer mirrors help more (with Mexico being the best in this test). signature.asc Description: PGP signature
Re: Do substitutes download slowly for you? / Speeding up substitute delivery/mirrors
Hi Chris, El 31/05/23 a las 10:48, Christopher Baines escribió: Luis Felipe writes: Another (faster) test from a different machine with Guix System 020184f, same place and network (60 Mbps): Thanks for the information, although it looks like you're not well connected to any of the three machines. The Singapore mirror is hosted by Vultr, and they do have some locations closer to you, I'd be interested to see what speeds you get downloading these files? https://sao-br-ping.vultr.com/vultr.com.100MB.bin https://mex-mx-ping.vultr.com/vultr.com.100MB.bin https://scl-cl-ping.vultr.com/vultr.com.100MB.bin It feels faster downloading from those locations. I performed the following tests using the same machine where downloads where faster last time, but changed two things: + Upgraded Guix System to 849286b (May 26, 2023) + Moved closer to the WiFi access point (1 m away) Before starting the tests, I checked the average download speed at the time: Connection: WiFi Promoted service speed: 60 Mbps Reported download speed: 48.8 Mbps VULTURE TESTS Brasil: #+begin_example wget https://sao-br-ping.vultr.com/vultr.com.100MB.bin --2023-05-31 09:38:56-- https://sao-br-ping.vultr.com/vultr.com.100MB.bin Resolving sao-br-ping.vultr.com (sao-br-ping.vultr.com)... 2001:19f0:b800:1083:5400:3ff:feb6:aa75, 216.238.98.118 Connecting to sao-br-ping.vultr.com (sao-br-ping.vultr.com)|2001:19f0:b800:1083:5400:3ff:feb6:aa75|:443... failed: Connection refused. Connecting to sao-br-ping.vultr.com (sao-br-ping.vultr.com)|216.238.98.118|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 104857600 (100M) [application/octet-stream] Saving to: 'vultr.com.100MB.bin.1' vultr.com.100MB.bin 100%[===>] 100.00M 6.81MB/s in 17s 2023-05-31 09:39:14 (5.77 MB/s) - 'vultr.com.100MB.bin.1' saved [104857600/104857600] #+end_example México: #+begin_example wget https://mex-mx-ping.vultr.com/vultr.com.100MB.bin --2023-05-31 09:40:51-- https://mex-mx-ping.vultr.com/vultr.com.100MB.bin Resolving mex-mx-ping.vultr.com (mex-mx-ping.vultr.com)... 216.238.66.16 Connecting to mex-mx-ping.vultr.com (mex-mx-ping.vultr.com)|216.238.66.16|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 104857600 (100M) [application/octet-stream] Saving to: 'vultr.com.100MB.bin.2' vultr.com.100MB.bin 100%[===>] 100.00M 6.59MB/s in 16s 2023-05-31 09:41:08 (6.08 MB/s) - 'vultr.com.100MB.bin.2' saved [104857600/104857600] #+end_example Chile: #+begin_example wget https://scl-cl-ping.vultr.com/vultr.com.100MB.bin --2023-05-31 09:42:41-- https://scl-cl-ping.vultr.com/vultr.com.100MB.bin Resolving scl-cl-ping.vultr.com (scl-cl-ping.vultr.com)... 64.176.2.7 Connecting to scl-cl-ping.vultr.com (scl-cl-ping.vultr.com)|64.176.2.7|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 104857600 (100M) [application/octet-stream] Saving to: 'vultr.com.100MB.bin.3' vultr.com.100MB.bin 100%[===>] 100.00M 6.62MB/s in 18s 2023-05-31 09:42:59 (5.70 MB/s) - 'vultr.com.100MB.bin.3' saved [104857600/104857600] #+end_example BORDEAUX TESTS France: #+begin_example wget https://bordeaux.guix.gnu.org/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 --2023-05-31 09:51:04-- https://bordeaux.guix.gnu.org/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 Resolving bordeaux.guix.gnu.org (bordeaux.guix.gnu.org)... 2a0c:e300::58, 185.233.100.56 Connecting to bordeaux.guix.gnu.org (bordeaux.guix.gnu.org)|2a0c:e300::58|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 208615205 (199M) [text/plain] Saving to: '078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0' 078vr3r8mn3yrwzwxw6 100%[===>] 198.95M 3.38MB/s in 62s 2023-05-31 09:52:07 (3.20 MB/s) - '078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0' saved [208615205/208615205] #+end_example US: #+begin_example wget https://bordeaux-us-east-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 --2023-05-31 09:52:56-- https://bordeaux-us-east-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 Resolving bordeaux-us-east-mirror.cbaines.net (bordeaux-us-east-mirror.cbaines.net)... 5.161.49.48 Connecting to bordeaux-us-east-mirror.cbaines.net (bordeaux-us-east-mirror.cbaines.net)|5.161.49.48|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 208615205 (199M) [text/plain] Saving to: '078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0.1' 078vr3r8mn3yrwzwxw6 100%[===>] 198.95M 4.06MB/s in 49s 2023-05-31 09:53:45 (4.10 MB/s) - '078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0.1' saved [208615205/208615205] #+end_example Singapore: #+begin_example wget https://bordeaux-singapore-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 --2023-05-31 09:54:41--
Re: Do substitutes download slowly for you? / Speeding up substitute delivery/mirrors
Luis Felipe writes: > Another (faster) test from a different machine with Guix System 020184f, > same place and network (60 Mbps): Thanks for the information, although it looks like you're not well connected to any of the three machines. The Singapore mirror is hosted by Vultr, and they do have some locations closer to you, I'd be interested to see what speeds you get downloading these files? https://sao-br-ping.vultr.com/vultr.com.100MB.bin https://mex-mx-ping.vultr.com/vultr.com.100MB.bin https://scl-cl-ping.vultr.com/vultr.com.100MB.bin signature.asc Description: PGP signature
Re: Do substitutes download slowly for you? / Speeding up substitute delivery/mirrors
Hi Ludo, all, On Fri, 26 May 2023 at 18:05, Ludovic Courtès wrote: > 2023-05-26 17:59:41 (75.0 MB/s) - ‘/dev/null’ saved [208615205/208615205] > 2023-05-26 18:01:16 (16.1 MB/s) - ‘/dev/null’ saved [208615205/208615205] > 2023-05-26 18:02:49 (5.88 MB/s) - ‘/dev/null’ saved [208615205/208615205] Arf, I understand why Guix is not frugal. ;-) In the worst case, considering you need all the 610MB of the closure, when you run “guix pull”, it’s less than 10 seconds. Using my network at home, the same is about 20 minutes. (And that leads to some vicious circles: because it needs some time and because I do not have the guarantee that the packages I need will build, so I run “guix pull” very barely on this laptop and thus it means the next “guix pull” will probably take longer. And I do not speak about other I/O bounds or CPU power. :-)) As I said elsewhere, Guix is becoming unusable for me with my 8 years laptop at home with some non-fiber network. Bah, an opportunity to turn off and do something else? ;-) And as I also said elsewhere, the ROADMAP for the next 10 years of Guix is to tackle all these inefficiencies – from suboptimal designs to specific optimizations. Well, I run Guix on the top of Debian on this laptop, and I do not experiment the same annoyances with APT, really not. The thread, How many bytes do we add (closure of guix) when adding one new package? Thu, 25 May 2023 20:24:30 +0200 id:87r0r4uv4x@gmail.com https://yhetil.org/guix/87r0r4uv4x@gmail.com is an attempt to discuss the suboptimality by design of “guix pull”. I do not have a clear idea of the solution, that’s why I have opened the discussion. :-) Another example is the “Git pulling twice” when installing, e.g., as pointed by Pierre in this thread: Install `guix pull'ed Guix to target partition on system install Sun, 20 Dec 2020 10:12:42 +0100 id:87ft403kol@ambrevar.xyz https://yhetil.org/guix/87ft403kol@ambrevar.xyz For sure, we need to make Guix do more with less resources. That’s the future. Cheers, simon
Re: Do substitutes download slowly for you? / Speeding up substitute delivery/mirrors
Hi Chris, Thanks for this work. Numbers from Paris, running: $ wget -O/dev/null 1. From desktop at work Bordeaux : 38.4 MB/s US : 2.33 MB/s Singapore: 2.96 MB/s 2. From laptop at home Bordeaux : 529 KB/s US : 520 KB/s Singapore: 524 KB/s Well, I am living at a poor suburb without fiber and more importantly I am always connecting via Wifi. That’s explain the bound. :-) Cheers, simon
Re: Do substitutes download slowly for you? / Speeding up substitute delivery/mirrors
On Thu, May 25, 2023 at 02:52:24PM +0100, Christopher Baines wrote: > Hey! > > I was reminded again about substitute download speeds outside of Europe > again today. It looks like I'm a bit later than most of the other responses. > Once again it would be good to gather some data on this, so here are > some test commands. I'm interested to see how France compares with > either the US or Singapore depending on your location. If you think that > none of these locations serve you well, then please say that plus give > some indication of what download speeds you see for things that download > quickly. > > France:wget > https://bordeaux.guix.gnu.org/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 (ins)efraim@3900XT /tmp$ wget https://bordeaux.guix.gnu.org/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 -O stellarium-france --2023-05-29 14:54:04-- https://bordeaux.guix.gnu.org/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 Resolving bordeaux.guix.gnu.org (bordeaux.guix.gnu.org)... 185.233.100.56, 2a0c:e300::58 Connecting to bordeaux.guix.gnu.org (bordeaux.guix.gnu.org)|185.233.100.56|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 208615205 (199M) [text/plain] Saving to: ‘stellarium-france’ stellarium-france 100%[>] 198.95M 12.2MB/sin 17s 2023-05-29 14:54:21 (11.8 MB/s) - ‘stellarium-france’ saved [208615205/208615205] > US:wget > https://bordeaux-us-east-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 (ins)efraim@3900XT /tmp$ wget https://bordeaux-us-east-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 -O stellarium-US --2023-05-29 14:55:02-- https://bordeaux-us-east-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 Resolving bordeaux-us-east-mirror.cbaines.net (bordeaux-us-east-mirror.cbaines.net)... 5.161.49.48 Connecting to bordeaux-us-east-mirror.cbaines.net (bordeaux-us-east-mirror.cbaines.net)|5.161.49.48|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 208615205 (199M) [text/plain] Saving to: ‘stellarium-US’ stellarium-US 100%[>] 198.95M 12.2MB/sin 17s 2023-05-29 14:55:20 (11.5 MB/s) - ‘stellarium-US’ saved [208615205/208615205] > Singapore: wget > https://bordeaux-singapore-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 (ins)efraim@3900XT /tmp$ wget https://bordeaux-singapore-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 -O stellarium-singapore --2023-05-29 14:56:29-- https://bordeaux-singapore-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 Resolving bordeaux-singapore-mirror.cbaines.net (bordeaux-singapore-mirror.cbaines.net)... 64.176.80.78, 2401:c080:1400:71df:5400:4ff:fe73:757d Connecting to bordeaux-singapore-mirror.cbaines.net (bordeaux-singapore-mirror.cbaines.net)|64.176.80.78|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 208615205 (199M) [text/plain] Saving to: ‘stellarium-singapore’ stellarium-singapore 100%[>] 198.95M 10.8MB/sin 19s 2023-05-29 14:56:50 (10.2 MB/s) - ‘stellarium-singapore’ saved [208615205/208615205] > So please share the output from wget and if you're comfortable doing so, > the rough real world location of where the computer doing the > downloading is. I'm in Israel, paying for a 100/2 connection. I'm surprised the download from Singapore went so quickly, I would've expected that to be slower. Unless things have changed our internet travels to us by way of Greece and Cyprus. As an aside, a few years ago we tried out using Amazon as a CDN, and IIRC I figured I was likely the only user in Israel with ~15GB/month draw. -- Efraim Flashner רנשלפ םירפא GPG key = A28B F40C 3E55 1372 662D 14F7 41AA E7DC CA3D 8351 Confidentiality cannot be guaranteed on emails sent or received unencrypted signature.asc Description: PGP signature
Re: Do substitutes download slowly for you? / Speeding up substitute delivery/mirrors
Hi, On Thu, May 25, 2023, at 5:04 PM, Felix Lechner wrote: > Hi Philip, > > On Thu, May 25, 2023 at 1:49 PM Philip McGrath > wrote: >> >> Here are results from Florida, US: >> >> 2023-05-25 16:28:07 (14.9 MB/s) >> 2023-05-25 16:28:53 (52.9 MB/s) >> 2023-05-25 16:29:37 (10.5 MB/s) > > Wow, those are the best Guix speeds I have seen yet, perhaps aside > from folks connected to DFN. [1] Would you please share some details > about your ISP? From a peering perspective, I think the most > interesting part is your ASN. [2] Thanks! > This was on a residential Comcast connection which seems to be AS7922. I tried to avoid any local slowdowns by doing this with a wired connection at a time when there was little other activity on the machine or the LAN and downloading to a tmpfs. Anecdotally, the speeds for servers *other* than bordeaux-us-east-mirror were faster in this trial than feels typical here. The results I reported at https://lists.gnu.org/archive/html/guix-devel/2022-07/msg00320.html (e.g. 8.17MB/s for bordeaux.guix.gnu.org) might be more usual. Subjectively, my impression of the non-mirrored substitute servers is that often the speeds is ok, but when they are slow it is very, very slow. Philip
Re: Do substitutes download slowly for you? / Speeding up substitute delivery/mirrors
Hi Kaelyn & everyone, On Fri, May 26, 2023 at 11:29 AM Kaelyn wrote: > > Below are my results In order to make it easier for Christopher—and all of us, really—to think about the results of the poll, I put together a Framacalc spreadsheet: https://lite.framacalc.org/pm6mbqubqr-a16h Perhaps you could briefly look over your data for errors I may have made. You should be able to make corrections on your own. You are also welcome to contact me privately if the spreadsheet is not available to you, for example from China. Kind regards & please have a good weekend (a long one in the US)! Felix
Re: Do substitutes download slowly for you? / Speeding up substitute delivery/mirrors
> France: wget > https://bordeaux.guix.gnu.org/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 > US: wget > https://bordeaux-us-east-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 > Singapore: wget > https://bordeaux-singapore-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 > > > So please share the output from wget and if you're comfortable doing so, > the rough real world location of where the computer doing the > downloading is. I'm in Salem, Oregon with Comcast/Xfinity home internet, and while the speeds I get from sites varies a lot, the mirrors are kind of all equally slow for me compared to what I usually see. The Singapore mirror was a little slower on average than France or US east, but all three showed fluctuations throughout the transfer ranging roughly from 650KB/s to 3+MB/s. Below are my results, along with a 4th result downloading a kernel tarball from kernel.org which shows a more typical speed for me. Cheers, Kaelyn $ wget -O/dev/null https://bordeaux.guix.gnu.org/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 --2023-05-26 11:13:25-- https://bordeaux.guix.gnu.org/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 Resolving bordeaux.guix.gnu.org (bordeaux.guix.gnu.org)... 185.233.100.56, 2a0c:e300::58 Connecting to bordeaux.guix.gnu.org (bordeaux.guix.gnu.org)|185.233.100.56|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 208615205 (199M) [text/plain] Saving to: ‘/dev/null’ /dev/null100%[>] 198.95M 1.07MB/sin 1m 57s 2023-05-26 11:15:23 (1.70 MB/s) - ‘/dev/null’ saved [208615205/208615205] $ wget -O/dev/null https://bordeaux-us-east-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 --2023-05-26 11:16:09-- https://bordeaux-us-east-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 Resolving bordeaux-us-east-mirror.cbaines.net (bordeaux-us-east-mirror.cbaines.net)... 5.161.49.48 Connecting to bordeaux-us-east-mirror.cbaines.net (bordeaux-us-east-mirror.cbaines.net)|5.161.49.48|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 208615205 (199M) [text/plain] Saving to: ‘/dev/null’ /dev/null100%[>] 198.95M 1.65MB/sin 2m 2s 2023-05-26 11:18:12 (1.62 MB/s) - ‘/dev/null’ saved [208615205/208615205] $ wget -O/dev/null https://bordeaux-singapore-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 --2023-05-26 11:18:30-- https://bordeaux-singapore-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 Resolving bordeaux-singapore-mirror.cbaines.net (bordeaux-singapore-mirror.cbaines.net)... 64.176.80.78, 2401:c080:1400:71df:5400:4ff:fe73:757d Connecting to bordeaux-singapore-mirror.cbaines.net (bordeaux-singapore-mirror.cbaines.net)|64.176.80.78|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 208615205 (199M) [text/plain] Saving to: ‘/dev/null’ /dev/null100%[>] 198.95M 760KB/sin 2m 26s 2023-05-26 11:20:57 (1.37 MB/s) - ‘/dev/null’ saved [208615205/208615205] $ wget -O/dev/null https://cdn.kernel.org/pub/linux/kernel/v6.x/linux-6.1.30.tar.xz --2023-05-26 11:21:17-- https://cdn.kernel.org/pub/linux/kernel/v6.x/linux-6.1.30.tar.xz Resolving cdn.kernel.org (cdn.kernel.org)... 151.101.1.176, 151.101.65.176, 151.101.193.176, ... Connecting to cdn.kernel.org (cdn.kernel.org)|151.101.1.176|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 134914908 (129M) [application/x-xz] Saving to: ‘/dev/null’ /dev/null100%[>] 128.66M 10.2MB/sin 12s 2023-05-26 11:21:34 (10.5 MB/s) - ‘/dev/null’ saved [134914908/134914908]
Re: Do substitutes download slowly for you? / Speeding up substitute delivery/mirrors
Another (faster) test from a different machine with Guix System 020184f, same place and network (60 Mbps): El 25/05/23 a las 15:49, Luis Felipe escribió: I'm in Colombia, Aburrá Valley, Guix System 5eb1d1b, home network, single user (as far as I know). France: #+begin_example wget https://bordeaux.guix.gnu.org/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 --2023-05-25 10:13:45-- https://bordeaux.guix.gnu.org/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 Resolviendo bordeaux.guix.gnu.org (bordeaux.guix.gnu.org)... 2a0c:e300::58, 185.233.100.56 Conectando con bordeaux.guix.gnu.org (bordeaux.guix.gnu.org)[2a0c:e300::58]:443... conectado. Petición HTTP enviada, esperando respuesta... 200 OK Longitud: 208615205 (199M) [text/plain] Grabando a: «078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0» 078vr3r8mn3yrwzwxw6 100%[===>] 198,95M 985KB/s en 7m 25s 2023-05-25 10:21:12 (457 KB/s) - «078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0» guardado [208615205/208615205] #+end_example US: #+begin_example wget https://bordeaux-us-east-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 --2023-05-25 10:23:22-- https://bordeaux-us-east-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 Resolving bordeaux-us-east-mirror.cbaines.net (bordeaux-us-east-mirror.cbaines.net)... 5.161.49.48 Connecting to bordeaux-us-east-mirror.cbaines.net (bordeaux-us-east-mirror.cbaines.net)|5.161.49.48|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 208615205 (199M) [text/plain] Saving to: '078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0.1' 078vr3r8mn3yrwzwxw6 100%[===>] 198.95M 835KB/s in 3m 25s 2023-05-25 10:26:49 (993 KB/s) - '078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0.1' saved [208615205/208615205] #+end_example Singapore: #+begin_example wget https://bordeaux-singapore-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 --2023-05-25 10:27:36-- https://bordeaux-singapore-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 Resolving bordeaux-singapore-mirror.cbaines.net (bordeaux-singapore-mirror.cbaines.net)... 2401:c080:1400:71df:5400:4ff:fe73:757d, 64.176.80.78 Connecting to bordeaux-singapore-mirror.cbaines.net (bordeaux-singapore-mirror.cbaines.net)|2401:c080:1400:71df:5400:4ff:fe73:757d|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 208615205 (199M) [text/plain] Saving to: '078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0.2' 078vr3r8mn3yrwzwxw6 100%[===>] 198.95M 1.26MB/s in 3m 30s 2023-05-25 10:31:08 (970 KB/s) - '078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0.2' saved [208615205/208615205] #+end_example France: #+begin_example wget https://bordeaux.guix.gnu.org/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 --2023-05-26 12:14:42-- https://bordeaux.guix.gnu.org/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 Resolviendo bordeaux.guix.gnu.org (bordeaux.guix.gnu.org)... 2a0c:e300::58, 185.233.100.56 Conectando con bordeaux.guix.gnu.org (bordeaux.guix.gnu.org)[2a0c:e300::58]:443... conectado. Petición HTTP enviada, esperando respuesta... 200 OK Longitud: 208615205 (199M) [text/plain] Grabando a: «078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0» 078vr3r8mn3yrwzwxw6 100%[===>] 198,95M 2,29MB/s en 92s 2023-05-26 12:16:15 (2,17 MB/s) - «078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0» guardado [208615205/208615205] #+end_example US: #+begin_example wget https://bordeaux-us-east-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 --2023-05-26 12:19:45-- https://bordeaux-us-east-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 Resolviendo bordeaux-us-east-mirror.cbaines.net (bordeaux-us-east-mirror.cbaines.net)... 5.161.49.48 Conectando con bordeaux-us-east-mirror.cbaines.net (bordeaux-us-east-mirror.cbaines.net)[5.161.49.48]:443... conectado. Petición HTTP enviada, esperando respuesta... 200 OK Longitud: 208615205 (199M) [text/plain] Grabando a: «078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0.1» 078vr3r8mn3yrwzwxw6 100%[===>] 198,95M 3,41MB/s en 82s 2023-05-26 12:21:08 (2,44 MB/s) - «078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0.1» guardado [208615205/208615205] #+end_example Singapore: #+begin_example wget https://bordeaux-singapore-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 --2023-05-26 12:22:16-- https://bordeaux-singapore-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 Resolviendo bordeaux-singapore-mirror.cbaines.net (bordeaux-singapore-mirror.cbaines.net)... 2401:c080:1400:71df:5400:4ff:fe73:757d, 64.176.80.78 Conectando con bordeaux-singapore-mirror.cbaines.net
Re: Do substitutes download slowly for you? / Speeding up substitute delivery/mirrors
Andreas Enge skribis: > I am in France with a 100Mb/s FTTH link, and download is fast from all > of the mirrors. > FR 5,59MB/sin 39s Only? I’m in Bordeaux :-) and from my workplace’s fast network I get more than 10x more: --8<---cut here---start->8--- $ wget -O/dev/null https://bordeaux.guix.gnu.org/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 --2023-05-26 17:59:38-- https://bordeaux.guix.gnu.org/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 Resolving bordeaux.guix.gnu.org (bordeaux.guix.gnu.org)... 185.233.100.56, 2a0c:e300::58 Connecting to bordeaux.guix.gnu.org (bordeaux.guix.gnu.org)|185.233.100.56|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 208615205 (199M) [text/plain] Saving to: ‘/dev/null’ /dev/null100%[>] 198.95M 75.0MB/sin 2.7s 2023-05-26 17:59:41 (75.0 MB/s) - ‘/dev/null’ saved [208615205/208615205] --8<---cut here---end--->8--- The others are below but not too bad: --8<---cut here---start->8--- $ wget -O/dev/null https://bordeaux-us-east-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 --2023-05-26 18:01:03-- https://bordeaux-us-east-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 Resolving bordeaux-us-east-mirror.cbaines.net (bordeaux-us-east-mirror.cbaines.net)... 5.161.49.48 Connecting to bordeaux-us-east-mirror.cbaines.net (bordeaux-us-east-mirror.cbaines.net)|5.161.49.48|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 208615205 (199M) [text/plain] Saving to: ‘/dev/null’ /dev/null100%[>] 198.95M 17.6MB/sin 12s 2023-05-26 18:01:16 (16.1 MB/s) - ‘/dev/null’ saved [208615205/208615205] $ wget -O /dev/null https://bordeaux-singapore-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 --2023-05-26 18:02:14-- https://bordeaux-singapore-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 Resolving bordeaux-singapore-mirror.cbaines.net (bordeaux-singapore-mirror.cbaines.net)... 2401:c080:1400:71df:5400:4ff:fe73:757d, 64.176.80.78 Connecting to bordeaux-singapore-mirror.cbaines.net (bordeaux-singapore-mirror.cbaines.net)|2401:c080:1400:71df:5400:4ff:fe73:757d|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 208615205 (199M) [text/plain] Saving to: ‘/dev/null’ /dev/null100%[>] 198.95M 6.63MB/sin 34s 2023-05-26 18:02:49 (5.88 MB/s) - ‘/dev/null’ saved [208615205/208615205] --8<---cut here---end--->8--- Substitution is often not network-bound though: https://guix.gnu.org/en/blog/2021/getting-bytes-to-disk-more-quickly/ Ludo’.
Re: Do substitutes download slowly for you? / Speeding up substitute delivery/mirrors
Hi Chris, Christopher Baines writes: [...] > France:wget > https://bordeaux.guix.gnu.org/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 > US:wget > https://bordeaux-us-east-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 > Singapore: wget > https://bordeaux-singapore-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 Here's the data, from an office connected to fiber in Montréal, Canada: Bordeaux (France): --8<---cut here---start->8--- $ wget https://bordeaux.guix.gnu.org/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 --2023-05-26 08:42:56-- https://bordeaux.guix.gnu.org/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 Resolving bordeaux.guix.gnu.org (bordeaux.guix.gnu.org)... 2a0c:e300::58, 185.233.100.56 Connecting to bordeaux.guix.gnu.org (bordeaux.guix.gnu.org)|2a0c:e300::58|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 208615205 (199M) [text/plain] Saving to: ‘078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0’ 078vr3r8mn3yrwzwxw64hmcysh 100%[==>] 198.95M 15.4MB/sin 14s 2023-05-26 08:43:11 (14.3 MB/s) - ‘078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0’ saved [208615205/208615205] --8<---cut here---end--->8--- US East: --8<---cut here---start->8--- $ wget https://bordeaux-us-east-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 --2023-05-26 08:43:18-- https://bordeaux-us-east-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 Resolving bordeaux-us-east-mirror.cbaines.net (bordeaux-us-east-mirror.cbaines.net)... 5.161.49.48 Connecting to bordeaux-us-east-mirror.cbaines.net (bordeaux-us-east-mirror.cbaines.net)|5.161.49.48|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 208615205 (199M) [text/plain] Saving to: ‘078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0.1’ 078vr3r8mn3yrwzwxw64hmcysh 100%[==>] 198.95M 33.7MB/sin 6.4s 2023-05-26 08:43:24 (31.0 MB/s) - ‘078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0.1’ saved [208615205/208615205] --8<---cut here---end--->8--- Singapore: --8<---cut here---start->8--- $ wget https://bordeaux-singapore-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 --2023-05-26 08:43:31-- https://bordeaux-singapore-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 Resolving bordeaux-singapore-mirror.cbaines.net (bordeaux-singapore-mirror.cbaines.net)... 2401:c080:1400:71df:5400:4ff:fe73:757d, 64.176.80.78 Connecting to bordeaux-singapore-mirror.cbaines.net (bordeaux-singapore-mirror.cbaines.net)|2401:c080:1400:71df:5400:4ff:fe73:757d|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 208615205 (199M) [text/plain] Saving to: ‘078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0.2’ 078vr3r8mn3yrwzwxw64hmcysh 100%[==>] 198.95M 10.1MB/sin 30s 2023-05-26 08:44:02 (6.72 MB/s) - ‘078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0.2’ saved [208615205/208615205] --8<---cut here---end--->8--- The fastest is logically US East, which is twice as fast as the current Bordeaux France link for my location. -- Thanks, Maxim
Re: Do substitutes download slowly for you? / Speeding up substitute delivery/mirrors
Christopher Baines writes: > While I did stop running a mirror in Singapore, it's now back and from > the discussion on IRC today [3] there was some anecdotal evidence that > this helps with fetching substitutes from China. Yes, only the Singapore IPv4 mirror is usable for me in China. [berdeaux] wget 'https://bordeaux.guix.gnu.org/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0' Connecting to bordeaux.guix.gnu.org (bordeaux.guix.gnu.org)|2a0c:e300::58|:443... connected. .. 159.69K 8.27KB/seta 6h 50m wget -4 'https://bordeaux.guix.gnu.org/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0' Connecting to bordeaux.guix.gnu.org (bordeaux.guix.gnu.org)|185.233.100.56|:443... connected. .. 31.69K 5.60KB/seta 10h 6m ^C [us-east-mirror] wget 'https://bordeaux-us-east-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0' Connecting to bordeaux-us-east-mirror.cbaines.net (bordeaux-us-east-mirror.cbaines.net)|5.161.49.48|:443... connected. Saving to: ‘078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0.2’ .. 639.69K 26.8KB/seta 1h 57m ^C [singapore-mirror] wget 'https://bordeaux-singapore-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0' Connecting to bordeaux-singapore-mirror.cbaines.net (bordeaux-singapore-mirror.cbaines.net)|2401:c080:1400:71df:5400:4ff:fe73:757d|:443... connected. .. 415.69K 22.1KB/seta 2h 9m ^C wget -4 'https://bordeaux-singapore-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0' Connecting to bordeaux-singapore-mirror.cbaines.net (bordeaux-singapore-mirror.cbaines.net)|64.176.80.78|:443... connected. .. 14.59M 199KB/seta 11m 22s
Re: Do substitutes download slowly for you? / Speeding up substitute delivery/mirrors
Hello, Am Thu, May 25, 2023 at 02:52:24PM +0100 schrieb Christopher Baines: > So please share the output from wget and if you're comfortable doing so, > the rough real world location of where the computer doing the > downloading is. I am in France with a 100Mb/s FTTH link, and download is fast from all of the mirrors. FR 5,59MB/sin 39s US 4,98MB/sin 53s SG 3,56MB/sin 73s The ordering looks consistent to me, but I am still surprised how good the connection is to Singapore! Andreas
Re: Do substitutes download slowly for you? / Speeding up substitute delivery/mirrors
Hi Philip, On Thu, May 25, 2023 at 1:49 PM Philip McGrath wrote: > > Here are results from Florida, US: > > 2023-05-25 16:28:07 (14.9 MB/s) > 2023-05-25 16:28:53 (52.9 MB/s) > 2023-05-25 16:29:37 (10.5 MB/s) Wow, those are the best Guix speeds I have seen yet, perhaps aside from folks connected to DFN. [1] Would you please share some details about your ISP? From a peering perspective, I think the most interesting part is your ASN. [2] Thanks! Kind regards Felix [1] https://www.dfn.de/en/ [2] https://www.iplocation.net/asn
Re: Do substitutes download slowly for you? / Speeding up substitute delivery/mirrors
Hi, On Thu, May 25, 2023, at 9:52 AM, Christopher Baines wrote: > Hey! > > I was reminded again about substitute download speeds outside of Europe > again today. > > There was some feedback when I sent out a message to guix-devel [1], [2] > a while back. I think the rough summary is that there's anecdotal > evidence that a US mirror helps. > > 1: https://lists.gnu.org/archive/html/guix-devel/2022-05/msg00203.html > 2: https://lists.gnu.org/archive/html/guix-devel/2022-07/msg00163.html Thanks again for setting this up! The us-east mirror makes a big difference for me. The wget output is below, but anecdotally, last week, when I installed Guix on a new Debian installation, my first `guix pull` failed maybe three times due to substitute timeouts before I enabled the mirror. After enabling the mirror, it succeed on the first attempt. Tangentially, a few months ago I was using a very poorly connected network that had the additional annoying property of disconnecting every 10 minutes or so. I got stuck downloading the beginning of one large nar enough times that eventually I gave up. I found, though, that `wget -c` was able to complete the download (though it took several attempts). Adding some similar resume functionality might at least help to mitigate the impact of slow downloads. > > France:wget > https://bordeaux.guix.gnu.org/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 > US:wget > https://bordeaux-us-east-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 > Singapore: wget > https://bordeaux-singapore-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 > > > So please share the output from wget and if you're comfortable doing so, > the rough real world location of where the computer doing the > downloading is. > Here are results from Florida, US: philip@avalon:/tmp$ wget https://bordeaux.guix.gnu.org/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 --2023-05-25 16:27:53-- https://bordeaux.guix.gnu.org/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 Resolving bordeaux.guix.gnu.org (bordeaux.guix.gnu.org)... 185.233.100.56, 2a0c:e300::58 Connecting to bordeaux.guix.gnu.org (bordeaux.guix.gnu.org)|185.233.100.56|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 208615205 (199M) [text/plain] Saving to: ‘078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0’ 078vr3r8mn3yrwzwxw 100%[=>] 198.95M 10.1MB/sin 13s 2023-05-25 16:28:07 (14.9 MB/s) - ‘078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0’ saved [208615205/208615205] philip@avalon:/tmp$ wget https://bordeaux-us-east-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 --2023-05-25 16:28:49-- https://bordeaux-us-east-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 Resolving bordeaux-us-east-mirror.cbaines.net (bordeaux-us-east-mirror.cbaines.net)... 5.161.49.48 Connecting to bordeaux-us-east-mirror.cbaines.net (bordeaux-us-east-mirror.cbaines.net)|5.161.49.48|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 208615205 (199M) [text/plain] Saving to: ‘078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0.1’ 078vr3r8mn3yrwzwxw 100%[=>] 198.95M 55.8MB/sin 3.8s 2023-05-25 16:28:53 (52.9 MB/s) - ‘078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0.1’ saved [208615205/208615205] philip@avalon:/tmp$ wget https://bordeaux-singapore-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 --2023-05-25 16:29:17-- https://bordeaux-singapore-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 Resolving bordeaux-singapore-mirror.cbaines.net (bordeaux-singapore-mirror.cbaines.net)... 64.176.80.78, 2401:c080:1400:71df:5400:4ff:fe73:757d Connecting to bordeaux-singapore-mirror.cbaines.net (bordeaux-singapore-mirror.cbaines.net)|64.176.80.78|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 208615205 (199M) [text/plain] Saving to: ‘078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0.2’ 078vr3r8mn3yrwzwxw 100%[=>] 198.95M 11.4MB/sin 19s 2023-05-25 16:29:37 (10.5 MB/s) - ‘078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0.2’ saved [208615205/208615205]
Re: Do substitutes download slowly for you? / Speeding up substitute delivery/mirrors
Hey, Chris: El 25/05/23 a las 13:52, Christopher Baines escribió: France:wget https://bordeaux.guix.gnu.org/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 US:wget https://bordeaux-us-east-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 Singapore: wget https://bordeaux-singapore-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 I'm in Colombia, Aburrá Valley, Guix System 5eb1d1b, home network, single user (as far as I know). France: #+begin_example wget https://bordeaux.guix.gnu.org/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 --2023-05-25 10:13:45-- https://bordeaux.guix.gnu.org/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 Resolviendo bordeaux.guix.gnu.org (bordeaux.guix.gnu.org)... 2a0c:e300::58, 185.233.100.56 Conectando con bordeaux.guix.gnu.org (bordeaux.guix.gnu.org)[2a0c:e300::58]:443... conectado. Petición HTTP enviada, esperando respuesta... 200 OK Longitud: 208615205 (199M) [text/plain] Grabando a: «078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0» 078vr3r8mn3yrwzwxw6 100%[===>] 198,95M 985KB/s en 7m 25s 2023-05-25 10:21:12 (457 KB/s) - «078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0» guardado [208615205/208615205] #+end_example US: #+begin_example wget https://bordeaux-us-east-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 --2023-05-25 10:23:22-- https://bordeaux-us-east-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 Resolving bordeaux-us-east-mirror.cbaines.net (bordeaux-us-east-mirror.cbaines.net)... 5.161.49.48 Connecting to bordeaux-us-east-mirror.cbaines.net (bordeaux-us-east-mirror.cbaines.net)|5.161.49.48|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 208615205 (199M) [text/plain] Saving to: '078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0.1' 078vr3r8mn3yrwzwxw6 100%[===>] 198.95M 835KB/s in 3m 25s 2023-05-25 10:26:49 (993 KB/s) - '078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0.1' saved [208615205/208615205] #+end_example Singapore: #+begin_example wget https://bordeaux-singapore-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 --2023-05-25 10:27:36-- https://bordeaux-singapore-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 Resolving bordeaux-singapore-mirror.cbaines.net (bordeaux-singapore-mirror.cbaines.net)... 2401:c080:1400:71df:5400:4ff:fe73:757d, 64.176.80.78 Connecting to bordeaux-singapore-mirror.cbaines.net (bordeaux-singapore-mirror.cbaines.net)|2401:c080:1400:71df:5400:4ff:fe73:757d|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 208615205 (199M) [text/plain] Saving to: '078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0.2' 078vr3r8mn3yrwzwxw6 100%[===>] 198.95M 1.26MB/s in 3m 30s 2023-05-25 10:31:08 (970 KB/s) - '078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0.2' saved [208615205/208615205] #+end_example OpenPGP_0x0AB0D067012F08C3.asc Description: OpenPGP public key OpenPGP_signature Description: OpenPGP digital signature
Re: Do substitutes download slowly for you? / Speeding up substitute delivery/mirrors
On 2023-05-25, Christopher Baines wrote: > France:wget > https://bordeaux.guix.gnu.org/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 > US:wget > https://bordeaux-us-east-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 > Singapore: wget > https://bordeaux-singapore-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 Thanks for revisiting this! > So please share the output from wget and if you're comfortable doing so, > the rough real world location of where the computer doing the > downloading is. Ok, sitting in Portland, Oregon, USA, with native IPv4 and IPv6 over a wireguard VPN routed via Freemont, California, USA... I tested both IPv4 and IPv6 for those that have IPv6 (US mirror only has IPv4). There is constant internet activity from other machines on the local network, so a lot of uncontrolled variables... The results seem to be all over the place, with the best speed result france (IPv4), the second best singapore(IPv6), the worst singapore (IPv4) and second worst the US mirror (IPv4), somewhat surprisingly. Maybe fetching the same content over IPv4 followed up by IPv6 warmed up the disk cache on the server side... but clearly not consistently. My VPN is hosted somewhere with much better internet connectivity, so maybe wireguard manages to queue packets and send them more efficiently for the IPv6 connections... sometimes? --2023-05-25 07:55:21-- https://bordeaux.guix.gnu.org/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 Resolving bordeaux.guix.gnu.org (bordeaux.guix.gnu.org)... 185.233.100.56 Connecting to bordeaux.guix.gnu.org (bordeaux.guix.gnu.org)|185.233.100.56|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 208615205 (199M) [text/plain] Saving to: ‘078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0’ 078vr3r8mn3yrwzwxw64hmcyshic9p3q 100%[==>] 198.95M 1.45MB/sin 56s 2023-05-25 07:56:17 (3.56 MB/s) - ‘078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0’ saved [208615205/208615205] --2023-05-25 07:56:17-- https://bordeaux.guix.gnu.org/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 Resolving bordeaux.guix.gnu.org (bordeaux.guix.gnu.org)... 2a0c:e300::58 Connecting to bordeaux.guix.gnu.org (bordeaux.guix.gnu.org)|2a0c:e300::58|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 208615205 (199M) [text/plain] Saving to: ‘078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0.1’ 078vr3r8mn3yrwzwxw64hmcyshic9p3q 100%[==>] 198.95M 2.61MB/sin 2m 12s 2023-05-25 07:58:30 (1.51 MB/s) - ‘078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0.1’ saved [208615205/208615205] bordeaux-us-east-mirror.cbaines.net has address 5.161.49.48 --2023-05-25 07:58:30-- https://bordeaux-us-east-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 Resolving bordeaux-us-east-mirror.cbaines.net (bordeaux-us-east-mirror.cbaines.net)... 5.161.49.48 Connecting to bordeaux-us-east-mirror.cbaines.net (bordeaux-us-east-mirror.cbaines.net)|5.161.49.48|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 208615205 (199M) [text/plain] Saving to: ‘078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0.2’ 078vr3r8mn3yrwzwxw64hmcyshic9p3q 100%[==>] 198.95M 3.60MB/sin 2m 39s 2023-05-25 08:01:11 (1.25 MB/s) - ‘078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0.2’ saved [208615205/208615205] bordeaux-singapore-mirror.cbaines.net has address 64.176.80.78 bordeaux-singapore-mirror.cbaines.net has IPv6 address 2401:c080:1400:71df:5400:4ff:fe73:757d --2023-05-25 08:01:11-- https://bordeaux-singapore-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 Resolving bordeaux-singapore-mirror.cbaines.net (bordeaux-singapore-mirror.cbaines.net)... 64.176.80.78 Connecting to bordeaux-singapore-mirror.cbaines.net (bordeaux-singapore-mirror.cbaines.net)|64.176.80.78|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 208615205 (199M) [text/plain] Saving to: ‘078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0.3’ 078vr3r8mn3yrwzwxw64hmcyshic9p3q 100%[==>] 198.95M 1.51MB/sin 3m 0s 2023-05-25 08:04:12 (1.11 MB/s) - ‘078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0.3’ saved [208615205/208615205] --2023-05-25 08:04:12-- https://bordeaux-singapore-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 Resolving bordeaux-singapore-mirror.cbaines.net (bordeaux-singapore-mirror.cbaines.net)... 2401:c080:1400:71df:5400:4ff:fe73:757d Connecting to bordeaux-singapore-mirror.cbaines.net (bordeaux-singapore-mirror.cbaines.net)|2401:c080:1400:71df:5400:4ff:fe73:757d|:443... connected. HTTP request sent, awaiting
Re: Do substitutes download slowly for you? / Speeding up substitute delivery/mirrors
Hi Chris! On Thu, May 25, 2023 at 7:14 AM Christopher Baines wrote: > > France:wget > https://bordeaux.guix.gnu.org/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 --2023-05-25 07:23:45-- https://bordeaux.guix.gnu.org/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 Resolving bordeaux.guix.gnu.org (bordeaux.guix.gnu.org)... 2a0c:e300::58, 185.233.100.56 Connecting to bordeaux.guix.gnu.org (bordeaux.guix.gnu.org)|2a0c:e300::58|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 208615205 (199M) [text/plain] Saving to: ‘078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0.1’ 078vr3r8mn3yrwzwxw64hmcyshic9 100%[===>] 198.95M 1.70MB/sin 1m 47s 2023-05-25 07:25:33 (1.86 MB/s) - ‘078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0.1’ saved [208615205/208615205] > US:wget > https://bordeaux-us-east-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 --2023-05-25 07:20:43-- https://bordeaux-us-east-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 Resolving bordeaux-us-east-mirror.cbaines.net (bordeaux-us-east-mirror.cbaines.net)... 5.161.49.48 Connecting to bordeaux-us-east-mirror.cbaines.net (bordeaux-us-east-mirror.cbaines.net)|5.161.49.48|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 208615205 (199M) [text/plain] Saving to: ‘078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0’ 078vr3r8mn3yrwzwxw64hmcyshic9 100%[===>] 198.95M 7.16MB/sin 35s 2023-05-25 07:21:18 (5.70 MB/s) - ‘078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0’ saved [208615205/208615205] > Singapore: wget > https://bordeaux-singapore-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 --2023-05-25 07:25:41-- https://bordeaux-singapore-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 Resolving bordeaux-singapore-mirror.cbaines.net (bordeaux-singapore-mirror.cbaines.net)... 2401:c080:1400:71df:5400:4ff:fe73:757d, 64.176.80.78 Connecting to bordeaux-singapore-mirror.cbaines.net (bordeaux-singapore-mirror.cbaines.net)|2401:c080:1400:71df:5400:4ff:fe73:757d|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 208615205 (199M) [text/plain] Saving to: ‘078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0.2’ 078vr3r8mn3yrwzwxw64hmcyshi 47%[==> ] 95.41M 1.36MB/seta 60s ^078vr3r8mn3yrwzwxw64hmcyshic9 100%[===>] 198.95M 3.60MB/sin 92s 2023-05-25 07:27:15 (2.16 MB/s) - ‘078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0.2’ saved [208615205/208615205] > So please share the output from wget and if you're comfortable doing so, > the rough real world location of where the computer doing the > downloading is. I am located in a home connected via a consumer-grade microwave link from Sail Internet and then via fiber to their hub in Hurricane Electric's FMT2 data center, which is about three miles away. My static IP is 208.82.101.137, or sail-ipv4.us-core.com. Typical downlink speeds are 200-300 Mbps. Thanks for operating and maintaining the Bordeaux build farm! Kind regards Felix
Do substitutes download slowly for you? / Speeding up substitute delivery/mirrors
Hey! I was reminded again about substitute download speeds outside of Europe again today. There was some feedback when I sent out a message to guix-devel [1], [2] a while back. I think the rough summary is that there's anecdotal evidence that a US mirror helps. 1: https://lists.gnu.org/archive/html/guix-devel/2022-05/msg00203.html 2: https://lists.gnu.org/archive/html/guix-devel/2022-07/msg00163.html While I did stop running a mirror in Singapore, it's now back and from the discussion on IRC today [3] there was some anecdotal evidence that this helps with fetching substitutes from China. 3: https://logs.guix.gnu.org/guix/2023-05-25.log#142624 Once again it would be good to gather some data on this, so here are some test commands. I'm interested to see how France compares with either the US or Singapore depending on your location. If you think that none of these locations serve you well, then please say that plus give some indication of what download speeds you see for things that download quickly. France:wget https://bordeaux.guix.gnu.org/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 US:wget https://bordeaux-us-east-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 Singapore: wget https://bordeaux-singapore-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 So please share the output from wget and if you're comfortable doing so, the rough real world location of where the computer doing the downloading is. So as an example, I'm in the United Kingdom, and here's what I see downloading from bordeaux.guix.gnu.org (France): → wget https://bordeaux.guix.gnu.org/nar/lzip/hyc5kb21vfdq9hb3snmkg2xsygbwzzsm-stellarium-23.1 --2023-05-25 15:02:49-- https://bordeaux.guix.gnu.org/nar/lzip/hyc5kb21vfdq9hb3snmkg2xsygbwzzsm-stellarium-23.1 Resolving bordeaux.guix.gnu.org (bordeaux.guix.gnu.org)... 2a0c:e300::58, 185.233.100.56 Connecting to bordeaux.guix.gnu.org (bordeaux.guix.gnu.org)|2a0c:e300::58|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 261054076 (249M) [text/plain] Saving to: ‘hyc5kb21vfdq9hb3snmkg2xsygbwzzsm-stellarium-23.1’ hyc5kb21vfdq9hb3snmkg2xsygbwzz 100%[==>] 248.96M 3.80MB/s in 66s 2023-05-25 15:03:55 (3.78 MB/s) - ‘hyc5kb21vfdq9hb3snmkg2xsygbwzzsm-stellarium-23.1’ saved [261054076/261054076] My internet connection is slow enough that I don't see much difference when I try the mirrors. Let me know if you have any comments or questions, and of course I'm interested to see how well substitute downloading works for you! Thanks, Chris signature.asc Description: PGP signature
