How Can We Make G-Expressions Even More Interactive At The REPL?
Hi Guixers, How can we make g-expressions even more interactive at the REPL? For example, thing to explore is what can we print instead of '(*approximate*)? Just brainstorming/listing. Let me know if there is some previous thread I should be reading. ps WDYT if we had even more convenience meta-commands for interactive development with g-expressions?
Re: Do substitutes download slowly for you? / Speeding up substitute delivery/mirrors
Hi Philip, On Thu, May 25, 2023 at 1:49 PM Philip McGrath wrote: > > Here are results from Florida, US: > > 2023-05-25 16:28:07 (14.9 MB/s) > 2023-05-25 16:28:53 (52.9 MB/s) > 2023-05-25 16:29:37 (10.5 MB/s) Wow, those are the best Guix speeds I have seen yet, perhaps aside from folks connected to DFN. [1] Would you please share some details about your ISP? From a peering perspective, I think the most interesting part is your ASN. [2] Thanks! Kind regards Felix [1] https://www.dfn.de/en/ [2] https://www.iplocation.net/asn
Re: Do substitutes download slowly for you? / Speeding up substitute delivery/mirrors
Hi, On Thu, May 25, 2023, at 9:52 AM, Christopher Baines wrote: > Hey! > > I was reminded again about substitute download speeds outside of Europe > again today. > > There was some feedback when I sent out a message to guix-devel [1], [2] > a while back. I think the rough summary is that there's anecdotal > evidence that a US mirror helps. > > 1: https://lists.gnu.org/archive/html/guix-devel/2022-05/msg00203.html > 2: https://lists.gnu.org/archive/html/guix-devel/2022-07/msg00163.html Thanks again for setting this up! The us-east mirror makes a big difference for me. The wget output is below, but anecdotally, last week, when I installed Guix on a new Debian installation, my first `guix pull` failed maybe three times due to substitute timeouts before I enabled the mirror. After enabling the mirror, it succeed on the first attempt. Tangentially, a few months ago I was using a very poorly connected network that had the additional annoying property of disconnecting every 10 minutes or so. I got stuck downloading the beginning of one large nar enough times that eventually I gave up. I found, though, that `wget -c` was able to complete the download (though it took several attempts). Adding some similar resume functionality might at least help to mitigate the impact of slow downloads. > > France:wget > https://bordeaux.guix.gnu.org/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 > US:wget > https://bordeaux-us-east-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 > Singapore: wget > https://bordeaux-singapore-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 > > > So please share the output from wget and if you're comfortable doing so, > the rough real world location of where the computer doing the > downloading is. > Here are results from Florida, US: philip@avalon:/tmp$ wget https://bordeaux.guix.gnu.org/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 --2023-05-25 16:27:53-- https://bordeaux.guix.gnu.org/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 Resolving bordeaux.guix.gnu.org (bordeaux.guix.gnu.org)... 185.233.100.56, 2a0c:e300::58 Connecting to bordeaux.guix.gnu.org (bordeaux.guix.gnu.org)|185.233.100.56|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 208615205 (199M) [text/plain] Saving to: ‘078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0’ 078vr3r8mn3yrwzwxw 100%[=>] 198.95M 10.1MB/sin 13s 2023-05-25 16:28:07 (14.9 MB/s) - ‘078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0’ saved [208615205/208615205] philip@avalon:/tmp$ wget https://bordeaux-us-east-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 --2023-05-25 16:28:49-- https://bordeaux-us-east-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 Resolving bordeaux-us-east-mirror.cbaines.net (bordeaux-us-east-mirror.cbaines.net)... 5.161.49.48 Connecting to bordeaux-us-east-mirror.cbaines.net (bordeaux-us-east-mirror.cbaines.net)|5.161.49.48|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 208615205 (199M) [text/plain] Saving to: ‘078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0.1’ 078vr3r8mn3yrwzwxw 100%[=>] 198.95M 55.8MB/sin 3.8s 2023-05-25 16:28:53 (52.9 MB/s) - ‘078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0.1’ saved [208615205/208615205] philip@avalon:/tmp$ wget https://bordeaux-singapore-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 --2023-05-25 16:29:17-- https://bordeaux-singapore-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 Resolving bordeaux-singapore-mirror.cbaines.net (bordeaux-singapore-mirror.cbaines.net)... 64.176.80.78, 2401:c080:1400:71df:5400:4ff:fe73:757d Connecting to bordeaux-singapore-mirror.cbaines.net (bordeaux-singapore-mirror.cbaines.net)|64.176.80.78|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 208615205 (199M) [text/plain] Saving to: ‘078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0.2’ 078vr3r8mn3yrwzwxw 100%[=>] 198.95M 11.4MB/sin 19s 2023-05-25 16:29:37 (10.5 MB/s) - ‘078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0.2’ saved [208615205/208615205]
How many bytes do we add (closure of guix) when adding one new package?
Hi, The initial discussion was about the closure of Guix and that “guix pull” brings graphical libraries. See #63050 [1]. Here, I would like to open a discussion about how Guix scales, i.e. about its size. I am trying to answer the question I am asking as the subject. ;-) It’s another angle to view Andreas and Ludo discussion: :-) >> Note that I do not care so much about the closure size, but about the >> number of packages that are needed to just build guix (although of course >> the two are related). Or otherwise said, the dependencies for "guix pull". > > Yes, understood. Graphviz is not in the closure anyway, it’s a > build-only dependency. Somehow, the closure is increasing: --8<---cut here---start->8--- $ for i in $(seq 1 4); do guix time-machine --commit=v1.$i.0 -- size guix | grep 'total:' ;done total: 410.9 MiB total: 496.0 MiB total: 564.8 MiB total: 637.2 MiB $ guix size guix | grep 'total:' total: 611.2 MiB --8<---cut here---end--->8--- (Yeah, the package guix is not exactly the same as guix itself, but it appears to me a good enough approximation. And my current revision is 14c0380.) Compare: --8<---cut here---start->8--- $ guix time-machine --commit=v1.1.0 -- size guix --sort=self | wc -l 44 $ guix time-machine --commit=v1.4.0 -- size guix --sort=self | wc -l 72 $ guix size guix --sort=self | wc -l 70 --8<---cut here---end--->8--- which is the Andreas’s concern for “exotic” architectures. Moreover, the inflation (in size) is about some packages that are just becoming bigger. --8<---cut here---start->8--- $ guix time-machine --commit=v1.1.0 -- size guix --sort=self | head store item totalself /gnu/store/fp16m5hkzql7jwhvnkm1j1i5qch0arhx-guix-1.1.0rc2-1.9d0d27f 410.9 221.6 53.9% /gnu/store/1mkkv2caiqbdbbd256c4dirfi4kwsacv-guile-2.2.6123.9 44.4 10.8% /gnu/store/ahqgl4h89xqj695lgqvsaf6zh2nhy4pj-glibc-2.29 37.4 35.8 8.7% /gnu/store/2plcy91lypnbbysb18ymnhaw3zwk8pg1-gcc-7.4.0-lib 70.0 32.6 7.9% /gnu/store/n79cf8bvy3k96gjk1rf18d36w40lkwlr-glibc-utf8-locales-2.2913.9 13.9 3.4% /gnu/store/k2m4q2av9hw73hw2jx6qrxqdyh855398-openssl-1.1.1c 76.4 6.4 1.6% /gnu/store/gzp4ig4rdb1qf4i5dy1d9nl0zmj5q09y-ncurses-6.1-2019060975.9 5.9 1.4% /gnu/store/hfvz18igm68p5yz7z4asn6ph363blp1z-gnutls-3.6.9 130.6 5.1 1.2% /gnu/store/b5vjmib411m74lbpf051fnwz3s9zcw79-guile-git-0.3.0 98.8 4.4 1.1% $ guix time-machine --commit=v1.4.0 -- size guix --sort=self | head store item totalself /gnu/store/9nvx97hr8kkr26gzwni2fblfn0yq0xjw-guix-1.4.0rc2 637.2 330.1 51.8% /gnu/store/qlmpcy5zi84m6dikq3fnx5dz38qpczlc-guile-3.0.8130.0 53.0 8.3% /gnu/store/cnfsv9ywaacyafkqdqsv2ry8f01yr7a9-guile-3.0.7129.1 52.0 8.2% /gnu/store/5h2w4qi9hk1qzzgi1w83220ydslinr4s-glibc-2.33 38.3 36.6 5.7% /gnu/store/094bbaq6glba86h1d4cj16xhdi6fk2jl-gcc-10.3.0-lib 71.7 33.4 5.2% /gnu/store/96srhmpmxa20wmsck95g3iq4hb3lz4a0-glib-2.70.2 98.1 15.3 2.4% /gnu/store/mw3py6smb1pk8yx298hd9ivz9lzbksqi-glibc-utf8-locales-2.3313.9 13.9 2.2% /gnu/store/5583c2za2jsn9g6az79rnksgvigwnsk7-util-linux-2.37.2-lib80.7 9.0 1.4% /gnu/store/9rrnm5hdjw7cy96a2a9rfgh6y08wsbmf-ncurses-6.2.2021061977.6 5.9 0.9% $ guix size guix --sort=self | head store item totalself /gnu/store/cgjddvw9zay626z8hyxl0zmn1354c24k-guix-1.4.0-6.dc5430c 611.2 350.2 57.3% /gnu/store/4gvgcfdiz67wv04ihqfa8pqwzsb0qpv5-guile-3.0.9135.0 53.1 8.7% /gnu/store/gsjczqir1wbz8p770zndrpw4rnppmxi3-glibc-2.35 40.6 38.8 6.3% /gnu/store/930nwsiysdvy2x5zv1sf6v7ym75z8ayk-gcc-11.3.0-lib 75.3 34.7 5.7% /gnu/store/nb40pwd37v6i1g4b1fq4l6q4h9px3asr-glib-2.72.3101.3 14.9 2.4% /gnu/store/5fmqijrs5f7vx8mc2q2pmq26yvhb74sm-glibc-utf8-locales-2.3513.9 13.9 2.3% /gnu/store/gwx2sf5wl9bsl21lwv35g5la63bwyy95-util-linux-2.37.4-lib84.3 9.0 1.5% /gnu/store/69wd3pd1hd3j84xr965jj2fk2qmxn0hl-openssl-3.0.8 83.4 8.1 1.3% /gnu/store/bcc053jvsbspdjr17gnnd9dg85b3a0gy-ncurses-6.2.2021061981.2 5.9 1.0% --8<---cut here---end--->8--- Considering Guix itself, one explanation for the increase is the number of packages – assuming the services and other are negligible; “git diff --shortstat” is a good indicator at first sight. Well, we could be more precise about the documentation. Hum, this ugly, --8<---cut here---start->8--- $ for doc in $(for ci in $
Re: Understanding a Golang importer error
Hi, On mer., 24 mai 2023 at 19:29, Felix Lechner via "Development of GNU Guix and the GNU System distribution." wrote: > I would find it more consistent, however, to pick a nearby version (or > the newest version) and emit that package definition, instead. Well, what does it mean “nearby“? From my understanding, it seems better to display a warning, to be non-blocking and provide a recipe where the integrity checksum is missing. For an example, see: https://issues.guix.gnu.org/issue/63647#0-lineno61 > After all, Guix package variables do not care about versions, and > neither do we. Guix and its contributors assume more or less > throughout that nearby versions work fine. Why not here, too? I do not understand what it means. Guix package cares a lot about fixed-output, i.e. about the integrity checksum. :-) Quoting the manual: Operations such as file downloads and version-control checkouts for which the expected content hash is known in advance are modeled as fixed-output derivations. Unlike regular derivations, the outputs of a fixed-output derivation are independent of its inputs—e.g., a source code download produces the same result regardless of the download method and tools being used. https://guix.gnu.org/manual/devel/en/guix.html#Derivations Therefore, you need a mean to express the map between the Guix content-addressed and the outside world working with URIs and often with version label. > We could also prompt the user of 'guix import' to select a tag. Well, I know nothing about Go. Neither about how Go packaging is working. Currently, these tags does not seems appearing in the goproxy (https://proxy.golang.org) which is the information used to construct the recipe, IIUC. > Do the versions perhaps come from the consuming go.mod files that > spell out the version requirements? Please note that, as Attila pointed, some improvements [1,2] for the Go importer are waiting for review in the patch tracker. Help is welcome. ;-) 1: https://issues.guix.gnu.org/issue/55242 2: https://issues.guix.gnu.org/issue/63631 Cheers, simon
Re: Understanding a Golang importer error
Hi, On jeu., 25 mai 2023 at 16:09, Simon Tournier wrote: >> We could also prompt the user of 'guix import' to select a tag. > > Well, I know nothing about Go. Neither about how Go packaging is > working. Currently, these tags does not seems appearing in the goproxy > (https://proxy.golang.org) which is the information used to construct > the recipe, IIUC. I correct myself. :-) See v3 of #63647 which rebases #52362 implementing support of tags. --8<---cut here---start->8--- $ ./pre-inst-env guix import go go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc (define-public go-go-opentelemetry-io-contrib-instrumentation-google-golang-org-grpc-otelgrpc (package (name "go-go-opentelemetry-io-contrib-instrumentation-google-golang-org-grpc-otelgrpc") (version "0.42.0") (source (origin (method git-fetch) (uri (git-reference (url "https://github.com/open-telemetry/opentelemetry-go-contrib";) (commit (string-append "instrumentation/google.golang.org/grpc/otelgrpc/v" version (file-name (git-file-name name version)) (sha256 (base32 "0ny4v9jcv5x6y78dwazsif93r0bcfc17h7rb7q2c9hgnfxx6lap3" (build-system go-build-system) (arguments '(#:import-path "go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc")) (propagated-inputs `(("go-gopkg-in-yaml-v3" ,go-gopkg-in-yaml-v3) ("go-google-golang-org-genproto" ,go-google-golang-org-genproto) ("go-google-golang-org-appengine" ,go-google-golang-org-appengine) ("go-golang-org-x-text" ,go-golang-org-x-text) ("go-golang-org-x-sys" ,go-golang-org-x-sys) ("go-golang-org-x-oauth2" ,go-golang-org-x-oauth2) ("go-golang-org-x-net" ,go-golang-org-x-net) ("go-github-com-pmezard-go-difflib" ,go-github-com-pmezard-go-difflib) ("go-github-com-golang-protobuf" ,go-github-com-golang-protobuf) ("go-github-com-go-logr-stdr" ,go-github-com-go-logr-stdr) ("go-github-com-go-logr-logr" ,go-github-com-go-logr-logr) ("go-github-com-davecgh-go-spew" ,go-github-com-davecgh-go-spew) ("go-cloud-google-com-go-compute-metadata" ,go-cloud-google-com-go-compute-metadata) ("go-cloud-google-com-go-compute" ,go-cloud-google-com-go-compute) ("go-google-golang-org-protobuf" ,go-google-golang-org-protobuf) ("go-google-golang-org-grpc" ,go-google-golang-org-grpc) ("go-go-opentelemetry-io-otel-trace" ,go-go-opentelemetry-io-otel-trace) ("go-go-opentelemetry-io-otel-metric" ,go-go-opentelemetry-io-otel-metric) ("go-go-opentelemetry-io-otel" ,go-go-opentelemetry-io-otel) ("go-github-com-stretchr-testify" ,go-github-com-stretchr-testify))) (home-page "https://go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc";) (synopsis #f) (description #f) (license license:asl2.0))) --8<---cut here---end--->8--- Cheers, simon
Re: Do substitutes download slowly for you? / Speeding up substitute delivery/mirrors
Hey, Chris: El 25/05/23 a las 13:52, Christopher Baines escribió: France:wget https://bordeaux.guix.gnu.org/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 US:wget https://bordeaux-us-east-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 Singapore: wget https://bordeaux-singapore-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 I'm in Colombia, Aburrá Valley, Guix System 5eb1d1b, home network, single user (as far as I know). France: #+begin_example wget https://bordeaux.guix.gnu.org/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 --2023-05-25 10:13:45-- https://bordeaux.guix.gnu.org/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 Resolviendo bordeaux.guix.gnu.org (bordeaux.guix.gnu.org)... 2a0c:e300::58, 185.233.100.56 Conectando con bordeaux.guix.gnu.org (bordeaux.guix.gnu.org)[2a0c:e300::58]:443... conectado. Petición HTTP enviada, esperando respuesta... 200 OK Longitud: 208615205 (199M) [text/plain] Grabando a: «078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0» 078vr3r8mn3yrwzwxw6 100%[===>] 198,95M 985KB/s en 7m 25s 2023-05-25 10:21:12 (457 KB/s) - «078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0» guardado [208615205/208615205] #+end_example US: #+begin_example wget https://bordeaux-us-east-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 --2023-05-25 10:23:22-- https://bordeaux-us-east-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 Resolving bordeaux-us-east-mirror.cbaines.net (bordeaux-us-east-mirror.cbaines.net)... 5.161.49.48 Connecting to bordeaux-us-east-mirror.cbaines.net (bordeaux-us-east-mirror.cbaines.net)|5.161.49.48|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 208615205 (199M) [text/plain] Saving to: '078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0.1' 078vr3r8mn3yrwzwxw6 100%[===>] 198.95M 835KB/s in 3m 25s 2023-05-25 10:26:49 (993 KB/s) - '078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0.1' saved [208615205/208615205] #+end_example Singapore: #+begin_example wget https://bordeaux-singapore-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 --2023-05-25 10:27:36-- https://bordeaux-singapore-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 Resolving bordeaux-singapore-mirror.cbaines.net (bordeaux-singapore-mirror.cbaines.net)... 2401:c080:1400:71df:5400:4ff:fe73:757d, 64.176.80.78 Connecting to bordeaux-singapore-mirror.cbaines.net (bordeaux-singapore-mirror.cbaines.net)|2401:c080:1400:71df:5400:4ff:fe73:757d|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 208615205 (199M) [text/plain] Saving to: '078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0.2' 078vr3r8mn3yrwzwxw6 100%[===>] 198.95M 1.26MB/s in 3m 30s 2023-05-25 10:31:08 (970 KB/s) - '078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0.2' saved [208615205/208615205] #+end_example OpenPGP_0x0AB0D067012F08C3.asc Description: OpenPGP public key OpenPGP_signature Description: OpenPGP digital signature
Re: Do substitutes download slowly for you? / Speeding up substitute delivery/mirrors
On 2023-05-25, Christopher Baines wrote: > France:wget > https://bordeaux.guix.gnu.org/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 > US:wget > https://bordeaux-us-east-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 > Singapore: wget > https://bordeaux-singapore-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 Thanks for revisiting this! > So please share the output from wget and if you're comfortable doing so, > the rough real world location of where the computer doing the > downloading is. Ok, sitting in Portland, Oregon, USA, with native IPv4 and IPv6 over a wireguard VPN routed via Freemont, California, USA... I tested both IPv4 and IPv6 for those that have IPv6 (US mirror only has IPv4). There is constant internet activity from other machines on the local network, so a lot of uncontrolled variables... The results seem to be all over the place, with the best speed result france (IPv4), the second best singapore(IPv6), the worst singapore (IPv4) and second worst the US mirror (IPv4), somewhat surprisingly. Maybe fetching the same content over IPv4 followed up by IPv6 warmed up the disk cache on the server side... but clearly not consistently. My VPN is hosted somewhere with much better internet connectivity, so maybe wireguard manages to queue packets and send them more efficiently for the IPv6 connections... sometimes? --2023-05-25 07:55:21-- https://bordeaux.guix.gnu.org/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 Resolving bordeaux.guix.gnu.org (bordeaux.guix.gnu.org)... 185.233.100.56 Connecting to bordeaux.guix.gnu.org (bordeaux.guix.gnu.org)|185.233.100.56|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 208615205 (199M) [text/plain] Saving to: ‘078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0’ 078vr3r8mn3yrwzwxw64hmcyshic9p3q 100%[==>] 198.95M 1.45MB/sin 56s 2023-05-25 07:56:17 (3.56 MB/s) - ‘078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0’ saved [208615205/208615205] --2023-05-25 07:56:17-- https://bordeaux.guix.gnu.org/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 Resolving bordeaux.guix.gnu.org (bordeaux.guix.gnu.org)... 2a0c:e300::58 Connecting to bordeaux.guix.gnu.org (bordeaux.guix.gnu.org)|2a0c:e300::58|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 208615205 (199M) [text/plain] Saving to: ‘078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0.1’ 078vr3r8mn3yrwzwxw64hmcyshic9p3q 100%[==>] 198.95M 2.61MB/sin 2m 12s 2023-05-25 07:58:30 (1.51 MB/s) - ‘078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0.1’ saved [208615205/208615205] bordeaux-us-east-mirror.cbaines.net has address 5.161.49.48 --2023-05-25 07:58:30-- https://bordeaux-us-east-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 Resolving bordeaux-us-east-mirror.cbaines.net (bordeaux-us-east-mirror.cbaines.net)... 5.161.49.48 Connecting to bordeaux-us-east-mirror.cbaines.net (bordeaux-us-east-mirror.cbaines.net)|5.161.49.48|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 208615205 (199M) [text/plain] Saving to: ‘078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0.2’ 078vr3r8mn3yrwzwxw64hmcyshic9p3q 100%[==>] 198.95M 3.60MB/sin 2m 39s 2023-05-25 08:01:11 (1.25 MB/s) - ‘078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0.2’ saved [208615205/208615205] bordeaux-singapore-mirror.cbaines.net has address 64.176.80.78 bordeaux-singapore-mirror.cbaines.net has IPv6 address 2401:c080:1400:71df:5400:4ff:fe73:757d --2023-05-25 08:01:11-- https://bordeaux-singapore-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 Resolving bordeaux-singapore-mirror.cbaines.net (bordeaux-singapore-mirror.cbaines.net)... 64.176.80.78 Connecting to bordeaux-singapore-mirror.cbaines.net (bordeaux-singapore-mirror.cbaines.net)|64.176.80.78|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 208615205 (199M) [text/plain] Saving to: ‘078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0.3’ 078vr3r8mn3yrwzwxw64hmcyshic9p3q 100%[==>] 198.95M 1.51MB/sin 3m 0s 2023-05-25 08:04:12 (1.11 MB/s) - ‘078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0.3’ saved [208615205/208615205] --2023-05-25 08:04:12-- https://bordeaux-singapore-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 Resolving bordeaux-singapore-mirror.cbaines.net (bordeaux-singapore-mirror.cbaines.net)... 2401:c080:1400:71df:5400:4ff:fe73:757d Connecting to bordeaux-singapore-mirror.cbaines.net (bordeaux-singapore-mirror.cbaines.net)|2401:c080:1400:71df:5400:4ff:fe73:757d|:443... connected. HTTP request sent, awaiting
Re: Do substitutes download slowly for you? / Speeding up substitute delivery/mirrors
Hi Chris! On Thu, May 25, 2023 at 7:14 AM Christopher Baines wrote: > > France:wget > https://bordeaux.guix.gnu.org/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 --2023-05-25 07:23:45-- https://bordeaux.guix.gnu.org/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 Resolving bordeaux.guix.gnu.org (bordeaux.guix.gnu.org)... 2a0c:e300::58, 185.233.100.56 Connecting to bordeaux.guix.gnu.org (bordeaux.guix.gnu.org)|2a0c:e300::58|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 208615205 (199M) [text/plain] Saving to: ‘078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0.1’ 078vr3r8mn3yrwzwxw64hmcyshic9 100%[===>] 198.95M 1.70MB/sin 1m 47s 2023-05-25 07:25:33 (1.86 MB/s) - ‘078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0.1’ saved [208615205/208615205] > US:wget > https://bordeaux-us-east-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 --2023-05-25 07:20:43-- https://bordeaux-us-east-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 Resolving bordeaux-us-east-mirror.cbaines.net (bordeaux-us-east-mirror.cbaines.net)... 5.161.49.48 Connecting to bordeaux-us-east-mirror.cbaines.net (bordeaux-us-east-mirror.cbaines.net)|5.161.49.48|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 208615205 (199M) [text/plain] Saving to: ‘078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0’ 078vr3r8mn3yrwzwxw64hmcyshic9 100%[===>] 198.95M 7.16MB/sin 35s 2023-05-25 07:21:18 (5.70 MB/s) - ‘078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0’ saved [208615205/208615205] > Singapore: wget > https://bordeaux-singapore-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 --2023-05-25 07:25:41-- https://bordeaux-singapore-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 Resolving bordeaux-singapore-mirror.cbaines.net (bordeaux-singapore-mirror.cbaines.net)... 2401:c080:1400:71df:5400:4ff:fe73:757d, 64.176.80.78 Connecting to bordeaux-singapore-mirror.cbaines.net (bordeaux-singapore-mirror.cbaines.net)|2401:c080:1400:71df:5400:4ff:fe73:757d|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 208615205 (199M) [text/plain] Saving to: ‘078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0.2’ 078vr3r8mn3yrwzwxw64hmcyshi 47%[==> ] 95.41M 1.36MB/seta 60s ^078vr3r8mn3yrwzwxw64hmcyshic9 100%[===>] 198.95M 3.60MB/sin 92s 2023-05-25 07:27:15 (2.16 MB/s) - ‘078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0.2’ saved [208615205/208615205] > So please share the output from wget and if you're comfortable doing so, > the rough real world location of where the computer doing the > downloading is. I am located in a home connected via a consumer-grade microwave link from Sail Internet and then via fiber to their hub in Hurricane Electric's FMT2 data center, which is about three miles away. My static IP is 208.82.101.137, or sail-ipv4.us-core.com. Typical downlink speeds are 200-300 Mbps. Thanks for operating and maintaining the Bordeaux build farm! Kind regards Felix
Do substitutes download slowly for you? / Speeding up substitute delivery/mirrors
Hey! I was reminded again about substitute download speeds outside of Europe again today. There was some feedback when I sent out a message to guix-devel [1], [2] a while back. I think the rough summary is that there's anecdotal evidence that a US mirror helps. 1: https://lists.gnu.org/archive/html/guix-devel/2022-05/msg00203.html 2: https://lists.gnu.org/archive/html/guix-devel/2022-07/msg00163.html While I did stop running a mirror in Singapore, it's now back and from the discussion on IRC today [3] there was some anecdotal evidence that this helps with fetching substitutes from China. 3: https://logs.guix.gnu.org/guix/2023-05-25.log#142624 Once again it would be good to gather some data on this, so here are some test commands. I'm interested to see how France compares with either the US or Singapore depending on your location. If you think that none of these locations serve you well, then please say that plus give some indication of what download speeds you see for things that download quickly. France:wget https://bordeaux.guix.gnu.org/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 US:wget https://bordeaux-us-east-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 Singapore: wget https://bordeaux-singapore-mirror.cbaines.net/nar/lzip/078vr3r8mn3yrwzwxw64hmcyshic9p3q-stellarium-0.21.0 So please share the output from wget and if you're comfortable doing so, the rough real world location of where the computer doing the downloading is. So as an example, I'm in the United Kingdom, and here's what I see downloading from bordeaux.guix.gnu.org (France): → wget https://bordeaux.guix.gnu.org/nar/lzip/hyc5kb21vfdq9hb3snmkg2xsygbwzzsm-stellarium-23.1 --2023-05-25 15:02:49-- https://bordeaux.guix.gnu.org/nar/lzip/hyc5kb21vfdq9hb3snmkg2xsygbwzzsm-stellarium-23.1 Resolving bordeaux.guix.gnu.org (bordeaux.guix.gnu.org)... 2a0c:e300::58, 185.233.100.56 Connecting to bordeaux.guix.gnu.org (bordeaux.guix.gnu.org)|2a0c:e300::58|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 261054076 (249M) [text/plain] Saving to: ‘hyc5kb21vfdq9hb3snmkg2xsygbwzzsm-stellarium-23.1’ hyc5kb21vfdq9hb3snmkg2xsygbwzz 100%[==>] 248.96M 3.80MB/s in 66s 2023-05-25 15:03:55 (3.78 MB/s) - ‘hyc5kb21vfdq9hb3snmkg2xsygbwzzsm-stellarium-23.1’ saved [261054076/261054076] My internet connection is slow enough that I don't see much difference when I try the mirrors. Let me know if you have any comments or questions, and of course I'm interested to see how well substitute downloading works for you! Thanks, Chris signature.asc Description: PGP signature