Re: guix pull fails because substitution fails

[zimoun]

Hi,

On Tue, 15 Dec 2020 at 19:14, Thorsten Wilms  wrote:

> Didn’t try that: After several days of always the same failure, `guix
> pull` is suddenly working again. So if this comes down to a networking
> issue, I wonder what went wrong for several days that did not affect
> any other service.

Thanks for the report and the feedback.


>> Ouch!  what I was in mind is that you GC time to time and not keep all
>> these versions. :-) For example, “guix pull --delete-generations=6m”
>> to keep only the last 6 months generations.  Then the next “guix gc”
>> will remove all these old generations; well if you never roll-back to
>> them.
>
> This is a bit embarrasing: I have been using `guix package
> --delete-generations; guix gc --collect-garbage` frequently and up to
> this day did not realize that there’s another “level”, which can be
> dealt with via `guix gc --delete-generations`.

The control is finer. :-) You can type “guix package --list-profiles”
and you should see, at least:

$HOME/.config/guix/current
$HOME/.guix-profile

where $HOME is expanded to yours.

Doing “guix package --delete-generations” only acts on the default
profile which is “~/.guix-profile”.  Therefore, you also need to clean
the profile “~/.config/guix/current” where the current Guix commands
live.  It is a regular profile so you can try:

  guix package -p ~/.config/guix/current --list-installed

or --list-generations (could be big in your case).  But because this
profile is the default one and is the one where Guix is pulled in, then
“guix pull” is the subcommand to manipulate it.

All the best,
simon

Re: guix pull fails because substitution fails

[Thorsten Wilms]

On Tue, 15 Dec 2020 14:24:09 +0100
zimoun  wrote:

> On my machine,
> 
>   guix time-machine --commit=9fe5bb7 \
>-- pull --commit=b828057 -p /tmp/new
> 
> works.  What does it say on your machine?

Didn’t try that: After several days of always the same failure, `guix
pull` is suddenly working again. So if this comes down to a networking
issue, I wonder what went wrong for several days that did not affect
any other service.


> Ouch!  what I was in mind is that you GC time to time and not keep all
> these versions. :-) For example, “guix pull --delete-generations=6m”
> to keep only the last 6 months generations.  Then the next “guix gc”
> will remove all these old generations; well if you never roll-back to
> them.

This is a bit embarrasing: I have been using `guix package
--delete-generations; guix gc --collect-garbage` frequently and up to
this day did not realize that there’s another “level”, which can be
dealt with via `guix gc --delete-generations`.

Many thanks for your help, simon!

-- 
Thorsten Wilms 

Re: guix pull fails because substitution fails

[zimoun]

Hi,

On Mon, 14 Dec 2020 at 17:34, Thorsten Wilms  wrote:
> On Mon, 14 Dec 2020 14:28:48 +0100
> zimoun  wrote:
>
>> You were pulling b828057, but from which commit?
>
> ```
> $: guix describe
> Generation 161Dec 02 2020 14:24:58(current)
>   guix 9fe5bb7
> repository URL: https://git.savannah.gnu.org/git/guix.git
> branch: master
> commit: 9fe5bb7c9217f247a0fbbc72467ba5de3a6ddf03
> ```

On my machine,

  guix time-machine --commit=9fe5bb7 \
   -- pull --commit=b828057 -p /tmp/new

works.  What does it say on your machine?

>> What is the output of “guix pull -l” and “guix package -l”?  What
>> does “guix time-machine –commit=b828057 – help” say?
>
> `guix pull -l` starts with:
> ```
> Generation 1  Nov 07 2018 21:45:53
>   guix b31e156
> repository URL: https://git.savannah.gnu.org/git/guix.git
> branch: master
> commit: b31e1561611ebe4916890183b24e6e13cb83bf59
> ```
> Half an hour later (which makes me think you had something else in
> mind) it ends with:

Ouch!  what I was in mind is that you GC time to time and not keep all
these versions. :-) For example, “guix pull --delete-generations=6m” to
keep only the last 6 months generations.  Then the next “guix gc” will
remove all these old generations; well if you never roll-back to them.

> Generation 161Dec 02 2020 14:24:58(current)
>   guix 9fe5bb7

Anyway, what I had in mind is to roll-back to the previous and try to
pull from this (generation 160 or 159).

> $: guix package -l
>
> Generation 182Nov 14 2020 10:38:14(current)
>   glibc-utf8-locales  2.31out 
> /gnu/store/z7a6sbvqzb5zapwpznmjkq2rsxil6i67-glibc-utf8-locales-2.31

[...]

>   wmctrl  1.07out 
> /gnu/store/011adrqz27gj2yf8l5gnaswg4fwp0d2m-wmctrl-1.07

You should split your profile as explained here:




For your initial problem, I do not know, it seems a transient network
failure.  Maybe try to remove the folder “~/.cache/guix/substitute” and
try again.


All the best,
simon

Re: guix pull fails because substitution fails

[Thorsten Wilms]

On Mon, 14 Dec 2020 14:28:48 +0100
zimoun  wrote:

> You were pulling b828057, but from which commit?

```
$: guix describe
Generation 161  Dec 02 2020 14:24:58(current)
  guix 9fe5bb7
repository URL: https://git.savannah.gnu.org/git/guix.git
branch: master
commit: 9fe5bb7c9217f247a0fbbc72467ba5de3a6ddf03
```

> What is the output of “guix pull -l” and “guix package -l”?  What
> does “guix time-machine –commit=b828057 – help” say?

`guix pull -l` starts with:
```
Generation 1Nov 07 2018 21:45:53
  guix b31e156
repository URL: https://git.savannah.gnu.org/git/guix.git
branch: master
commit: b31e1561611ebe4916890183b24e6e13cb83bf59
```
Half an hour later (which makes me think you had something else in mind) it 
ends with:
```
Generation 161  Dec 02 2020 14:24:58(current)
  guix 9fe5bb7
repository URL: https://git.savannah.gnu.org/git/guix.git
branch: master
commit: 9fe5bb7c9217f247a0fbbc72467ba5de3a6ddf03
  103 new packages: bcachefs-static, bcachefs-tools-static, cgoban, 
cl-array-operations, cl-check-it, cl-clamp, cl-claw-support, cl-clawk, cl-clesh,

News for channel 'guix'
  Local substitute servers discovery is now supported
commit 79f9dee3c4c0e6d21066f142116a537207ae7ba4

The `guix-daemon' can now discover local substitute servers when the 
`--discover' option is passed.  Only the substitute servers started with the 
`--advertise'
option will be discovered.  The network discovery is based on mDNS and 
DNS-SD protocols, using Guile-Avahi library for now.
```

```
$: guix package -l

Generation 182  Nov 14 2020 10:38:14(current)
  glibc-utf8-locales2.31out 
/gnu/store/z7a6sbvqzb5zapwpznmjkq2rsxil6i67-glibc-utf8-locales-2.31
  qrencode  4.0.2   out 
/gnu/store/28kraxb70gcdqxbj85ncr5pwc3g5mkvw-qrencode-4.0.2
  pngcrush  1.8.13  out 
/gnu/store/318yvcifwvs92hhilas877piw4yhjl3r-pngcrush-1.8.13
  font-ibm-plex 4.0.2   out 
/gnu/store/3yb65z1xhmgjgn119d90kpavp0b07nf6-font-ibm-plex-4.0.2
  xmlstarlet1.6.1   out 
/gnu/store/2s8i216vjnavmd00x54qkg2glx18z3gq-xmlstarlet-1.6.1
  rename1.10out 
/gnu/store/v7ii8kkhr57ara7n4ajlm6vajwfx5psc-rename-1.10
  tree  1.8.0   out /gnu/store/9cfirwz0bk3n6gad4dy6qvxzf6kps597-tree-1.8.0
  source-highlight  3.1.9   out 
/gnu/store/n0k5jn8y77d5gjnfiir68lh6cjnm7gqd-source-highlight-3.1.9
  detox 1.3.0   out /gnu/store/7va9kc3wbc4ixrfxxadl557b4353njki-detox-1.3.0
  aspell-dict-de20161207-7-0out 
/gnu/store/y47m34nvj9z5xjkv2w0wi3krvx6z2v8d-aspell-dict-de-20161207-7-0
  zita-convolver4.0.3   out 
/gnu/store/j2iszgvvkn217zz19hn4gql2rqpmsdhn-zita-convolver-4.0.3
  autotalent0.2 out 
/gnu/store/lrbdiwawr7xbcmccjw23bvrzply2n8ic-autotalent-0.2
  jack  0.125.0 out /gnu/store/pz11x36fqzkblmc0vdk10ml94dqf0nv5-jack-0.125.0
  flac  1.3.3   out /gnu/store/99bhlq1y4x4h3jlfhwm5a3v873wk6naz-flac-1.3.3
  gnutls3.6.14  out 
/gnu/store/0f6agk6xk8rcz99907d39nd1vzmc4abq-gnutls-3.6.14
  nss-certs 3.52.1  out 
/gnu/store/0llx3y194278l5ksr4xh9kc64mh8nn8d-nss-certs-3.52.1
  libjpeg   9d  out 
/gnu/store/1qpb4akvgi3l2zcdjrqs1apvzzxksglv-libjpeg-9d
  fdupes2.1.2   out 
/gnu/store/b2bqxnbi2ky56msplvz059fc1xs1ljar-fdupes-2.1.2
  emacs-use-package 2.4 out 
/gnu/store/if9n8w8mkd80xggw01j9pip7vfqqbdnj-emacs-use-package-2.4
  emacs-smex3.0 out 
/gnu/store/h3mir3cxkp34vb34zh2fri44s2gh8wxw-emacs-smex-3.0
  emacs-rainbow-delimiters  2.1.4   out 
/gnu/store/51q75s4q2wn3alcim4j56xmygag5z5c3-emacs-rainbow-delimiters-2.1.4
  emacs-paredit 24  out 
/gnu/store/1wb8yinahw2xqmf8cksg6kmrmapxjl6l-emacs-paredit-24
  emacs-flx 0.6.1   out 
/gnu/store/l5sn7pxrdg8n5v26jvc6wdibdcg16675-emacs-flx-0.6.1
  emacs-company 0.9.13  out 
/gnu/store/2vqbb5n1ak06hjngaxkda8vr6vgifczg-emacs-company-0.9.13
  emacs-column-marker   9   out 
/gnu/store/yshx9xn9rn29yl97xl61pwywnwica8km-emacs-column-marker-9
  emacs-rainbow-mode1.0.5   out 
/gnu/store/ph9cq24d3gvdrh88vwi3idgivzai376p-emacs-rainbow-mode-1.0.5
  emacs-ivy 0.13.1  out 
/gnu/store/i0vbhylrx3c6cy8c1zi3v795kcgg5lab-emacs-ivy-0.13.1
  emacs-counsel 0.13.1  out 
/gnu/store/ss0fjkan5g5bbmfd66azwkn0pqdb4cp9-emacs-counsel-0.13.1
  swh-plugins-lv2   1.0.16  out 
/gnu/store/23kg3l012lj7n4jkqxmd56z5f7nrnivk-swh-plugins-lv2-1.0.16
  mod-utilities 0-2.80ea3ea9f   out 
/gnu/store/arrhn1r72jl6a3kngbrhqwasg9ay8852-mod-utilities-0-2.80ea3ea9f
  gx-voodoo-fuzz-lv20.1 out 
/gnu/store/2zb2yq1408ldhxday3wqdbn4xdbmmr92-gx-voodoo-fuzz-lv2-0.1
  gx-vintage-fuzz-master-lv20.1 out 
/gnu/store/kdadhwgph50qqddw4w93yzf95k9i6mqs-gx-vintage-fuzz-master-lv2-0.1
  gx-tone-mender-lv20-1.b6780b4a3   out 
/gnu/store/213nzjci9fsphjbwdrs4i2l41z1cmdsp-gx-tone-mender-lv2-0-1.b6780b4a3
  gx-switchless-wah-lv2 0-2.7b0869120   out 
/gnu/store/yk1bc7798nhxjxl890fvwnyzjmplvhaz-gx

Re: guix pull fails because substitution fails

[zimoun]

Hi,

On Sat, 12 Dec 2020 at 19:48, Thorsten Wilms  wrote:

> ```
> $ guix pull
>
> Updating channel 'guix' from Git repository at
> 'https://git.savannah.gnu.org/git/guix.git'... Building from this
> channel: guix  https://git.savannah.gnu.org/git/guix.git
> b828057

You were pulling b828057, but from which commit?


> Trying to update a package also fails:
> ´´´
> guix package -u inkscape
> hint: Consider installing the `glibc-utf8-locales' or `glibc-locales'
> package and defining `GUIX_LOCPATH', along these lines:
>
>  guix install glibc-utf8-locales
>  export GUIX_LOCPATH="$HOME/.guix-profile/lib/locale"
>
> See the "Application Setup" section in the manual, for more info.
>
> guix package: warning: Your Guix installation is 10 days old.
> guix package: warning: Consider running 'guix pull' followed by
> 'guix package -u' to get up-to-date packages and security updates.
>
> The following package will be upgraded:
>inkscape (dependencies or package changed)
>
> substitute: following redirection to
> `https://ci.guix.gnu.org/nix-cache-info'... substitute: Backtrace:
> substitute:3 (apply-smob/1 #)
> substitute: In ice-9/boot-9.scm:
> substitute: 705:2  2 (call-with-prompt _ _ # default-prompt-handle…>) substitute: In ice-9/eval.scm:
> substitute: 619:8  1 (_ #(#(#)))
> substitute: In guix/ui.scm:
> substitute:   1579:12  0 (run-guix-command _ . _)
> substitute: 
> substitute: guix/ui.scm:1579:12: In procedure run-guix-command:
> substitute: In procedure put-string: Wrong type argument in position 1
> (expecting open output port): # guix package:
> error: substituter `substitute' died unexpectedly
> ´´´

What is the output of “guix pull -l” and “guix package -l”?  What does “guix
time-machine –commit=b828057 – help” say?


All the best,
simon

guix pull fails because substitution fails

[Thorsten Wilms]

Hi!

Trying to update several days old guix, `guix pull` fails due to “some
substitutes for the outputs of derivation
`/gnu/store/mvf88n2v90jjxg9n8b315p22r6jrkbyb-libx11-1.6.A.drv' failed”

```
$ guix pull

Updating channel 'guix' from Git repository at
'https://git.savannah.gnu.org/git/guix.git'... Building from this
channel: guix  https://git.savannah.gnu.org/git/guix.git
b828057
substituting /gnu/store/q0s3bi0by383cqzl9zz1wf74p6pdl3fc-libx11-1.6.A-doc...
\substitution
of /gnu/store/q0s3bi0by383cqzl9zz1wf74p6pdl3fc-libx11-1.6.A-doc failed
guix pull: error: some substitutes for the outputs of derivation
`/gnu/store/mvf88n2v90jjxg9n8b315p22r6jrkbyb-libx11-1.6.A.drv' failed
(usually happens due to networking issues); try `--fallback' to build
derivation from source
```

If I then try with --fallback I get a long list of substitutions
failing:
´´´
\substitution
of /gnu/store/q0s3bi0by383cqzl9zz1wf74p6pdl3fc-libx11-1.6.A-doc failed
substituting 
/gnu/store/hwcky7446s952w0mwchhmm211ll07zrq-glibc-utf8-locales-2.31...
|substitution
|of /gnu/store/hwcky7446s952w0mwchhmm211ll07zrq-glibc-utf8-locales-2.31
|failed
substituting /gnu/store/n4n560pfvvw50a9369axw5vj5rrqfj1n-diffutils-3.7...
/substitution
of /gnu/store/n4n560pfvvw50a9369axw5vj5rrqfj1n-diffutils-3.7 failed
substituting /gnu/store/mzfkrxd4w8vqrmyrx169wj8wyw7r8i37-bash...
-substitution of /gnu/store/mzfkrxd4w8vqrmyrx169wj8wyw7r8i37-bash
failed
substituting /gnu/store/m89p469fxwn4hj7an9givd1ry9vk7j2l-bash-mesboot0-2.05b...
substituting /gnu/store/l4qq4a2vzh0jv7bvmm18vwx04qawnx44-diffutils-3.7.tar.xz...
|substitution
|of /gnu/store/l4qq4a2vzh0jv7bvmm18vwx04qawnx44-diffutils-3.7.tar.xz
|failed
substituting /gnu/store/mzfkrxd4w8vqrmyrx169wj8wyw7r8i37-bash...
/substitution of /gnu/store/mzfkrxd4w8vqrmyrx169wj8wyw7r8i37-bash failed
substituting /gnu/store/xwanyg9972rpznx89ja38v01c8483392-bash-4.4.tar.gz...
-substitution
of /gnu/store/xwanyg9972rpznx89ja38v01c8483392-bash-4.4.tar.gz failed
substituting /gnu/store/mzfkrxd4w8vqrmyrx169wj8wyw7r8i37-bash...
\substitution of /gnu/store/mzfkrxd4w8vqrmyrx169wj8wyw7r8i37-bash
failed
substituting /gnu/store/m89p469fxwn4hj7an9givd1ry9vk7j2l-bash-mesboot0-2.05b...
|substitution
|of /gnu/store/m89p469fxwn4hj7an9givd1ry9vk7j2l-bash-mesboot0-2.05b
|failed
substituting /gnu/store/mzfkrxd4w8vqrmyrx169wj8wyw7r8i37-bash...
/substitution of /gnu/store/mzfkrxd4w8vqrmyrx169wj8wyw7r8i37-bash failed
substituting /gnu/store/zkkcabiqcy11wy4wkn8bysava6qz8w7v-bash-2.05b.tar.gz...
-substitution
of /gnu/store/zkkcabiqcy11wy4wkn8bysava6qz8w7v-bash-2.05b.tar.gz failed
substituting /gnu/store/90pc8y5hdnj0vsx6lkrnw8zxpjhn5wqc-binutils-2.14.tar.gz...
\substitution
of /gnu/store/90pc8y5hdnj0vsx6lkrnw8zxpjhn5wqc-binutils-2.14.tar.gz
failed
substituting 
/gnu/store/4ypjnj25zxi4p199gpq4jvnlxp6853kh-binutils-2.20.1a.tar.xz...
|substitution
|of /gnu/store/4ypjnj25zxi4p199gpq4jvnlxp6853kh-binutils-2.20.1a.tar.xz
|failed
substituting /gnu/store/fqgdv6rnzgj9zaywbl61xwp5lfc8aba2-binutils-2.34.tar.xz...
/substitution
of /gnu/store/fqgdv6rnzgj9zaywbl61xwp5lfc8aba2-binutils-2.34.tar.xz
failed
substituting 
/gnu/store/kydzdkzwczkvazwljqx3p5ilnmaccqv8-binutils-2.20.1a.tar.bz2...
-substitution
of /gnu/store/kydzdkzwczkvazwljqx3p5ilnmaccqv8-binutils-2.20.1a.tar.bz2
failed
substituting 
/gnu/store/m5aax1v4gn8qiibsid6sdb4cz85gyp7g-binutils-2.34.tar.bz2...
\substitution
of /gnu/store/m5aax1v4gn8qiibsid6sdb4cz85gyp7g-binutils-2.34.tar.bz2
failed
substituting /gnu/store/x75asd2zk2pvh9la3rjnbk8ca8pb8a9l-bootar-1a.ses...
|substitution
|of /gnu/store/x75asd2zk2pvh9la3rjnbk8ca8pb8a9l-bootar-1a.ses failed
substituting /gnu/store/5bdaayvl6cs8nrdivskz4dbrsy2m009c-bootstrap-binaries-0...
/substitution
of /gnu/store/5bdaayvl6cs8nrdivskz4dbrsy2m009c-bootstrap-binaries-0
failed
substituting /gnu/store/3il0ngja1qn6vz72bvmkfxa0b9271nhr-bootstrap-mes-0...
-substitution
of /gnu/store/3il0ngja1qn6vz72bvmkfxa0b9271nhr-bootstrap-mes-0 failed
substituting 
/gnu/store/4imf8knry9ngg1zq9x7asgh2alhlkmg1-bootstrap-mescc-tools-0.5.2...
\substitution
of /gnu/store/4imf8knry9ngg1zq9x7asgh2alhlkmg1-bootstrap-mescc-tools-0.5.2
failed
substituting /gnu/store/q5sqgng4wdzxr6yrvvp706kbxa3fcfjf-bzip2-1.0.8.tar.gz...
|substitution
|of /gnu/store/q5sqgng4wdzxr6yrvvp706kbxa3fcfjf-bzip2-1.0.8.tar.gz
|failed
substituting /gnu/store/x4q8wl1afx621fx8h1b89ixv2nlw5n5m-coreutils-5.0.tar.gz...
/substitution
of /gnu/store/x4q8wl1afx621fx8h1b89ixv2nlw5n5m-coreutils-5.0.tar.gz
failed
substituting 
/gnu/store/iz9282gi50wlb39iblm89wl127j62dwg-coreutils-8.32.tar.xz...
-substitution
of /gnu/store/iz9282gi50wlb39iblm89wl127j62dwg-coreutils-8.32.tar.xz
failed
substituting /gnu/store/4gl5x4lm03dalhx61r9sxnskyh4d7v2c-diffutils-2.7.tar.gz...
\substitution
of /gnu/store/4gl5x4lm03dalhx61r9sxnskyh4d7v2c-diffutils-2.7.tar.gz
failed
substituting 
/gnu/store/ljvdvkmcr8mqkjxij6aklw60ni0xjjn2-coreutils-8.32.tar.xz...
|substitution
|of /gnu/store/ljvdvkmcr8mqkjxij6aklw60ni0xjjn2-coreutils-8.32.tar.xz
|failed
substituting /gnu/st