Re: Preparing the reduced bootstrap tarballs, take 3

[Mark H Weaver]

Hi Ludovic,

Ludovic Courtès  writes:

> Mark H Weaver  skribis:
>
>> What commit did you use?  It would be good to document this, so that
>> others can independently verify our bootstrap binaries, now or in the
>> future.
>
> The commit appears in the commit log and in this very thread, no?

Yes, thanks.  I'm glad to see it in the commit log.  I thought it might
also be worthy of documentation in our source tree, possibly in HACKING,
for the sake of those who wish to independently verify our bootstrap
binaries in the future.  However, it's not something that I feel
strongly about.

 Thanks,
   Mark

Re: Preparing the reduced bootstrap tarballs, take 3

[Ludovic Courtès]

Mark H Weaver  skribis:

> Ludovic Courtès  writes:
>
>> Mark H Weaver  skribis:
>>
>>> Ludovic Courtès  writes:
>>>
 Jan Nieuwenhuizen  skribis:

> Ludovic Courtès writes:
>
> Hi!
>
>> I’ve just uploaded these to
>> :
>>
>>   linux-libre-headers-stripped-4.14.67-i686-linux.tar.xz
>>   linux-libre-headers-stripped-4.14.67-i686-linux.tar.xz.sig
>>   mescc-tools-static-0.5.2-0.bb062b0-i686-linux.tar.xz
>>   mescc-tools-static-0.5.2-0.bb062b0-i686-linux.tar.xz.sig
>>   mes-minimal-stripped-0.18-0.08f04f5-i686-linux.tar.xz
>>   mes-minimal-stripped-0.18-0.08f04f5-i686-linux.tar.xz.sig
>
> Great!
>
>> Could you adjust bootstrap.scm to refer to this URL?  Currently I see
>> bootstrap.scm refers to a different version of
>> linux-libre-headers-stripped so it should be the only one whose hash
>> needs to be changed.
>
> I don't see that...and the hash matches.

 We’ve discussed it in person, and now I think we’re all set!  :-)
>>>
>>> Does our documentation include instructions on how to reproducibly build
>>> these new bootstrap binaries, to independently verify them?
>>
>> The build procedure remains unchanged (info "(guix) Bootstrapping"):
>>
>>   guix build bootstrap-tarballs
>>
>> To verify them, you can do what I described in this thread, which is to
>> use the same commit as Janneke and myself used, run “guix build
>> bootstrap-tarballs”, and compare the three tarballs listed above.
>
> What commit did you use?  It would be good to document this, so that
> others can independently verify our bootstrap binaries, now or in the
> future.

The commit appears in the commit log and in this very thread, no?

Ludo’.

Re: Preparing the reduced bootstrap tarballs, take 3

[Mark H Weaver]

Ludovic Courtès  writes:

> Mark H Weaver  skribis:
>
>> Ludovic Courtès  writes:
>>
>>> Jan Nieuwenhuizen  skribis:
>>>
 Ludovic Courtès writes:

 Hi!

> I’ve just uploaded these to
> :
>
>   linux-libre-headers-stripped-4.14.67-i686-linux.tar.xz
>   linux-libre-headers-stripped-4.14.67-i686-linux.tar.xz.sig
>   mescc-tools-static-0.5.2-0.bb062b0-i686-linux.tar.xz
>   mescc-tools-static-0.5.2-0.bb062b0-i686-linux.tar.xz.sig
>   mes-minimal-stripped-0.18-0.08f04f5-i686-linux.tar.xz
>   mes-minimal-stripped-0.18-0.08f04f5-i686-linux.tar.xz.sig

 Great!

> Could you adjust bootstrap.scm to refer to this URL?  Currently I see
> bootstrap.scm refers to a different version of
> linux-libre-headers-stripped so it should be the only one whose hash
> needs to be changed.

 I don't see that...and the hash matches.
>>>
>>> We’ve discussed it in person, and now I think we’re all set!  :-)
>>
>> Does our documentation include instructions on how to reproducibly build
>> these new bootstrap binaries, to independently verify them?
>
> The build procedure remains unchanged (info "(guix) Bootstrapping"):
>
>   guix build bootstrap-tarballs
>
> To verify them, you can do what I described in this thread, which is to
> use the same commit as Janneke and myself used, run “guix build
> bootstrap-tarballs”, and compare the three tarballs listed above.

What commit did you use?  It would be good to document this, so that
others can independently verify our bootstrap binaries, now or in the
future.

 Thanks,
   Mark

Re: Preparing the reduced bootstrap tarballs, take 3

[Jan Nieuwenhuizen]

Ludovic Courtès writes:

>> Does our documentation include instructions on how to reproducibly build
>> these new bootstrap binaries, to independently verify them?
>
> The build procedure remains unchanged (info "(guix) Bootstrapping"):
>
>   guix build bootstrap-tarballs
>
> To verify them, you can do what I described in this thread, which is to
> use the same commit as Janneke and myself used, run “guix build
> bootstrap-tarballs”, and compare the three tarballs listed above.

Note however that while you're very welcome to do so now, Ricardo and
are working on at least a new mes-minimal-stripped-tarball that I
expect any day now.

janneke

-- 
Jan Nieuwenhuizen  | GNU LilyPond http://lilypond.org
Freelance IT http://JoyofSource.com | Avatar® http://AvatarAcademy.com

Re: Preparing the reduced bootstrap tarballs, take 3

[Ludovic Courtès]

Hi Mark,

Mark H Weaver  skribis:

> Ludovic Courtès  writes:
>
>> Jan Nieuwenhuizen  skribis:
>>
>>> Ludovic Courtès writes:
>>>
>>> Hi!
>>>
 I’ve just uploaded these to
 :

   linux-libre-headers-stripped-4.14.67-i686-linux.tar.xz
   linux-libre-headers-stripped-4.14.67-i686-linux.tar.xz.sig
   mescc-tools-static-0.5.2-0.bb062b0-i686-linux.tar.xz
   mescc-tools-static-0.5.2-0.bb062b0-i686-linux.tar.xz.sig
   mes-minimal-stripped-0.18-0.08f04f5-i686-linux.tar.xz
   mes-minimal-stripped-0.18-0.08f04f5-i686-linux.tar.xz.sig
>>>
>>> Great!
>>>
 Could you adjust bootstrap.scm to refer to this URL?  Currently I see
 bootstrap.scm refers to a different version of
 linux-libre-headers-stripped so it should be the only one whose hash
 needs to be changed.
>>>
>>> I don't see that...and the hash matches.
>>
>> We’ve discussed it in person, and now I think we’re all set!  :-)
>
> Does our documentation include instructions on how to reproducibly build
> these new bootstrap binaries, to independently verify them?

The build procedure remains unchanged (info "(guix) Bootstrapping"):

  guix build bootstrap-tarballs

To verify them, you can do what I described in this thread, which is to
use the same commit as Janneke and myself used, run “guix build
bootstrap-tarballs”, and compare the three tarballs listed above.

Ludo’.

Re: Preparing the reduced bootstrap tarballs, take 3

[Mark H Weaver]

Ludovic Courtès  writes:

> Jan Nieuwenhuizen  skribis:
>
>> Ludovic Courtès writes:
>>
>> Hi!
>>
>>> I’ve just uploaded these to
>>> :
>>>
>>>   linux-libre-headers-stripped-4.14.67-i686-linux.tar.xz
>>>   linux-libre-headers-stripped-4.14.67-i686-linux.tar.xz.sig
>>>   mescc-tools-static-0.5.2-0.bb062b0-i686-linux.tar.xz
>>>   mescc-tools-static-0.5.2-0.bb062b0-i686-linux.tar.xz.sig
>>>   mes-minimal-stripped-0.18-0.08f04f5-i686-linux.tar.xz
>>>   mes-minimal-stripped-0.18-0.08f04f5-i686-linux.tar.xz.sig
>>
>> Great!
>>
>>> Could you adjust bootstrap.scm to refer to this URL?  Currently I see
>>> bootstrap.scm refers to a different version of
>>> linux-libre-headers-stripped so it should be the only one whose hash
>>> needs to be changed.
>>
>> I don't see that...and the hash matches.
>
> We’ve discussed it in person, and now I think we’re all set!  :-)

Does our documentation include instructions on how to reproducibly build
these new bootstrap binaries, to independently verify them?

 Thanks,
   Mark

Re: Preparing the reduced bootstrap tarballs, take 3

[Jan Nieuwenhuizen]

Ludovic Courtès writes:

> Jan Nieuwenhuizen  skribis:
>
>> Ludovic Courtès writes:
>>
>> Hi!
>>
>>> I’ve just uploaded these to
>>> :
>>>
>>>   linux-libre-headers-stripped-4.14.67-i686-linux.tar.xz
>>>   linux-libre-headers-stripped-4.14.67-i686-linux.tar.xz.sig
>>>   mescc-tools-static-0.5.2-0.bb062b0-i686-linux.tar.xz
>>>   mescc-tools-static-0.5.2-0.bb062b0-i686-linux.tar.xz.sig
>>>   mes-minimal-stripped-0.18-0.08f04f5-i686-linux.tar.xz
>>>   mes-minimal-stripped-0.18-0.08f04f5-i686-linux.tar.xz.sig
>>
>> Great!
>>
>>> Could you adjust bootstrap.scm to refer to this URL?  Currently I see
>>> bootstrap.scm refers to a different version of
>>> linux-libre-headers-stripped so it should be the only one whose hash
>>> needs to be changed.
>>
>> I don't see that...and the hash matches.
>
> We’ve discussed it in person, and now I think we’re all set!  :-)

Yes, that helped!  Pushed to core-updates as

da3c6a7f19ef1243af725f63c16c8fd92fde33b4
bootstrap: Switch to official bootstrap urls.

janneke

Re: Preparing the reduced bootstrap tarballs, take 3

[Ludovic Courtès]

Jan Nieuwenhuizen  skribis:

> Ludovic Courtès writes:
>
> Hi!
>
>> I’ve just uploaded these to
>> :
>>
>>   linux-libre-headers-stripped-4.14.67-i686-linux.tar.xz
>>   linux-libre-headers-stripped-4.14.67-i686-linux.tar.xz.sig
>>   mescc-tools-static-0.5.2-0.bb062b0-i686-linux.tar.xz
>>   mescc-tools-static-0.5.2-0.bb062b0-i686-linux.tar.xz.sig
>>   mes-minimal-stripped-0.18-0.08f04f5-i686-linux.tar.xz
>>   mes-minimal-stripped-0.18-0.08f04f5-i686-linux.tar.xz.sig
>
> Great!
>
>> Could you adjust bootstrap.scm to refer to this URL?  Currently I see
>> bootstrap.scm refers to a different version of
>> linux-libre-headers-stripped so it should be the only one whose hash
>> needs to be changed.
>
> I don't see that...and the hash matches.

We’ve discussed it in person, and now I think we’re all set!  :-)

Ludo’.

Re: Preparing the reduced bootstrap tarballs, take 3

[Jan Nieuwenhuizen]

Ludovic Courtès writes:

Hi!

> I’ve just uploaded these to
> :
>
>   linux-libre-headers-stripped-4.14.67-i686-linux.tar.xz
>   linux-libre-headers-stripped-4.14.67-i686-linux.tar.xz.sig
>   mescc-tools-static-0.5.2-0.bb062b0-i686-linux.tar.xz
>   mescc-tools-static-0.5.2-0.bb062b0-i686-linux.tar.xz.sig
>   mes-minimal-stripped-0.18-0.08f04f5-i686-linux.tar.xz
>   mes-minimal-stripped-0.18-0.08f04f5-i686-linux.tar.xz.sig

Great!

> Could you adjust bootstrap.scm to refer to this URL?  Currently I see
> bootstrap.scm refers to a different version of
> linux-libre-headers-stripped so it should be the only one whose hash
> needs to be changed.

I don't see that...and the hash matches.

> Thanks, and let me know if we need anything else!

See attached patch.  Push to my gitlab core-updates-next, not to
savannah yet.

janneke

>From 3cc2f27208de71f9dd0b37593db974b7c1a305f3 Mon Sep 17 00:00:00 2001
From: Jan Nieuwenhuizen 
Date: Sun, 9 Dec 2018 19:05:45 +0100
Subject: [PATCH] bootstrap: Switch to official bootstrap urls.

* gnu/packages/bootstrap.scm (%bootstrap-linux-libre-headers): Switch to
official bootstrap urls.
(%bootstrap-mescc-tools): Likewise.
(%bootstrap-mes): Likewise.
---
 gnu/packages/bootstrap.scm | 41 +-
 1 file changed, 14 insertions(+), 27 deletions(-)

diff --git a/gnu/packages/bootstrap.scm b/gnu/packages/bootstrap.scm
index a835cbc206..eac729f785 100644
--- a/gnu/packages/bootstrap.scm
+++ b/gnu/packages/bootstrap.scm
@@ -405,17 +405,10 @@ $out/bin/guile --version~%"
(lambda (system)
  (origin
(method url-fetch)
-   (uri (match system
-  ("i686-linux"
-   (string-append
-"http://lilypond.org/janneke/guix/20181124/;
-"linux-libre-headers-stripped-4.14.67-i686-linux.tar.xz"))
-  ("x86_64-linux"
-   (string-append
-"http://lilypond.org/janneke/guix/20181124/;
-"linux-libre-headers-stripped-4.14.67-x86_64-linux.tar.xz"))
-  (_ (error "linux-libre-headers-bootstrap: system not supported:"
-(%current-system)
+   (uri (map (cute string-append <>
+   "/i686-linux/20181020/"
+   "linux-libre-headers-stripped-4.14.67-i686-linux.tar.xz")
+ %bootstrap-base-urls))
(sha256
 (base32
  "0sm2z9x4wk45bh6qfs94p0w1d6hsy6dqx9sw38qsqbvxwa1qzk8s"
@@ -656,15 +649,11 @@ exec ~a/bin/.gcc-wrapped -B~a/lib \
 ,(bootstrap-origin
   (origin
 (method url-fetch)
-(uri (string-append
-  "http://lilypond.org/janneke/guix/20181124/;
-  (match (%current-system)
-("i686-linux"
- "mescc-tools-static-0.5.2-0.bb062b0-i686-linux.tar.xz")
-("x86_64-linux"
- "mescc-tools-static-0.5.2-0.bb062b0-x86_64-linux.tar.xz")
-(_ (error "bootstrap-mescc-tools: system not supported:"
-  (%current-system))
+(uri (map
+  (cute string-append <>
+"/i686-linux/20181020/"
+"mescc-tools-static-0.5.2-0.bb062b0-i686-linux.tar.xz")
+  %bootstrap-base-urls))
 (sha256
  (base32
   "11lniw0vg61kmyhvnwkmcnkci9ym6hbmiksiqggd0hkipbq7hvlz")))
@@ -708,13 +697,11 @@ exec ~a/bin/.gcc-wrapped -B~a/lib \
 ,(bootstrap-origin
   (origin
 (method url-fetch)
-(uri (string-append
-  "http://lilypond.org/janneke/guix/20181124/;
-  (match (%current-system)
-("i686-linux"
- "mes-minimal-stripped-0.18-0.08f04f5-i686-linux.tar.xz")
-("x86_64-linux"
- "mes-minimal-stripped-0.18-0.08f04f5-x86_64-linux.tar.xz"
+(uri (map
+  (cute string-append <>
+"/i686-linux/20181020/"
+"mes-minimal-stripped-0.18-0.08f04f5-i686-linux.tar.xz")
+ %bootstrap-base-urls))
 (sha256
  (match (%current-system)
((or "i686-linux" "x86_64-linux")
-- 
2.19.2

Re: Preparing the reduced bootstrap tarballs, take 3

[Ludovic Courtès]

Hello!

l...@gnu.org (Ludovic Courtès) skribis:

> So, on x86_64-linux, here’s what I got:
>
> ludo@ribbon ~/src/guix/+core-updates-next$ ./pre-inst-env guix build 
> bootstrap-tarballs
> /gnu/store/n8lrszv7qf0rwqhibm57d8jykj253bw2-bootstrap-tarballs-0
> ludo@ribbon ~/src/guix/+core-updates-next$ (cd 
> /gnu/store/n8lrszv7qf0rwqhibm57d8jykj253bw2-bootstrap-tarballs-0; for i in * 
> ; do echo $i && guix hash $i ; done )
> guile-static-stripped-2.2.4-x86_64-linux.tar.xz
> 06ygv0b3dpvy93jji5yl4hdz17w4hiqm64m7ypf6g2vi4nfn9xl9
> linux-libre-headers-stripped-4.14.67-x86_64-linux.tar.xz
> 0sm2z9x4wk45bh6qfs94p0w1d6hsy6dqx9sw38qsqbvxwa1qzk8s
> mescc-tools-static-0.5.2-0.bb062b0-x86_64-linux.tar.xz
> 11lniw0vg61kmyhvnwkmcnkci9ym6hbmiksiqggd0hkipbq7hvlz
> mes-minimal-stripped-0.18-0.08f04f5-x86_64-linux.tar.xz
> 0qwpby91hp6afmg5ibdrrk3fw85zxdazfk7rhrdsihsfzqwmfhfx
> static-binaries-0-x86_64-linux.tar.xz
> 0bqyjdbas67wgfwv4rcmr5a5b31l8kk8z6gsidxay7liih5rp5hn
> ludo@ribbon ~/src/guix/+core-updates-next$ git describe
> v0.15.0-3121-g4ae7dc7b9a

I’ve just uploaded these to
:

  linux-libre-headers-stripped-4.14.67-i686-linux.tar.xz
  linux-libre-headers-stripped-4.14.67-i686-linux.tar.xz.sig
  mescc-tools-static-0.5.2-0.bb062b0-i686-linux.tar.xz
  mescc-tools-static-0.5.2-0.bb062b0-i686-linux.tar.xz.sig
  mes-minimal-stripped-0.18-0.08f04f5-i686-linux.tar.xz
  mes-minimal-stripped-0.18-0.08f04f5-i686-linux.tar.xz.sig

Could you adjust bootstrap.scm to refer to this URL?  Currently I see
bootstrap.scm refers to a different version of
linux-libre-headers-stripped so it should be the only one whose hash
needs to be changed.

Thanks, and let me know if we need anything else!

Ludo’.


signature.asc
Description: PGP signature

Re: Preparing the reduced bootstrap tarballs, take 3

[Ludovic Courtès]

Hello,

Jan Nieuwenhuizen  skribis:

> Jan Nieuwenhuizen writes:
>
>>>   
>>> 
>>>
>>> Could you share yours so we can compare?
>>
>> Mine is here
>>
>> 
>> http://lilypond.org/janneke/mes/x86_64-linux/guile-static-stripped-2.2.4-x86_64-linux.tar.xz
>>
>> ...so it looks like we're walking a pretty big round , for --rounds=2 ;-)
>
> Diffoscope output is huge, here is the file diff list (manually edited)

Here’s an excerpt of the differences in the .go files:

--8<---cut here---start->8---
$ diffoscope --exclude-directory-metadata janneke ludo
--- janneke
+++ ludo
├── lib
│ ├── guile
│ │ ├── 2.2
│ │ │ ├── ccache
│ │ │ │ ├── language
│ │ │ │ │ ├── tree-il
│ │ │ │ │ │ ├── effects.go
│ │ │ │ │ │ │ ├── 
/gnu/store/02iklp4swqs0ipxhg5x9b2shmj6b30h1-binutils-2.31.1/bin/readelf --wide 
--decompress --hex-dump=.rodata {}
│ │ │ │ │ │ │ │ @@ -473,38 +473,38 @@
│ │ │ │ │ │ │ │0x00016d78 6c2d3137 63356138 34616166 34633833 
l-17c5a84aaf4c83
│ │ │ │ │ │ │ │0x00016d88 30612d31 3862 2700  
0a-18b..'...
│ │ │ │ │ │ │ │0x00016d98 0900  70726f63 2d6e616d 
proc-nam
│ │ │ │ │ │ │ │0x00016da8 6500  2700  
e...'...
│ │ │ │ │ │ │ │0x00016db8 0400  61726773  
args
│ │ │ │ │ │ │ │0x00016dc8 2700  1600  
'...
│ │ │ │ │ │ │ │0x00016dd8 6c2d3638 30623737 35666233 37613436 
l-680b775fb37a46
│ │ │ │ │ │ │ │ -  0x00016de8 332d3136 6263 2700  
3-16bc..'...
│ │ │ │ │ │ │ │ +  0x00016de8 332d3166 6530 2700  
3-1fe0..'...
│ │ │ │ │ │ │ │0x00016df8 1600  6c2d3638 30623737 
l-680b77
│ │ │ │ │ │ │ │ -  0x00016e08 35666233 37613436 332d3136 6264 
5fb37a463-16bd..
│ │ │ │ │ │ │ │ +  0x00016e08 35666233 37613436 332d3166 6531 
5fb37a463-1fe1..
│ │ │ │ │ │ │ │0x00016e18 2700  0700  
'...
│ │ │ │ │ │ │ │0x00016e28 666f726d 616c7300 2700  
formals.'...
│ │ │ │ │ │ │ │0x00016e38 1600  6c2d3638 30623737 
l-680b77
│ │ │ │ │ │ │ │ -  0x00016e48 35666233 37613436 332d3136 6233 
5fb37a463-16b3..
│ │ │ │ │ │ │ │ +  0x00016e48 35666233 37613436 332d3166 6437 
5fb37a463-1fd7..
│ │ │ │ │ │ │ │0x00016e58 2700  1600  
'...
│ │ │ │ │ │ │ │0x00016e68 6c2d3638 30623737 35666233 37613436 
l-680b775fb37a46
│ │ │ │ │ │ │ │ -  0x00016e78 332d3136 6234 2700  
3-16b4..'...
│ │ │ │ │ │ │ │ +  0x00016e78 332d3166 6438 2700  
3-1fd8..'...
│ │ │ │ │ │ │ │0x00016e88 1600  6c2d3638 30623737 
l-680b77
│ │ │ │ │ │ │ │ -  0x00016e98 35666233 37613436 332d3136 6235 
5fb37a463-16b5..
│ │ │ │ │ │ │ │ +  0x00016e98 35666233 37613436 332d3166 6439 
5fb37a463-1fd9..
--8<---cut here---end--->8---

It clearly looks like the psyntax non-deterministic gensym bug described
at .  I guess we’ll have to give it another
go.

Ludo’.

Re: Preparing the reduced bootstrap tarballs, take 3

[Ludovic Courtès]

Hello,

Jan Nieuwenhuizen  skribis:

> Jan Nieuwenhuizen writes:
>
>>>   
>>> 
>>>
>>> Could you share yours so we can compare?
>>
>> Mine is here
>>
>> 
>> http://lilypond.org/janneke/mes/x86_64-linux/guile-static-stripped-2.2.4-x86_64-linux.tar.xz
>>
>> ...so it looks like we're walking a pretty big round , for --rounds=2 ;-)
>
> Diffoscope output is huge, here is the file diff list (manually edited)

Here’s an excerpt of the differences in the .go files:

--8<---cut here---start->8---
$ diffoscope --exclude-directory-metadata janneke ludo
--- janneke
+++ ludo
├── lib
│ ├── guile
│ │ ├── 2.2
│ │ │ ├── ccache
│ │ │ │ ├── language
│ │ │ │ │ ├── tree-il
│ │ │ │ │ │ ├── effects.go
│ │ │ │ │ │ │ ├── 
/gnu/store/02iklp4swqs0ipxhg5x9b2shmj6b30h1-binutils-2.31.1/bin/readelf --wide 
--decompress --hex-dump=.rodata {}
│ │ │ │ │ │ │ │ @@ -473,38 +473,38 @@
│ │ │ │ │ │ │ │0x00016d78 6c2d3137 63356138 34616166 34633833 
l-17c5a84aaf4c83
│ │ │ │ │ │ │ │0x00016d88 30612d31 3862 2700  
0a-18b..'...
│ │ │ │ │ │ │ │0x00016d98 0900  70726f63 2d6e616d 
proc-nam
│ │ │ │ │ │ │ │0x00016da8 6500  2700  
e...'...
│ │ │ │ │ │ │ │0x00016db8 0400  61726773  
args
│ │ │ │ │ │ │ │0x00016dc8 2700  1600  
'...
│ │ │ │ │ │ │ │0x00016dd8 6c2d3638 30623737 35666233 37613436 
l-680b775fb37a46
│ │ │ │ │ │ │ │ -  0x00016de8 332d3136 6263 2700  
3-16bc..'...
│ │ │ │ │ │ │ │ +  0x00016de8 332d3166 6530 2700  
3-1fe0..'...
│ │ │ │ │ │ │ │0x00016df8 1600  6c2d3638 30623737 
l-680b77
│ │ │ │ │ │ │ │ -  0x00016e08 35666233 37613436 332d3136 6264 
5fb37a463-16bd..
│ │ │ │ │ │ │ │ +  0x00016e08 35666233 37613436 332d3166 6531 
5fb37a463-1fe1..
│ │ │ │ │ │ │ │0x00016e18 2700  0700  
'...
│ │ │ │ │ │ │ │0x00016e28 666f726d 616c7300 2700  
formals.'...
│ │ │ │ │ │ │ │0x00016e38 1600  6c2d3638 30623737 
l-680b77
│ │ │ │ │ │ │ │ -  0x00016e48 35666233 37613436 332d3136 6233 
5fb37a463-16b3..
│ │ │ │ │ │ │ │ +  0x00016e48 35666233 37613436 332d3166 6437 
5fb37a463-1fd7..
│ │ │ │ │ │ │ │0x00016e58 2700  1600  
'...
│ │ │ │ │ │ │ │0x00016e68 6c2d3638 30623737 35666233 37613436 
l-680b775fb37a46
│ │ │ │ │ │ │ │ -  0x00016e78 332d3136 6234 2700  
3-16b4..'...
│ │ │ │ │ │ │ │ +  0x00016e78 332d3166 6438 2700  
3-1fd8..'...
│ │ │ │ │ │ │ │0x00016e88 1600  6c2d3638 30623737 
l-680b77
│ │ │ │ │ │ │ │ -  0x00016e98 35666233 37613436 332d3136 6235 
5fb37a463-16b5..
│ │ │ │ │ │ │ │ +  0x00016e98 35666233 37613436 332d3166 6439 
5fb37a463-1fd9..
--8<---cut here---end--->8---

It clearly looks like the psyntax non-deterministic gensym bug described
at .  I guess we’ll have to give it another
go.

Ludo’.

Re: Preparing the reduced bootstrap tarballs, take 3

[Jan Nieuwenhuizen]

Ludovic Courtès writes:

Hello Ludo',

> Jan Nieuwenhuizen  skribis:
>
>> I have updated core-updates-next with this fix, a documentation update
>> and to also include Marius' mes bootstrap cleanups from his wip-gcc7
>> branch.
>>
>> $ for i in $(./pre-inst-env guix build bootstrap-tarballs)/*; do echo 
>> $i;guix hash $i; done
>> /gnu/store/n8lrszv7qf0rwqhibm57d8jykj253bw2-bootstrap-tarballs-0/guile-static-stripped-2.2.4-x86_64-linux.tar.xz
>> 1285hlbfahp414hy3jjdghxjfgi94aj7y3fw0pz7z27421b7z2f9
>> /gnu/store/n8lrszv7qf0rwqhibm57d8jykj253bw2-bootstrap-tarballs-0/linux-libre-headers-stripped-4.14.67-x86_64-linux.tar.xz

> So, on x86_64-linux, here’s what I got:
>
> ludo@ribbon ~/src/guix/+core-updates-next$ ./pre-inst-env guix build 
> bootstrap-tarballs
> /gnu/store/n8lrszv7qf0rwqhibm57d8jykj253bw2-bootstrap-tarballs-0
> ludo@ribbon ~/src/guix/+core-updates-next$ (cd 
> /gnu/store/n8lrszv7qf0rwqhibm57d8jykj253bw2-bootstrap-tarballs-0; for i in * 
> ; do echo $i && guix hash $i ; done )
> guile-static-stripped-2.2.4-x86_64-linux.tar.xz
> 06ygv0b3dpvy93jji5yl4hdz17w4hiqm64m7ypf6g2vi4nfn9xl9

> So only ‘guile-static-stripped’ differs from yours.

Ah, beautiful!

> This may be due to
> non-determinism in bindings introduced by psyntax (something we
> addressed with , but maybe there are
> remnants around.)  I’ve uploaded mine here:
>
>   
> 
>
> Could you share yours so we can compare?

Mine is here


http://lilypond.org/janneke/mes/x86_64-linux/guile-static-stripped-2.2.4-x86_64-linux.tar.xz

...so it looks like we're walking a pretty big round , for --rounds=2 ;-)


> Anyway, I’ll run the “-s i686-linux” build because right now I only have
> the 64-bit ‘guile-static-stripped’, which is not what we want, silly me…

Oh!  Eh, is that right?  I wasn't aware...

> Should we force #:system for this one as well?

We could but then should make sure that any go files in x86_64-linux
bootstrap binaries (mes, and in time gash) are i686-linux too.

janneke

-- 
Jan Nieuwenhuizen  | GNU LilyPond http://lilypond.org
Freelance IT http://JoyofSource.com | Avatar® http://AvatarAcademy.com

Re: Preparing the reduced bootstrap tarballs, take 3

[Jan Nieuwenhuizen]

Jan Nieuwenhuizen writes:

>>   
>> 
>>
>> Could you share yours so we can compare?
>
> Mine is here
>
> 
> http://lilypond.org/janneke/mes/x86_64-linux/guile-static-stripped-2.2.4-x86_64-linux.tar.xz
>
> ...so it looks like we're walking a pretty big round , for --rounds=2 ;-)

Diffoscope output is huge, here is the file diff list (manually edited)
--8<---cut here---start->8---
18:40:36 janneke@dundal:~/src/ludo [env]
$ PYTHONIOENCODING=utf-8 diffoscope 
~/guile-static-stripped-2.2.4-x86_64-linux.tar.xz 
guile-static-stripped-2.2.4-x86_64-linux.tar.xz |grep .*.go
│ ├── ./lib/guile/2.2/ccache/ice-9/suspendable-ports.go
│ ├── ./lib/guile/2.2/ccache/ice-9/vlist.go
│ ├── ./lib/guile/2.2/ccache/language/cps/effects-analysis.go
│ ├── ./lib/guile/2.2/ccache/language/cps/intmap.go
│ ├── ./lib/guile/2.2/ccache/language/cps/intset.go
│ ├── ./lib/guile/2.2/ccache/language/cps/slot-allocation.go
│ ├── ./lib/guile/2.2/ccache/language/cps/types.go
│ ├── ./lib/guile/2.2/ccache/language/cps/utils.go
│ ├── ./lib/guile/2.2/ccache/srfi/srfi-18.go
│ ├── ./lib/guile/2.2/ccache/srfi/srfi-19.go
│ ├── ./lib/guile/2.2/ccache/srfi/srfi-27.go
--8<---cut here---end--->8---

Not sure if that's useful...hoping the specific names may ring a bell.

Greetings,
janneke

Re: Preparing the reduced bootstrap tarballs, take 3

[Ludovic Courtès]

Hello janneke,

Jan Nieuwenhuizen  skribis:

> I have updated core-updates-next with this fix, a documentation update
> and to also include Marius' mes bootstrap cleanups from his wip-gcc7
> branch.
>
> So, finally for core-updates-next 4ae7dc7b9af64794081b1913740b97acd89c91bc
> here are my lucky numbers
>
> 08:21:04 janneke@dundal:~/src/guix-boot 
> $ for i in $(./pre-inst-env guix build --system=i686-linux 
> bootstrap-tarballs)/*; do echo $i;guix hash $i; done
> /gnu/store/i8rrdivr5ab56kqwbasigp41wqpj1pyp-bootstrap-tarballs-0/guile-static-stripped-2.2.4-i686-linux.tar.xz
> 17p28xv0y1q729idvf2k1dpcfd469akxm8lnf7gd5a7hmnrb28l5
> /gnu/store/i8rrdivr5ab56kqwbasigp41wqpj1pyp-bootstrap-tarballs-0/linux-libre-headers-stripped-4.14.67-i686-linux.tar.xz
> 0sm2z9x4wk45bh6qfs94p0w1d6hsy6dqx9sw38qsqbvxwa1qzk8s
> /gnu/store/i8rrdivr5ab56kqwbasigp41wqpj1pyp-bootstrap-tarballs-0/mescc-tools-static-0.5.2-0.bb062b0-i686-linux.tar.xz
> 11lniw0vg61kmyhvnwkmcnkci9ym6hbmiksiqggd0hkipbq7hvlz
> /gnu/store/i8rrdivr5ab56kqwbasigp41wqpj1pyp-bootstrap-tarballs-0/mes-minimal-stripped-0.18-0.08f04f5-i686-linux.tar.xz
> 0qwpby91hp6afmg5ibdrrk3fw85zxdazfk7rhrdsihsfzqwmfhfx
> /gnu/store/i8rrdivr5ab56kqwbasigp41wqpj1pyp-bootstrap-tarballs-0/static-binaries-0-i686-linux.tar.xz
> 1rs8qh0n6zxmhs0h1b02sydi4vn09qngf3spfpfynkm2n0bxs368
>
> 08:21:10 janneke@dundal:~/src/guix-boot 
> $ for i in $(./pre-inst-env guix build bootstrap-tarballs)/*; do echo $i;guix 
> hash $i; done
> /gnu/store/n8lrszv7qf0rwqhibm57d8jykj253bw2-bootstrap-tarballs-0/guile-static-stripped-2.2.4-x86_64-linux.tar.xz
> 1285hlbfahp414hy3jjdghxjfgi94aj7y3fw0pz7z27421b7z2f9
> /gnu/store/n8lrszv7qf0rwqhibm57d8jykj253bw2-bootstrap-tarballs-0/linux-libre-headers-stripped-4.14.67-x86_64-linux.tar.xz
> 0sm2z9x4wk45bh6qfs94p0w1d6hsy6dqx9sw38qsqbvxwa1qzk8s
> /gnu/store/n8lrszv7qf0rwqhibm57d8jykj253bw2-bootstrap-tarballs-0/mescc-tools-static-0.5.2-0.bb062b0-x86_64-linux.tar.xz
> 11lniw0vg61kmyhvnwkmcnkci9ym6hbmiksiqggd0hkipbq7hvlz
> /gnu/store/n8lrszv7qf0rwqhibm57d8jykj253bw2-bootstrap-tarballs-0/mes-minimal-stripped-0.18-0.08f04f5-x86_64-linux.tar.xz
> 0qwpby91hp6afmg5ibdrrk3fw85zxdazfk7rhrdsihsfzqwmfhfx
> /gnu/store/n8lrszv7qf0rwqhibm57d8jykj253bw2-bootstrap-tarballs-0/static-binaries-0-x86_64-linux.tar.xz
> 0bqyjdbas67wgfwv4rcmr5a5b31l8kk8z6gsidxay7liih5rp5hn
>
> We may want to change the bootstrap downloads for x86_64 in
> bootstrap.scm, mescc-tools-static and mes-minimal-stripped and
> linux-libre-headers-stripped to use the x86_64-linux variants (currently
> we use the i686-linux tarballs); but as you can see their content is
> identical.
>
> Happy verifying ;-)

So, on x86_64-linux, here’s what I got:

--8<---cut here---start->8---
ludo@ribbon ~/src/guix/+core-updates-next$ ./pre-inst-env guix build 
bootstrap-tarballs
/gnu/store/n8lrszv7qf0rwqhibm57d8jykj253bw2-bootstrap-tarballs-0
ludo@ribbon ~/src/guix/+core-updates-next$ (cd 
/gnu/store/n8lrszv7qf0rwqhibm57d8jykj253bw2-bootstrap-tarballs-0; for i in * ; 
do echo $i && guix hash $i ; done )
guile-static-stripped-2.2.4-x86_64-linux.tar.xz
06ygv0b3dpvy93jji5yl4hdz17w4hiqm64m7ypf6g2vi4nfn9xl9
linux-libre-headers-stripped-4.14.67-x86_64-linux.tar.xz
0sm2z9x4wk45bh6qfs94p0w1d6hsy6dqx9sw38qsqbvxwa1qzk8s
mescc-tools-static-0.5.2-0.bb062b0-x86_64-linux.tar.xz
11lniw0vg61kmyhvnwkmcnkci9ym6hbmiksiqggd0hkipbq7hvlz
mes-minimal-stripped-0.18-0.08f04f5-x86_64-linux.tar.xz
0qwpby91hp6afmg5ibdrrk3fw85zxdazfk7rhrdsihsfzqwmfhfx
static-binaries-0-x86_64-linux.tar.xz
0bqyjdbas67wgfwv4rcmr5a5b31l8kk8z6gsidxay7liih5rp5hn
ludo@ribbon ~/src/guix/+core-updates-next$ git describe
v0.15.0-3121-g4ae7dc7b9a
--8<---cut here---end--->8---

So only ‘guile-static-stripped’ differs from yours.  This may be due to
non-determinism in bindings introduced by psyntax (something we
addressed with , but maybe there are
remnants around.)  I’ve uploaded mine here:

  


Could you share yours so we can compare?

Anyway, I’ll run the “-s i686-linux” build because right now I only have
the 64-bit ‘guile-static-stripped’, which is not what we want, silly me…
Should we force #:system for this one as well?

Thanks,
Ludo’.


signature.asc
Description: PGP signature