Re: Starting the weekly live images for Bookworm building again

[Holger Levsen]

On Sun, Mar 19, 2023 at 03:13:47PM +, Steve McIntyre wrote:
> So, after some delay from me and some further delays from various
> Debian machines committing suicide [1], I've got bookworm live builds
> running again. \o/

this is great news! thanks and kudos to everyone involved!


-- 
cheers,
Holger

 ⢀⣴⠾⠻⢶⣦⠀
 ⣾⠁⢠⠒⠀⣿⡁  holger@(debian|reproducible-builds|layer-acht).org
 ⢿⡄⠘⠷⠚⠋⠀  OpenPGP: B8BF54137B09D35CF026FE9D 091AB856069AAA1C
 ⠈⠳⣄

40% of homeless people in the United States have full-time jobs.


signature.asc
Description: PGP signature

Re: Starting the weekly live images for Bookworm building again

[Roland Clobus]

My last cross-post. Follow-up please on debian-live

Hello Steve and lists,

On 19/03/2023 16:13, Steve McIntyre wrote:

So, after some delay from me and some further delays from various
Debian machines committing suicide, I've got bookworm live builds
running again. \o/


Thanks for merging the changes.


I've taken Roland's updated patches and tweaked a little more in the
setup.git and live-setup.git repos, and we now have live builds
integrated. Changes I've added:

  * turned on source tarball generation using LB_SOURCE=true, and
disable the external source build that we did for the older
live-wrapper builds


That's a good way to enable the source tarballs. I haven't looked at 
that part of live-build for a while, so the source tarball might need 
some love.



  * when building on casulana, warn about archive updates rather than
restarting builds
  * don't attempt to build i386 live images any more, they're not useful
  * tweaked logging


And an additional change to use the installer images from the repository 
instead of rebuilding them from git [1].

That change is now causing the missing kernel modules for d-i.

I've rebuilding the installer images from git, after the discussion in 
#1006800 [2], to save the d-i team from doing an upload for every single 
kernel bump, while bookworm was not yet in freeze. (That is a recurring 
issue for every release [3])



So, *builds* work fine but I've not *yet* tested actually
booting/using one of these images in any way. I've just triggered a
full build of "testing" live images now, please help test if you can
once they're in place at [2] in a couple of hours from now.

> [2] https://get.debian.org/images/weekly-live-builds/

In openQA [4] the live images that were generated by Jenkins [5]
have been tested for a while now. Now we can switch and use these new 
images instead of the images from Jenkins. Since both images are 
generated by the same script, I wouldn't expect many issues.



I don't yet know how close we are to having full non-free-firmware
integration with the live images; I expect there might be some more
work needed there yet, but I'd love to be proven wrong. :-)


This weekend I've written the missing parts, non-free-firmware images 
are now generated by default by live-build, and the ISO images are still 
bit-for-bit reproducible.


With kind regards,
Roland Clobus

[1] 3cef309a5cfa4758ba33480b170734133b7104b5
[2] https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=1006800
[3] #986506, https://lists.debian.org/debian-boot/2021/03/msg00166.html
[4] https://openqa.debian.net/group_overview/14
[5] https://jenkins.debian.net/view/live/


OpenPGP_signature
Description: OpenPGP digital signature

Re: Starting the weekly live images for Bookworm building again

[Steve McIntyre]

Hey again,

On Tue, Jan 31, 2023 at 03:36:53PM +, Steve McIntyre wrote:
>>
>>As you can see, this affects many teams:
>>* live-setup: a MR to generate all live images for Bookworm [A2]

So, after some delay from me and some further delays from various
Debian machines committing suicide [1], I've got bookworm live builds
running again. \o/

I've taken Roland's updated patches and tweaked a little more in the
setup.git and live-setup.git repos, and we now have live builds
integrated. Changes I've added:

 * turned on source tarball generation using LB_SOURCE=true, and
   disable the external source build that we dod for the older
   live-wrapper builds
 * when building on casulana, warn about archive updates rather than
   restarting builds
 * don't attempt to build i386 live images any more, they're not useful
 * tweaked logging

So, *builds* work fine but I've not *yet* tested actually
booting/using one of these images in any way. I've just triggered a
full build of "testing" live images now, please help test if you can
once they're in place at [2] in a couple of hours from now.

I don't yet know how close we are to having full non-free-firmware
integration with the live images; I expect there might be some more
work needed there yet, but I'd love to be proven wrong. :-)

[1] "yay" for the long-standing tradition of services failing as we
get close to a release: this time it was casulana and salsa...
[2] https://get.debian.org/images/weekly-live-builds/

-- 
Steve McIntyre, Cambridge, UK.st...@einval.com
"...In the UNIX world, people tend to interpret `non-technical user'
 as meaning someone who's only ever written one device driver." -- Daniel Pead

Re: Starting the weekly live images for Bookworm building again

[Cyril Brulebois]

Luna Jernberg  (2023-03-15):
> And now they have not built for 2 days any specific reason?

casulana broke; please refrain from hijacking threads and cross-posting
to so many lists. debian-cd would have done just fine…


Cheers,
-- 
Cyril Brulebois (k...@debian.org)
D-I release manager -- Release team member -- Freelance Consultant


signature.asc
Description: PGP signature

Re: Starting the weekly live images for Bookworm building again

[Luna Jernberg]

And now they have not built for 2 days any specific reason?

On 3/15/23, Holger Wansing  wrote:
> Hi,
>
> Steve McIntyre  wrote (Tue, 31 Jan 2023 15:36:53 +):
>> On Mon, Jan 16, 2023 at 05:35:50PM +0100, Roland Clobus wrote:
>> >* localechooser: A minor fix [A3]
>>
>> No idea about that, leaving for somebody else.
>
> A (small) change, that we want, I guess, to add Curaçao to Carribean
> region,
> where it belongs, and skip no-longer existing country 'Netherlands Antilles'
>
> from the list.
>
> Tested on a local build; works as it should.
> Thus merged.
>
>
> Holger
>
>
> --
> Holger Wansing 
> PGP-Fingerprint: 496A C6E8 1442 4B34 8508  3529 59F1 87CA 156E B076
>
>

Re: Starting the weekly live images for Bookworm building again

[Holger Wansing]

Hi,

Steve McIntyre  wrote (Tue, 31 Jan 2023 15:36:53 +):
> On Mon, Jan 16, 2023 at 05:35:50PM +0100, Roland Clobus wrote:
> >* localechooser: A minor fix [A3]
> 
> No idea about that, leaving for somebody else.

A (small) change, that we want, I guess, to add Curaçao to Carribean region,
where it belongs, and skip no-longer existing country 'Netherlands Antilles' 
from the list.

Tested on a local build; works as it should.
Thus merged.


Holger


-- 
Holger Wansing 
PGP-Fingerprint: 496A C6E8 1442 4B34 8508  3529 59F1 87CA 156E B076

Re: Starting the weekly live images for Bookworm building again

[Steve McIntyre]

Hey Roland,

Apologies for leaving you waiting a while :-/

On Mon, Jan 16, 2023 at 05:35:50PM +0100, Roland Clobus wrote:
>
>This is a follow-up of my mail from 2022-11-21 [A1].
>
>I've made progress in the last two months, but would like to have some merge
>requests approved, to get more traction and to allow others to jump aboard
>and make the live images for Bookworm possible.
>
>As you can see, this affects many teams:
>* live-setup: a MR to generate all live images for Bookworm [A2]

ACK, I'll take a look at this again shortly.

>* localechooser: A minor fix [A3]

No idea about that, leaving for somebody else.

>* live-installer: A better user experience after the installer is finished
>[A4]

Merred just now.

>* live-build: Various installer improvements, including off-line installation
>[A5]

Not sure who might review that, let's see

-- 
Steve McIntyre, Cambridge, UK.st...@einval.com
< Aardvark> I dislike C++ to start with. C++11 just seems to be
handing rope-creating factories for users to hang multiple
instances of themselves.

Re: Starting the weekly live images for Bookworm building again

[Roland Clobus]

Hello lists (sorry for cross-posting to so many lists),

This is a follow-up of my mail from 2022-11-21 [A1].

I've made progress in the last two months, but would like to have some 
merge requests approved, to get more traction and to allow others to 
jump aboard and make the live images for Bookworm possible.


As you can see, this affects many teams:
* live-setup: a MR to generate all live images for Bookworm [A2]
* localechooser: A minor fix [A3]
* live-installer: A better user experience after the installer is 
finished [A4]
* live-build: Various installer improvements, including off-line 
installation [A5]


With kind regards,
Roland Clobus

[A1] https://lists.debian.org/debian-devel/2022/11/msg00221.html
[A2] https://salsa.debian.org/images-team/live-setup/-/merge_requests/2
[A3] 
https://salsa.debian.org/installer-team/localechooser/-/merge_requests/7
[A4] 
https://salsa.debian.org/installer-team/live-installer/-/merge_requests/3

[A5] https://salsa.debian.org/live-team/live-build/-/merge_requests/297


OpenPGP_signature
Description: OpenPGP digital signature