Re: [RFC] initoverlayfs - a scalable initial filesystem

2023-12-18 Thread Eric Curtin
Yes, your understanding is correct. I'm off at the moment, we will try and open a PR sometime to explain it better. By the way I'd also happily review your PR also if you think you could explain it better. At the moment it's a loopback mounted file from /boot, mounted as an erofs with transient

Re: [RFC] initoverlayfs - a scalable initial filesystem

2023-12-16 Thread Lennart Poettering
On Do, 14.12.23 02:17, Nils Kattenbeck (nilskem...@gmail.com) wrote: > On Wed, Dec 13, 2023 at 10:03 AM Lennart Poettering > wrote: > > > > On Di, 12.12.23 23:01, Nils Kattenbeck (nilskem...@gmail.com) wrote: > > > > > > sysexts are erofs or squashfs file systems with verity backing. Only > > >

Re: [RFC] initoverlayfs - a scalable initial filesystem

2023-12-13 Thread Nils Kattenbeck
On Wed, Dec 13, 2023 at 10:03 AM Lennart Poettering wrote: > > On Di, 12.12.23 23:01, Nils Kattenbeck (nilskem...@gmail.com) wrote: > > > > sysexts are erofs or squashfs file systems with verity backing. Only > > > the sectors you access are decompressed. > > > > Okay I forgot that they were

Re: [RFC] initoverlayfs - a scalable initial filesystem

2023-12-13 Thread Lennart Poettering
On Di, 12.12.23 23:01, Nils Kattenbeck (nilskem...@gmail.com) wrote: > > sysexts are erofs or squashfs file systems with verity backing. Only > > the sectors you access are decompressed. > > Okay I forgot that they were erofs based and mentioned cpio archives > so I assumed they would be one. >

Re: [RFC] initoverlayfs - a scalable initial filesystem

2023-12-12 Thread Nils Kattenbeck
On Tue, Dec 12, 2023 at 10:02 PM Lennart Poettering wrote: > > If you have 7 cpio initrds then the kernel will allocate a tmpfs and > unpack them all into it, one after the other, on top of each other, > and then jumps into the result. > > if you have an erofs and 7 cpio initds, what are you

Re: [RFC] initoverlayfs - a scalable initial filesystem

2023-12-12 Thread Lennart Poettering
On Di, 12.12.23 21:34, Nils Kattenbeck (nilskem...@gmail.com) wrote: > Hi, while I have been following this thread passively for now I also > wanted to chime in. > > > (The main reason why sd-stub doesn't actually support erofs-initrds, > > is that sd-stub also generates initrd cpios on the fly,

Re: [RFC] initoverlayfs - a scalable initial filesystem

2023-12-12 Thread Eric Curtin
On Tue, 12 Dec 2023 at 20:35, Nils Kattenbeck wrote: > > Hi, while I have been following this thread passively for now I also > wanted to chime in. > > > (The main reason why sd-stub doesn't actually support erofs-initrds, > > is that sd-stub also generates initrd cpios on the fly, to pass > >

Re: [RFC] initoverlayfs - a scalable initial filesystem

2023-12-12 Thread Nils Kattenbeck
Hi, while I have been following this thread passively for now I also wanted to chime in. > (The main reason why sd-stub doesn't actually support erofs-initrds, > is that sd-stub also generates initrd cpios on the fly, to pass > credentials and system extension images to the kernel, and you can't

Re: [RFC] initoverlayfs - a scalable initial filesystem

2023-12-12 Thread Demi Marie Obenour
On Tue, Dec 12, 2023 at 06:40:32PM +0100, Lennart Poettering wrote: > On Mo, 11.12.23 12:48, Eric Curtin (ecur...@redhat.com) wrote: > > > Although the nice thing about a storage-init like approach is there's > > basically zero copies up front. What storage-init is trying to be, is > > a tool to

Re: [RFC] initoverlayfs - a scalable initial filesystem

2023-12-12 Thread Stephen Smoogen
On Tue, 12 Dec 2023 at 12:38, Lennart Poettering wrote: > On Mo, 11.12.23 12:48, Eric Curtin (ecur...@redhat.com) wrote: > > > Sort of yes, but preferably using that __initramfs_start / > > initrd_start buffer as is without copying any bytes anywhere else and > > without teaching the bootloaders

Re: [RFC] initoverlayfs - a scalable initial filesystem

2023-12-12 Thread Lennart Poettering
On Mo, 11.12.23 17:03, Eric Curtin (ecur...@redhat.com) wrote: > A generic approach is hard, I think it's worth discussing which type of boots > you should actually care about milliseconds of performance for. It would be > nice > if we had an init system that contained the binary data to do the

Re: [RFC] initoverlayfs - a scalable initial filesystem

2023-12-12 Thread Lennart Poettering
On Mo, 11.12.23 11:28, Demi Marie Obenour (d...@invisiblethingslab.com) wrote: > I don't think this is "a pretty specific solution to one set of devices" > _at all_. To the contrary, it is _exactly_ what I want to see desktop > systems moving to in the future. > > It solves the problem of large

Re: [RFC] initoverlayfs - a scalable initial filesystem

2023-12-12 Thread Lennart Poettering
On Mo, 11.12.23 12:48, Eric Curtin (ecur...@redhat.com) wrote: > Although the nice thing about a storage-init like approach is there's > basically zero copies up front. What storage-init is trying to be, is > a tool to just call systemd storage things, without also inheriting > all the systemd

Re: [RFC] initoverlayfs - a scalable initial filesystem

2023-12-12 Thread Lennart Poettering
On Mo, 11.12.23 12:48, Eric Curtin (ecur...@redhat.com) wrote: > Sort of yes, but preferably using that __initramfs_start / > initrd_start buffer as is without copying any bytes anywhere else and > without teaching the bootloaders to do things. > > The "memmap=" approach you suggested sounds like

Re: [RFC] initoverlayfs - a scalable initial filesystem

2023-12-12 Thread Paul Menzel
[Sorry for the spam to the people in Cc. Now the real address.] Dear Luca, Am 11.12.23 um 22:45 schrieb Luca Boccassi: > On Mon, 11 Dec 2023 at 21:20, Demi Marie Obenour wrote: >> >> On Mon, Dec 11, 2023 at 08:58:58PM +, Luca Boccassi wrote: >>> On Mon, 11 Dec 2023 at 20:43, Demi Marie

Re: [RFC] initoverlayfs - a scalable initial filesystem

2023-12-11 Thread Luca Boccassi
On Mon, 11 Dec 2023 at 21:20, Demi Marie Obenour wrote: > > On Mon, Dec 11, 2023 at 08:58:58PM +, Luca Boccassi wrote: > > On Mon, 11 Dec 2023 at 20:43, Demi Marie Obenour > > wrote: > > > > > > -BEGIN PGP SIGNED MESSAGE- > > > Hash: SHA512 > > > > > > On Mon, Dec 11, 2023 at

Re: [RFC] initoverlayfs - a scalable initial filesystem

2023-12-11 Thread Eric Curtin
On Mon, 11 Dec 2023 at 20:59, Luca Boccassi wrote: > > On Mon, 11 Dec 2023 at 20:43, Demi Marie Obenour > wrote: > > > > -BEGIN PGP SIGNED MESSAGE- > > Hash: SHA512 > > > > On Mon, Dec 11, 2023 at 08:15:27PM +, Luca Boccassi wrote: > > > On Mon, 11 Dec 2023 at 17:30, Demi Marie

Re: [RFC] initoverlayfs - a scalable initial filesystem

2023-12-11 Thread Demi Marie Obenour
On Mon, Dec 11, 2023 at 08:58:58PM +, Luca Boccassi wrote: > On Mon, 11 Dec 2023 at 20:43, Demi Marie Obenour > wrote: > > > > -BEGIN PGP SIGNED MESSAGE- > > Hash: SHA512 > > > > On Mon, Dec 11, 2023 at 08:15:27PM +, Luca Boccassi wrote: > > > On Mon, 11 Dec 2023 at 17:30, Demi

Re: [RFC] initoverlayfs - a scalable initial filesystem

2023-12-11 Thread Luca Boccassi
On Mon, 11 Dec 2023 at 20:43, Demi Marie Obenour wrote: > > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA512 > > On Mon, Dec 11, 2023 at 08:15:27PM +, Luca Boccassi wrote: > > On Mon, 11 Dec 2023 at 17:30, Demi Marie Obenour > > wrote: > > > > > > On Mon, Dec 11, 2023 at 10:57:58AM +0100,

Re: [RFC] initoverlayfs - a scalable initial filesystem

2023-12-11 Thread Demi Marie Obenour
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 On Mon, Dec 11, 2023 at 08:15:27PM +, Luca Boccassi wrote: > On Mon, 11 Dec 2023 at 17:30, Demi Marie Obenour > wrote: > > > > On Mon, Dec 11, 2023 at 10:57:58AM +0100, Lennart Poettering wrote: > > > On Fr, 08.12.23 17:59, Eric Curtin

Re: [RFC] initoverlayfs - a scalable initial filesystem

2023-12-11 Thread Luca Boccassi
On Mon, 11 Dec 2023 at 17:30, Demi Marie Obenour wrote: > > On Mon, Dec 11, 2023 at 10:57:58AM +0100, Lennart Poettering wrote: > > On Fr, 08.12.23 17:59, Eric Curtin (ecur...@redhat.com) wrote: > > > > > Here is the boot sequence with initoverlayfs integrated, the > > > mini-initramfs contains

Re: [RFC] initoverlayfs - a scalable initial filesystem

2023-12-11 Thread Demi Marie Obenour
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 On Mon, Dec 11, 2023 at 05:03:13PM +, Eric Curtin wrote: > On Mon, 11 Dec 2023 at 16:36, Demi Marie Obenour > wrote: > > > > On Mon, Dec 11, 2023 at 10:57:58AM +0100, Lennart Poettering wrote: > > > On Fr, 08.12.23 17:59, Eric Curtin

Re: [RFC] initoverlayfs - a scalable initial filesystem

2023-12-11 Thread Neal Gompa
On Mon, Dec 11, 2023 at 12:30 PM Demi Marie Obenour wrote: > > On Mon, Dec 11, 2023 at 10:57:58AM +0100, Lennart Poettering wrote: > > On Fr, 08.12.23 17:59, Eric Curtin (ecur...@redhat.com) wrote: > > > > > Here is the boot sequence with initoverlayfs integrated, the > > > mini-initramfs

Re: [RFC] initoverlayfs - a scalable initial filesystem

2023-12-11 Thread Eric Curtin
On Mon, 11 Dec 2023 at 16:36, Demi Marie Obenour wrote: > > On Mon, Dec 11, 2023 at 10:57:58AM +0100, Lennart Poettering wrote: > > On Fr, 08.12.23 17:59, Eric Curtin (ecur...@redhat.com) wrote: > > > > > Here is the boot sequence with initoverlayfs integrated, the > > > mini-initramfs contains

Re: [RFC] initoverlayfs - a scalable initial filesystem

2023-12-11 Thread Demi Marie Obenour
On Mon, Dec 11, 2023 at 10:57:58AM +0100, Lennart Poettering wrote: > On Fr, 08.12.23 17:59, Eric Curtin (ecur...@redhat.com) wrote: > > > Here is the boot sequence with initoverlayfs integrated, the > > mini-initramfs contains just enough to get storage drivers loaded and > > storage devices

Re: [RFC] initoverlayfs - a scalable initial filesystem

2023-12-11 Thread Eric Curtin
On Mon, 11 Dec 2023 at 12:48, Eric Curtin wrote: > > On Mon, 11 Dec 2023 at 11:51, Lennart Poettering > wrote: > > > > On Mo, 11.12.23 11:28, Eric Curtin (ecur...@redhat.com) wrote: > > > > > > > For the items listed above I think you can find different solutions > > > > > which do not

Re: [RFC] initoverlayfs - a scalable initial filesystem

2023-12-11 Thread Eric Curtin
On Mon, 11 Dec 2023 at 11:51, Lennart Poettering wrote: > > On Mo, 11.12.23 11:28, Eric Curtin (ecur...@redhat.com) wrote: > > > > > For the items listed above I think you can find different solutions > > > > which do not necessarily compromise security as much. > > > > > > > > So, in the list

Re: [RFC] initoverlayfs - a scalable initial filesystem

2023-12-11 Thread Lennart Poettering
On Mo, 11.12.23 11:42, Eric Curtin (ecur...@redhat.com) wrote: > I am also thinking, what is the difference between "make the > bootloader load the erofs into contiguous memory" part and doing > something like storage-init. Well, from my PoV there's value in reducing the stages of the boot

Re: [RFC] initoverlayfs - a scalable initial filesystem

2023-12-11 Thread Lennart Poettering
On Mo, 11.12.23 11:28, Eric Curtin (ecur...@redhat.com) wrote: > > > For the items listed above I think you can find different solutions > > > which do not necessarily compromise security as much. > > > > > > So, in the list above you could address the latter three like this: > > > > > > 2. Use

Re: [RFC] initoverlayfs - a scalable initial filesystem

2023-12-11 Thread Eric Curtin
I am also thinking, what is the difference between "make the bootloader load the erofs into contiguous memory" part and doing something like storage-init. They are similar approaches, introduce something in the middle to handle the erofs. Is mise le meas/Regards, Eric Curtin On Mon, 11 Dec

Re: [RFC] initoverlayfs - a scalable initial filesystem

2023-12-11 Thread Eric Curtin
On Mon, 11 Dec 2023 at 11:20, Eric Curtin wrote: > > On Mon, 11 Dec 2023 at 10:06, Lennart Poettering wrote: > > > > On Fr, 08.12.23 17:59, Eric Curtin (ecur...@redhat.com) wrote: > > > > > Here is the boot sequence with initoverlayfs integrated, the > > > mini-initramfs contains just enough to

Re: [RFC] initoverlayfs - a scalable initial filesystem

2023-12-11 Thread Eric Curtin
On Mon, 11 Dec 2023 at 10:06, Lennart Poettering wrote: > > On Fr, 08.12.23 17:59, Eric Curtin (ecur...@redhat.com) wrote: > > > Here is the boot sequence with initoverlayfs integrated, the > > mini-initramfs contains just enough to get storage drivers loaded and > > storage devices initialized.

Re: [RFC] initoverlayfs - a scalable initial filesystem

2023-12-11 Thread Lennart Poettering
On Mo, 11.12.23 10:57, Lennart Poettering (mzerq...@0pointer.de) wrote: > Which leaves item 1, which is a bit harder to address. We have been > discussing this off an on internally too. A generic solution to this > is hard. My current thinking for this could be something like this, > covering the

Re: [RFC] initoverlayfs - a scalable initial filesystem

2023-12-11 Thread Lennart Poettering
On Fr, 08.12.23 17:59, Eric Curtin (ecur...@redhat.com) wrote: > Here is the boot sequence with initoverlayfs integrated, the > mini-initramfs contains just enough to get storage drivers loaded and > storage devices initialized. storage-init is a process that is not > designed to replace init, it

Re: [RFC] initoverlayfs - a scalable initial filesystem

2023-12-09 Thread Eric Curtin
On Sat, 9 Dec 2023 at 18:12, Luca Boccassi wrote: > > On Sat, 9 Dec 2023 at 17:58, Eric Curtin wrote: > > > > On Sat, 9 Dec 2023 at 17:46, Luca Boccassi wrote: > > > > > > On Sat, 9 Dec 2023 at 17:25, Eric Curtin wrote: > > > > > > > > On Sat, 9 Dec 2023 at 17:19, Luca Boccassi wrote: > > > >

Re: [RFC] initoverlayfs - a scalable initial filesystem

2023-12-09 Thread Luca Boccassi
On Sat, 9 Dec 2023 at 17:58, Eric Curtin wrote: > > On Sat, 9 Dec 2023 at 17:46, Luca Boccassi wrote: > > > > On Sat, 9 Dec 2023 at 17:25, Eric Curtin wrote: > > > > > > On Sat, 9 Dec 2023 at 17:19, Luca Boccassi wrote: > > > > > > > > On Sat, 9 Dec 2023 at 15:08, Eric Curtin wrote: > > > > >

Re: [RFC] initoverlayfs - a scalable initial filesystem

2023-12-09 Thread Eric Curtin
On Sat, 9 Dec 2023 at 17:46, Luca Boccassi wrote: > > On Sat, 9 Dec 2023 at 17:25, Eric Curtin wrote: > > > > On Sat, 9 Dec 2023 at 17:19, Luca Boccassi wrote: > > > > > > On Sat, 9 Dec 2023 at 15:08, Eric Curtin wrote: > > > > > > > > On Sat, 9 Dec 2023 at 14:56, Andrei Borzenkov > > > >

Re: [RFC] initoverlayfs - a scalable initial filesystem

2023-12-09 Thread Luca Boccassi
On Sat, 9 Dec 2023 at 17:25, Eric Curtin wrote: > > On Sat, 9 Dec 2023 at 17:19, Luca Boccassi wrote: > > > > On Sat, 9 Dec 2023 at 15:08, Eric Curtin wrote: > > > > > > On Sat, 9 Dec 2023 at 14:56, Andrei Borzenkov wrote: > > > > > > > > On 09.12.2023 17:42, Eric Curtin wrote: > > > > > On

Re: [RFC] initoverlayfs - a scalable initial filesystem

2023-12-09 Thread Eric Curtin
On Sat, 9 Dec 2023 at 17:19, Luca Boccassi wrote: > > On Sat, 9 Dec 2023 at 15:08, Eric Curtin wrote: > > > > On Sat, 9 Dec 2023 at 14:56, Andrei Borzenkov wrote: > > > > > > On 09.12.2023 17:42, Eric Curtin wrote: > > > > On Sat, 9 Dec 2023 at 12:46, Luca Boccassi wrote: > > > >> > > > >> On

Re: [RFC] initoverlayfs - a scalable initial filesystem

2023-12-09 Thread Luca Boccassi
On Sat, 9 Dec 2023 at 15:08, Eric Curtin wrote: > > On Sat, 9 Dec 2023 at 14:56, Andrei Borzenkov wrote: > > > > On 09.12.2023 17:42, Eric Curtin wrote: > > > On Sat, 9 Dec 2023 at 12:46, Luca Boccassi wrote: > > >> > > >> On Fri, 8 Dec 2023 at 19:00, Eric Curtin wrote: > > >>> > > >>> We have

Re: [RFC] initoverlayfs - a scalable initial filesystem

2023-12-09 Thread Eric Curtin
On Sat, 9 Dec 2023 at 15:23, Daan De Meyer wrote: > > > We have been working on a new initial filesystem called initoverlayfs. > > It is a new filesystem that provides a more scalable approach to > > initial filesystems as opposed to just using initrds. We are writing > > this RFC to the systemd

Re: [RFC] initoverlayfs - a scalable initial filesystem

2023-12-09 Thread Daan De Meyer
> We have been working on a new initial filesystem called initoverlayfs. > It is a new filesystem that provides a more scalable approach to > initial filesystems as opposed to just using initrds. We are writing > this RFC to the systemd and dracut mailing lists (feel free to forward > to UAPI

Re: [RFC] initoverlayfs - a scalable initial filesystem

2023-12-09 Thread Eric Curtin
On Sat, 9 Dec 2023 at 14:56, Andrei Borzenkov wrote: > > On 09.12.2023 17:42, Eric Curtin wrote: > > On Sat, 9 Dec 2023 at 12:46, Luca Boccassi wrote: > >> > >> On Fri, 8 Dec 2023 at 19:00, Eric Curtin wrote: > >>> > >>> We have been working on a new initial filesystem called initoverlayfs. >

Re: [RFC] initoverlayfs - a scalable initial filesystem

2023-12-09 Thread Andrei Borzenkov
On 09.12.2023 17:42, Eric Curtin wrote: On Sat, 9 Dec 2023 at 12:46, Luca Boccassi wrote: On Fri, 8 Dec 2023 at 19:00, Eric Curtin wrote: We have been working on a new initial filesystem called initoverlayfs. It is a new filesystem that provides a more scalable approach to initial

Re: [RFC] initoverlayfs - a scalable initial filesystem

2023-12-09 Thread Eric Curtin
On Sat, 9 Dec 2023 at 12:46, Luca Boccassi wrote: > > On Fri, 8 Dec 2023 at 19:00, Eric Curtin wrote: > > > > We have been working on a new initial filesystem called initoverlayfs. > > It is a new filesystem that provides a more scalable approach to > > initial filesystems as opposed to just

Re: [RFC] initoverlayfs - a scalable initial filesystem

2023-12-09 Thread Luca Boccassi
On Fri, 8 Dec 2023 at 19:00, Eric Curtin wrote: > > We have been working on a new initial filesystem called initoverlayfs. > It is a new filesystem that provides a more scalable approach to > initial filesystems as opposed to just using initrds. We are writing > this RFC to the systemd and dracut