Re: Why does mingw-filesystem depend on mingw-binutils-generic?

2023-08-30 Thread Daniel P . Berrangé
> > > > Sandro > > > > [1] > > https://src.fedoraproject.org/rpms/mingw-filesystem/blob/rawhide/f/mingw.req > > I see, good point. > > There's a concern in this bug: > > > >https://src.fedoraproject.org/rpms/virt-v2v/pull-request/2

Re: Why does mingw-filesystem depend on mingw-binutils-generic?

2023-08-30 Thread Richard W.M. Jones
On Wed, Aug 30, 2023 at 10:36:26AM +0200, Sandro Mani wrote: > Hi > > I'd say, as least as it stands now, this is because the dependency > generators require mingw-objdump, see mingw.req [1]. > > Sandro > > [1] > https://src.fedoraproject.org/rpms/mingw-filesystem/

Re: Why does mingw-filesystem depend on mingw-binutils-generic?

2023-08-30 Thread Sandro Mani
Hi I'd say, as least as it stands now, this is because the dependency generators require mingw-objdump, see mingw.req [1]. Sandro [1] https://src.fedoraproject.org/rpms/mingw-filesystem/blob/rawhide/f/mingw.req On 30.08.23 10:30, Richard W.M. Jones wrote: https://src.fedoraproject.org

Why does mingw-filesystem depend on mingw-binutils-generic?

2023-08-30 Thread Richard W.M. Jones
https://src.fedoraproject.org/rpms/virt-v2v/pull-request/2 mingw-binutils-generic contains a random selection of binaries: $ rpm -ql mingw-binutils-generic /usr/bin/mingw-nm /usr/bin/mingw-objcopy /usr/bin/mingw-objdump /usr/bin/mingw-strip For unclear reasons, mingw32-filesystem depends

Testing lua-filesystem 1.8.0

2021-01-27 Thread Michel Alexandre Salim
Hi all, lua-filesystem has not been properly updated since 2015; we missed the 1.7.0 release in 2017 and the 1.8.0 release in April last year. The changelogs seem to indicate this should be backward-compatible, but if your package depends on the `lfs` module please test: F32 https

Re: Fedora 34 Change proposal: Reduce installation media size by eliminating the intermediate EXT4 filesystem in the SquashFS (Self-Contained Change)

2020-10-02 Thread Chris Murphy
On Fri, Oct 2, 2020 at 9:10 AM Ben Cotton wrote: > > == How To Test == > The change could be tested by booting ISO images from the compose > below. Regular Fedora test suite should be sufficient to verify this > change. >

Fedora 34 Change proposal: Reduce installation media size by eliminating the intermediate EXT4 filesystem in the SquashFS (Self-Contained Change)

2020-10-02 Thread Ben Cotton
https://fedoraproject.org/wiki/Changes/OptimizeSquashFSOnDVDByRemovingEXT4FilesystemImageLayer == Summary == Change the process of building installation images such that the Squash filesystem image, which is present on netinstall and DVD ISO images, doesn't contain the EXT4 filesystem image

Fedora 34 Change proposal: Reduce installation media size by eliminating the intermediate EXT4 filesystem in the SquashFS (Self-Contained Change)

2020-10-02 Thread Ben Cotton
https://fedoraproject.org/wiki/Changes/OptimizeSquashFSOnDVDByRemovingEXT4FilesystemImageLayer == Summary == Change the process of building installation images such that the Squash filesystem image, which is present on netinstall and DVD ISO images, doesn't contain the EXT4 filesystem image

Re: F34 Change: Reduce installation media size by improving the compression ratio of SquashFS filesystem (Self-Contained Change)

2020-10-02 Thread Bohdan Khomutskyi
Hello, I filed another change proposal, which is related to the original one: https://fedoraproject.org/wiki/Changes/OptimizeSquashFSOnDVDByRemovingEXT4FilesystemImageLayer The new proposal does not change compression parameters of the SquashFS image on DVD. On 18/09/2020 12:54, Zbigniew

Re: F34 Change: Reduce installation media size by improving the compression ratio of SquashFS filesystem (Self-Contained Change)

2020-09-18 Thread Zbigniew Jędrzejewski-Szmek
On Fri, Sep 18, 2020 at 09:31:59AM +0200, Bohdan Khomutskyi wrote: > Hello Zbyszek, > > > You haven't really answered the "why" part: why is it so important to > save 50MB? And why is the effect on QA less important? > > From my perspective, the storage on the installation medium should > be

Re: F34 Change: Reduce installation media size by improving the compression ratio of SquashFS filesystem (Self-Contained Change)

2020-09-18 Thread Bohdan Khomutskyi
available data I previously posted for Fedora Live images at https://fedoraproject.org/wiki/Changes/OptimizeSquashFS As a reminder, there are 2 levels for this optimization: 1. Making the SquashFS filesystem on the DVD plain (i.e. without embedded EXT4 inside it) -- has the suffix plain-xz-128k.

Re: F34 Change: Reduce installation media size by improving the compression ratio of SquashFS filesystem (Self-Contained Change)

2020-09-16 Thread Kevin Kofler
Gary Buhrmaster wrote: > Some people download once, and install once. For > those, it is pay me now, or pay me later, and it may > be a wash, time wise, depending on your download > speeds, but it is also just a one time thing in any > case. Some people download once, and install lots > of times

Re: F34 Change: Reduce installation media size by improving the compression ratio of SquashFS filesystem (Self-Contained Change)

2020-09-15 Thread Gary Buhrmaster
On Tue, Sep 15, 2020 at 11:47 PM Kevin Kofler wrote: > There still exist connections as slow as 33 kbps. And no doubt you can find people still using 300 baud TI Silent 700 terminals. However, the global internet speed tests show that the numbers are much higher on average, and we should

Re: F34 Change: Reduce installation media size by improving the compression ratio of SquashFS filesystem (Self-Contained Change)

2020-09-15 Thread Samuel Sieb
On 9/15/20 4:46 PM, Kevin Kofler wrote: There still exist connections as slow as 33 kbps. At that speed, 142 MB take at least 10 hours to download (probably more because 1 data byte takes more than 8 raw bits to transfer and because the theoretical speed cannot always be sustained). Depending on

Re: F34 Change: Reduce installation media size by improving the compression ratio of SquashFS filesystem (Self-Contained Change)

2020-09-15 Thread Kevin Kofler
Frantisek Zatloukal wrote: > Saving 142 MBs isn't going to make a huge difference in download times > (disclaimer: I don't know how is the internet connection > speed in other areas, I have not that fast connection of 200mbps down > (slowest possible in my area), so 142 MB saving would make

Re: F34 Change: Reduce installation media size by improving the compression ratio of SquashFS filesystem (Self-Contained Change)

2020-09-15 Thread Kevin Kofler
Kamil Paral wrote: > Each image is downloaded just once, but installed 1+ times. Most end users install the image exactly once. Kevin Kofler ___ devel mailing list -- devel@lists.fedoraproject.org To unsubscribe send an email to

Re: F34 Change: Reduce installation media size by improving the compression ratio of SquashFS filesystem (Self-Contained Change)

2020-09-15 Thread Zbigniew Jędrzejewski-Szmek
ders/1tGsoqFMg2A6dQZHfuQNb9uDqYu9XEiPI > > The result of benchmark will supplement already available data I > previously posted for Fedora Live images at > https://fedoraproject.org/wiki/Changes/OptimizeSquashFS > > As a reminder, there are 2 levels for this optimization: > > 1.

Re: F34 Change: Reduce installation media size by improving the compression ratio of SquashFS filesystem (Self-Contained Change)

2020-09-15 Thread Bohdan Khomutskyi
at https://fedoraproject.org/wiki/Changes/OptimizeSquashFS As a reminder, there are 2 levels for this optimization: 1. Making the SquashFS filesystem on the DVD plain (i.e. without embedded EXT4 inside it) -- has the suffix plain-xz-128k.iso 2. In addition to #1, using a different compression

Re: F34 Change: Reduce installation media size by improving the compression ratio of SquashFS filesystem (Self-Contained Change)

2020-09-07 Thread Bohdan Khomutskyi
wiki/Changes/OptimizeSquashFS > > == Summary == > Improve compression ratio of SquashFS filesystem on the installation > media. > ... > > Based on the results above, I'd suggest selecting the following > ''optimal configuration'': XZ algorithm, with

Re: F34 Change: Reduce installation media size by improving the compression ratio of SquashFS filesystem (Self-Contained Change)

2020-09-05 Thread Zbigniew Jędrzejewski-Szmek
On Thu, Aug 27, 2020 at 11:13:26AM -0400, Ben Cotton wrote: > https://fedoraproject.org/wiki/Changes/OptimizeSquashFS ... > Based on the results above, I'd suggest selecting the following > ''optimal configuration'': XZ algorithm, with block size of 1MiB and > without BCJ filter (plain xz -b 1M,

Re: F34 Change: Reduce installation media size by improving the compression ratio of SquashFS filesystem (Self-Contained Change)

2020-09-04 Thread Kamil Paral
On Fri, Sep 4, 2020 at 6:17 AM John Reiser wrote: > On 2020-09-01 at 12:13 UTC, Kamil Paral wrote: > [[snip]] > > I'd like to ... hugely speed up the installation instead > [[snip]] > > Zstd is faster than xz at de-compression, but a much larger speed > improvement > would be to

Re: F34 Change: Reduce installation media size by improving the compression ratio of SquashFS filesystem (Self-Contained Change)

2020-09-03 Thread John Reiser
installed in parallel. Even for scriptlets that might force serialization [such as selinux], all processing before the first Write-to- destination-filesystem can be parallel. For any individual .rpm, the stages of fetch the package (from network, USB flash memory, DVD, etc.), decompress, and process the

Re: F34 Change: Reduce installation media size by improving the compression ratio of SquashFS filesystem (Self-Contained Change)

2020-09-03 Thread Kevin Fenzi
On Thu, Sep 03, 2020 at 11:30:10AM +0200, Kamil Paral wrote: > On Wed, Sep 2, 2020 at 8:28 PM Matthew Miller > wrote: > > > On Tue, Sep 01, 2020 at 02:13:21PM +0200, Kamil Paral wrote: > > > Bohdan, could you build the same image in several configurations (the > > most > > > likely candidates)

Re: F34 Change: Reduce installation media size by improving the compression ratio of SquashFS filesystem (Self-Contained Change)

2020-09-03 Thread Kamil Paral
On Wed, Sep 2, 2020 at 8:28 PM Matthew Miller wrote: > On Tue, Sep 01, 2020 at 02:13:21PM +0200, Kamil Paral wrote: > > Bohdan, could you build the same image in several configurations (the > most > > likely candidates) and share them with us? (We can host them in our QA > > fedorapeople space,

Re: F34 Change: Reduce installation media size by improving the compression ratio of SquashFS filesystem (Self-Contained Change)

2020-09-02 Thread Matthew Miller
On Tue, Sep 01, 2020 at 02:13:21PM +0200, Kamil Paral wrote: > Bohdan, could you build the same image in several configurations (the most > likely candidates) and share them with us? (We can host them in our QA > fedorapeople space, if needed). That would allow interested parties to test > and

Re: F34 Change: Reduce installation media size by improving the compression ratio of SquashFS filesystem (Self-Contained Change)

2020-09-01 Thread Chris Murphy
On Tue, Sep 1, 2020 at 3:22 AM Frantisek Zatloukal wrote: > > > > On Thu, Aug 27, 2020 at 5:16 PM Ben Cotton wrote: >> >> https://fedoraproject.org/wiki/Changes/OptimizeSquashFS >> >> == Summary == >> Improve compression ratio of SquashFS filesystem

Re: F34 Change: Reduce installation media size by improving the compression ratio of SquashFS filesystem (Self-Contained Change)

2020-09-01 Thread Ben Cotton
On Tue, Sep 1, 2020 at 5:23 AM Frantisek Zatloukal wrote: > > Saving 142 MBs isn't going to make a huge difference in download times > (disclaimer: I don't know how is the internet connection speed in other > areas, I have not that fast connection of 200mbps down (slowest possible in > my

Re: F34 Change: Reduce installation media size by improving the compression ratio of SquashFS filesystem (Self-Contained Change)

2020-09-01 Thread Kamil Paral
On Fri, Aug 28, 2020 at 12:55 AM Michel Alexandre Salim < mic...@michel-slm.name> wrote: > On Thu, 2020-08-27 at 11:13 -0400, Ben Cotton wrote: > > https://fedoraproject.org/wiki/Changes/OptimizeSquashFS > > > > == Summary == > > Improve compres

Re: F34 Change: Reduce installation media size by improving the compression ratio of SquashFS filesystem (Self-Contained Change)

2020-09-01 Thread Frantisek Zatloukal
On Thu, Aug 27, 2020 at 5:16 PM Ben Cotton wrote: > https://fedoraproject.org/wiki/Changes/OptimizeSquashFS > > == Summary == > Improve compression ratio of SquashFS filesystem on the installation media. > > == Owner == > * Name: [[User:bkhomuts|Bohdan Khomutskyi]] > * Em

Re: F34 Change: Reduce installation media size by improving the compression ratio of SquashFS filesystem (Self-Contained Change)

2020-08-27 Thread Michel Alexandre Salim
On Thu, 2020-08-27 at 11:13 -0400, Ben Cotton wrote: > https://fedoraproject.org/wiki/Changes/OptimizeSquashFS > > == Summary == > Improve compression ratio of SquashFS filesystem on the installation > media. > ... > > Based on the results above, I'd suggest selecting t

F34 Change: Reduce installation media size by improving the compression ratio of SquashFS filesystem (Self-Contained Change)

2020-08-27 Thread Ben Cotton
https://fedoraproject.org/wiki/Changes/OptimizeSquashFS == Summary == Improve compression ratio of SquashFS filesystem on the installation media. == Owner == * Name: [[User:bkhomuts|Bohdan Khomutskyi]] * Email: bkhom...@redhat.com == Detailed Description == As of Fedora 31, the LiveOS

F34 Change: Reduce installation media size by improving the compression ratio of SquashFS filesystem (Self-Contained Change)

2020-08-27 Thread Ben Cotton
https://fedoraproject.org/wiki/Changes/OptimizeSquashFS == Summary == Improve compression ratio of SquashFS filesystem on the installation media. == Owner == * Name: [[User:bkhomuts|Bohdan Khomutskyi]] * Email: bkhom...@redhat.com == Detailed Description == As of Fedora 31, the LiveOS

Re: Fedora 32 system-wide change proposal: reduce installation media size by improving the compression ratio of SquashFS filesystem

2020-08-13 Thread Bohdan Khomutskyi
results -- working proof of concept. With the following change: https://github.com/rhinstaller/anaconda/pull/2292 , not only the higher compression does not impact the installation time. In certain cases, the installation time is even reduced. This is because of the fact the filesystem internal

Re: Respinning rawhide images every filesystem update?

2020-08-08 Thread Kevin Fenzi
On Thu, Aug 06, 2020 at 12:02:09PM -0400, Alex Scheel wrote: > - Original Message - > > From: "Stephen John Smoogen" > > To: "Development discussions related to Fedora" > > > > Sent: Thursday, August 6, 2020 10:55:51 AM > > Subject:

Re: Respinning rawhide images every filesystem update?

2020-08-06 Thread Alex Scheel
- Original Message - > From: "Stephen John Smoogen" > To: "Development discussions related to Fedora" > > Sent: Thursday, August 6, 2020 10:55:51 AM > Subject: Re: Respinning rawhide images every filesystem update? > > On Thu

Re: Respinning rawhide images every filesystem update?

2020-08-06 Thread Stephen John Smoogen
M > > Subject: Re: Respinning rawhide images every filesystem update? > > > > On Thu, 6 Aug 2020 at 09:36, Alex Scheel wrote: > > > > > > I'm bumping this thread. This is still broken. > > > > > > > Please open a ticket at > > https://pag

Re: Respinning rawhide images every filesystem update?

2020-08-06 Thread Alex Scheel
- Original Message - > From: "Stephen John Smoogen" > To: "Development discussions related to Fedora" > , asch...@redhat.com > Sent: Thursday, August 6, 2020 9:55:17 AM > Subject: Re: Respinning rawhide images every filesystem update? > > On Thu

Re: Respinning rawhide images every filesystem update?

2020-08-06 Thread Stephen John Smoogen
--- Original Message - > > From: "Alex Scheel" > > To: "Development discussions related to Fedora" > > > > Sent: Monday, August 3, 2020 2:36:40 PM > > Subject: Respinning rawhide images every filesystem update? > > > > Hey list,

Re: Respinning rawhide images every filesystem update?

2020-08-06 Thread Alex Scheel
I'm bumping this thread. This is still broken. - Original Message - > From: "Alex Scheel" > To: "Development discussions related to Fedora" > > Sent: Monday, August 3, 2020 2:36:40 PM > Subject: Respinning rawhide images every filesystem update? &

Re: Respinning rawhide images every filesystem update?

2020-08-05 Thread Kevin Fenzi
On Mon, Aug 03, 2020 at 02:36:40PM -0400, Alex Scheel wrote: > Hey list, > > > How do Fedora rawhide images get respun? Every time filesystem updates, They are rebuild in every rawhide nightly compose. Here's the one from last night/this morning: https://koji.fedoraproject.org/k

Respinning rawhide images every filesystem update?

2020-08-03 Thread Alex Scheel
Hey list, How do Fedora rawhide images get respun? Every time filesystem updates, it causes `dnf update` to fail in a podman container because filesystem can't be updated in a container. We either need to make sure filesystem updates cause rawhide containers to be rebuilt, or figure out how

Re: Fedora 32 system-wide change proposal: reduce installation media size by improving the compression ratio of SquashFS filesystem

2020-05-27 Thread Chris Murphy
ompression does not impact the installation time. In certain cases, the > > installation time is even reduced. This is because of the fact the > > filesystem internal structure aware process is used to install the system > > from the SquashFS. The new process also allows for taking adv

Re: Fedora 32 system-wide change proposal: reduce installation media size by improving the compression ratio of SquashFS filesystem

2020-05-14 Thread Bruno Wolff III
On Wed, May 13, 2020 at 13:32:19 +0200, Bohdan Khomutskyi wrote: For optimization of the SquashFS, I will work on requesting the support of the required functionality in the Pungi compose build software. Note that squashfs-tools 4.4 just went into rawhide a couple of days ago. By default

Re: Fedora 32 system-wide change proposal: reduce installation media size by improving the compression ratio of SquashFS filesystem

2020-05-13 Thread Chris Murphy
achieved outstanding > results -- working proof of concept. With the following change: > https://github.com/rhinstaller/anaconda/pull/2292 , not only the higher > compression does not impact the installation time. In certain cases, the > installation time is even reduced. This is b

Re: Fedora 32 system-wide change proposal: reduce installation media size by improving the compression ratio of SquashFS filesystem

2020-05-13 Thread Kamil Paral
eved > outstanding results -- working proof of concept. With the following change: > https://github.com/rhinstaller/anaconda/pull/2292 , not only the higher > compression does not impact the installation time. In certain cases, the > installation time is even reduced. This is becaus

Re: Fedora 32 system-wide change proposal: reduce installation media size by improving the compression ratio of SquashFS filesystem

2020-05-13 Thread Bohdan Khomutskyi
: https://github.com/rhinstaller/anaconda/pull/2292 , not only the higher compression does not impact the installation time. In certain cases, the installation time is even reduced. This is because of the fact the filesystem internal structure aware process is used to install the system from

Re: Fedora 32 system-wide change proposal: reduce installation media size by improving the compression ratio of SquashFS filesystem

2020-01-25 Thread Bohdan Khomutskyi
thm in EROFS, even if EROFS has perfect layout of the filesystem, it's to good to be true it can outperform the XZ in compression ratio tests. The difference for SquashFS LZ4hc 1M vs XZ 1M is >40%. On Fri, Jan 24, 2020 at 2:17 AM Chris Murphy wrote: > On Mon, Jan 20, 2020 at 1:38 AM Bo

Re: Fedora 32 system-wide change proposal: reduce installation media size by improving the compression ratio of SquashFS filesystem

2020-01-23 Thread Chris Murphy
On Mon, Jan 20, 2020 at 1:38 AM Bohdan Khomutskyi wrote: > > In my previous message, I mentioned that CPU is underutilized during > installation. I haven't investigated further why, but I suspect it's due to > the inefficiency caused by the usage of the loop device and/or inefficiency > in the

Re: Fedora 32 system-wide change proposal: reduce installation media size by improving the compression ratio of SquashFS filesystem

2020-01-23 Thread Chris Murphy
On Mon, Jan 20, 2020 at 1:38 AM Bohdan Khomutskyi wrote: > In my previous message, I mentioned that CPU is underutilized during > installation. I haven't investigated further why, but I suspect it's due to > the inefficiency caused by the usage of the loop device and/or inefficiency > in the

Re: Fedora 32 system-wide change proposal: reduce installation media size by improving the compression ratio of SquashFS filesystem

2020-01-21 Thread John M. Harris Jr
On Sunday, January 19, 2020 4:41:06 PM MST Chris Murphy wrote: > I admit I'm biased toward the two endpoints: create and consume, not > distribution ,i.e the mirror donors. Their storage and bandwidth > concerns were evaluated with the RPM change from xz to zstd. So I'm > mystified by the bias for

Re: Fedora 32 system-wide change proposal: reduce installation media size by improving the compression ratio of SquashFS filesystem

2020-01-20 Thread Chris Murphy
immediately > clear *which of Fedora's images* are affected by this Change), but are > you sure of this? Do we not do it even for Cloud image deployments or > ARM disk image deployments? ISTR there being a filesystem resize > involved there, which is why I ask... Cloud images don't use sq

Re: Fedora 32 system-wide change proposal: reduce installation media size by improving the compression ratio of SquashFS filesystem

2020-01-20 Thread Kamil Paral
On Sun, Jan 19, 2020 at 4:42 PM Bohdan Khomutskyi wrote: > Hello, > > Thanks everyone for posting feedback. > More benchmarking results are available at > https://fedoraproject.org/wiki/Category:Changes/OptimizeSquashFS, > including the 'plain' SquashFS filesystem. > After

Re: Fedora 32 system-wide change proposal: reduce installation media size by improving the compression ratio of SquashFS filesystem

2020-01-20 Thread Adam Williamson
Do we not do it even for Cloud image deployments or ARM disk image deployments? ISTR there being a filesystem resize involved there, which is why I ask... -- Adam Williamson Fedora QA Community Monkey IRC: adamw | Twitter: AdamW_Fedora | identi.ca: adamwfedora http://www.happy

Re: Fedora 32 system-wide change proposal: reduce installation media size by improving the compression ratio of SquashFS filesystem

2020-01-20 Thread Richard W.M. Jones
On Mon, Jan 20, 2020 at 09:37:32AM +0100, Bohdan Khomutskyi wrote: > Chris, > > Thanks for your feedback and comments, it's very valuable to me. > > In my previous message, I mentioned that CPU is *underutilized* during > installation. I haven't investigated further why, but I suspect it's due

Re: Fedora 32 system-wide change proposal: reduce installation media size by improving the compression ratio of SquashFS filesystem

2020-01-20 Thread Richard W.M. Jones
On Sun, Jan 05, 2020 at 10:08:07AM -0700, Chris Murphy wrote: > In my testing, xz does provide better compression ratios, well suited > for seldom used images like archives. But it really makes the > installation experience worse by soaking the CPU, times thousands of > installations (openQA tests

Re: Fedora 32 system-wide change proposal: reduce installation media size by improving the compression ratio of SquashFS filesystem

2020-01-20 Thread Bohdan Khomutskyi
More benchmarking results are available at > https://fedoraproject.org/wiki/Category:Changes/OptimizeSquashFS, > including the 'plain' SquashFS filesystem. > > After performing the tests, I personally recommend to use xz compression > with 1MiB block size, without bcj, on a 'plain' squash f

Re: Fedora 32 system-wide change proposal: reduce installation media size by improving the compression ratio of SquashFS filesystem

2020-01-19 Thread Chris Murphy
On Sun, Jan 19, 2020 at 8:41 AM Bohdan Khomutskyi wrote: > > Hello, > > Thanks everyone for posting feedback. > More benchmarking results are available at > https://fedoraproject.org/wiki/Category:Changes/OptimizeSquashFS, including > the 'plain' SquashFS filesyste

Re: Fedora 32 system-wide change proposal: reduce installation media size by improving the compression ratio of SquashFS filesystem

2020-01-19 Thread Bohdan Khomutskyi
Hello, Thanks everyone for posting feedback. More benchmarking results are available at https://fedoraproject.org/wiki/Category:Changes/OptimizeSquashFS, including the 'plain' SquashFS filesystem. After performing the tests, I personally recommend to use xz compression with 1MiB block size

Re: Fedora 32 system-wide change proposal: reduce installation media size by improving the compression ratio of SquashFS filesystem

2020-01-13 Thread Kamil Paral
On Sun, Jan 12, 2020 at 5:46 PM Bohdan Khomutskyi wrote: > Hello, > > I posted more benchmark results in this article: > https://fedoraproject.org/wiki/Category:Changes/OptimizeSquashFS > > In short, bigger block size and higher compression ratio does not increase > the installation time for

Re: Fedora 32 system-wide change proposal: reduce installation media size by improving the compression ratio of SquashFS filesystem

2020-01-12 Thread Chris Murphy
On Sun, Jan 12, 2020 at 3:53 PM Samuel Sieb wrote: > > On 1/7/20 11:16 AM, Kevin Kofler wrote: > > Chris Murphy wrote: > >> Stacked images on the same media functionality is in the kernel, it's > >> not complicated, it's well tested, doesn't require any gymnastics in > >> the initramfs - your

Re: Fedora 32 system-wide change proposal: reduce installation media size by improving the compression ratio of SquashFS filesystem

2020-01-12 Thread Samuel Sieb
On 1/7/20 11:16 AM, Kevin Kofler wrote: Chris Murphy wrote: Stacked images on the same media functionality is in the kernel, it's not complicated, it's well tested, doesn't require any gymnastics in the initramfs - your bootloader entries can each point to different root=UUIDs and image

Re: Fedora 32 system-wide change proposal: reduce installation media size by improving the compression ratio of SquashFS filesystem

2020-01-12 Thread Chris Murphy
On Sun, Jan 12, 2020 at 9:45 AM Bohdan Khomutskyi wrote: > Hello, > > I posted more benchmark results in this article: > https://fedoraproject.org/wiki/Category:Changes/OptimizeSquashFS > Cool! Do you have any tests to compare plain squashfs xz with zstd? The nested ext4 stuff is really

Re: Fedora 32 system-wide change proposal: reduce installation media size by improving the compression ratio of SquashFS filesystem

2020-01-12 Thread Kevin Fenzi
On Sun, Jan 12, 2020 at 05:44:33PM +0100, Bohdan Khomutskyi wrote: > Hello, > > I posted more benchmark results in this article: > https://fedoraproject.org/wiki/Category:Changes/OptimizeSquashFS > > In short, bigger block size and higher compression ratio does not increase > the installation

Re: Fedora 32 system-wide change proposal: reduce installation media size by improving the compression ratio of SquashFS filesystem

2020-01-12 Thread Bohdan Khomutskyi
Hello, I posted more benchmark results in this article: https://fedoraproject.org/wiki/Category:Changes/OptimizeSquashFS In short, bigger block size and higher compression ratio does not increase the installation time for Fedora Workstation. I saw the opposite effect. The Zstd compression

Re: Fedora 32 system-wide change proposal: reduce installation media size by improving the compression ratio of SquashFS filesystem

2020-01-11 Thread Bohdan Khomutskyi
Thanks everyone for your comments. These are all valid concerns. I filed a new change proposal at https://fedoraproject.org/wiki/Category:Changes/OptimizeSquashFS. I'll run more benchmarks, including using Zstd compression algorithm, and will post results. Hopefully this weekend, I'll also try

Re: Fedora 32 system-wide change proposal: reduce installation media size by improving the compression ratio of SquashFS filesystem

2020-01-09 Thread Lukas Ruzicka
> > Why stacked images? Consider a single base.img that's maybe 1G, and > now you don't have to do separate composes for server, cloud, GNOME, > KDE, Cinnamon, LXQt, Astronomy that repeat a lot of the same steps, > including expensive steps like compressing the same things over and > over again.

Re: Fedora 32 system-wide change proposal: reduce installation media size by improving the compression ratio of SquashFS filesystem

2020-01-08 Thread Richard Hughes
On Tue, 7 Jan 2020 at 18:07, Martin Kolman wrote: > IIRC the speedups in compression and decompression > speed we got for RPMs[0] with zstd were pretty nice If it helps the argument, at the moment 99.7% of the time building the AppStream metadata is spent decompressing the RPMs. If zstd helps

Re: Fedora 32 system-wide change proposal: reduce installation media size by improving the compression ratio of SquashFS filesystem

2020-01-07 Thread Colin Walters
On Sun, Jan 5, 2020, at 12:08 PM, Chris Murphy wrote: > I've pretty much concluded Fedora is best off dropping the nested ext4 > in favor of plain squashfs, and using zstd. Fedora CoreOS already uses zstd for squashfs:

Re: Fedora 32 system-wide change proposal: reduce installation media size by improving the compression ratio of SquashFS filesystem

2020-01-07 Thread Kamil Paral
even the first dnf metadata update will consume exactly this amount of data, and then they will be presented with 1 GB worth of system updates. Not to mention we're talking here about removing the nested ext4 filesystem, which is likely to *reduce* the image size (and combined with changing

Re: Fedora 32 system-wide change proposal: reduce installation media size by improving the compression ratio of SquashFS filesystem

2020-01-07 Thread Kevin Kofler
Chris Murphy wrote: > Even at 8% bigger it would be worth it. And probably 16%. I disagree. We need to stop treating bloat like a feature. And please see my other replies for why this is a particularly bad tradeoff in this particular case. > Gaining additional features, like on the fly

Re: Fedora 32 system-wide change proposal: reduce installation media size by improving the compression ratio of SquashFS filesystem

2020-01-07 Thread Kevin Kofler
Gary Buhrmaster wrote: > While not exactly the same, the measured increase in size > by the Arch community for their packaging by moving from > xz to zstd was ~0.8% (and gaining a huge reduction in CPU > utilization at the decompress end). I don't know what xz settings Arch was using, but in the

Re: Fedora 32 system-wide change proposal: reduce installation media size by improving the compression ratio of SquashFS filesystem

2020-01-07 Thread Kevin Kofler
Chris Murphy wrote: > It's untenable to consider ISO size alone. It is a legitimate concern, but > it can't be reasonable to soak every single CPU, times thousands. You're > willing to exchange less download time for longer install time and higher > energy demand, but there are quite a lot of

Re: Fedora 32 system-wide change proposal: reduce installation media size by improving the compression ratio of SquashFS filesystem

2020-01-07 Thread Kevin Kofler
Brian C. Lane wrote: > Yes, according to the manpage it supports xattrs. Does that include file capabilities and ACLs? Kevin Kofler ___ devel mailing list -- devel@lists.fedoraproject.org To unsubscribe send an email to

Re: Fedora 32 system-wide change proposal: reduce installation media size by improving the compression ratio of SquashFS filesystem

2020-01-07 Thread Brian C. Lane
On Tue, Jan 07, 2020 at 09:56:21AM +0100, Kevin Kofler wrote: > Brian C. Lane wrote: > > I agree with Chris here, I think we should make the switch to plain > > squashfs unless someone can come up something dramatic that it will > > break :) > > Does SquashFS support all the advanced features

Re: Fedora 32 system-wide change proposal: reduce installation media size by improving the compression ratio of SquashFS filesystem

2020-01-07 Thread Chris Murphy
On Tue, Jan 7, 2020 at 9:58 AM Gary Buhrmaster wrote: > > On Tue, Jan 7, 2020 at 9:00 AM Kevin Kofler wrote: > > > I think increasing the size of the live images, also affecting the download > > time and the time to write the image to media (even USB sticks are not > > instant), to get a

Re: Fedora 32 system-wide change proposal: reduce installation media size by improving the compression ratio of SquashFS filesystem

2020-01-07 Thread Martin Kolman
On Tue, 2020-01-07 at 11:20 -0700, Chris Murphy wrote: > On Tue, Jan 7, 2020 at 11:07 AM Martin Kolman wrote: > > On Mon, 2020-01-06 at 16:35 -0800, Brian C. Lane wrote: > > > On Sun, Jan 05, 2020 at 10:08:07AM -0700, Chris Murphy wrote: > > > > I've pretty much concluded Fedora is best off

Re: Fedora 32 system-wide change proposal: reduce installation media size by improving the compression ratio of SquashFS filesystem

2020-01-07 Thread Chris Murphy
On Tue, Jan 7, 2020 at 11:07 AM Martin Kolman wrote: > > On Mon, 2020-01-06 at 16:35 -0800, Brian C. Lane wrote: > > On Sun, Jan 05, 2020 at 10:08:07AM -0700, Chris Murphy wrote: > > > I've pretty much concluded Fedora is best off dropping the nested ext4 > > > in favor of plain squashfs, and

Re: Fedora 32 system-wide change proposal: reduce installation media size by improving the compression ratio of SquashFS filesystem

2020-01-07 Thread Martin Kolman
On Mon, 2020-01-06 at 16:35 -0800, Brian C. Lane wrote: > On Sun, Jan 05, 2020 at 10:08:07AM -0700, Chris Murphy wrote: > > I've pretty much concluded Fedora is best off dropping the nested ext4 > > in favor of plain squashfs, and using zstd. It's not required to do > > both, but the benefit is

Re: Fedora 32 system-wide change proposal: reduce installation media size by improving the compression ratio of SquashFS filesystem

2020-01-07 Thread Gary Buhrmaster
On Tue, Jan 7, 2020 at 9:00 AM Kevin Kofler wrote: > I think increasing the size of the live images, also affecting the download > time and the time to write the image to media (even USB sticks are not > instant), to get a one-time installation speedup is a very bad tradeoff. While not exactly

Re: Fedora 32 system-wide change proposal: reduce installation media size by improving the compression ratio of SquashFS filesystem

2020-01-07 Thread Chris Murphy
It's untenable to consider ISO size alone. It is a legitimate concern, but it can't be reasonable to soak every single CPU, times thousands. You're willing to exchange less download time for longer install time and higher energy demand, but there are quite a lot of other uses occurring that

Re: Fedora 32 system-wide change proposal: reduce installation media size by improving the compression ratio of SquashFS filesystem

2020-01-07 Thread Kevin Kofler
Kamil Paral wrote: > Well for the general user, everything is one-time. One download, one write > to USB, one install. Saving a minute in one step and adding it to a > different step doesn't really matter, it's the same sum overall (unless > you pay considerable money for the extra downloaded

Re: Fedora 32 system-wide change proposal: reduce installation media size by improving the compression ratio of SquashFS filesystem

2020-01-07 Thread Kamil Paral
On Tue, Jan 7, 2020 at 10:01 AM Kevin Kofler wrote: > Chris Murphy wrote: > > Has zstandard been evaluated? In my testing of images compressed with > > zstd, the CPU hit is cut by more than 50%, and is no longer a > > bottleneck during installations. Image size does increase, although I > >

Re: Fedora 32 system-wide change proposal: reduce installation media size by improving the compression ratio of SquashFS filesystem

2020-01-07 Thread Kevin Kofler
Chris Murphy wrote: > Has zstandard been evaluated? In my testing of images compressed with > zstd, the CPU hit is cut by more than 50%, and is no longer a > bottleneck during installations. Image size does increase, although I > haven't tested mksquashfs block size higher than 256K. I think

Re: Fedora 32 system-wide change proposal: reduce installation media size by improving the compression ratio of SquashFS filesystem

2020-01-07 Thread Kevin Kofler
Brian C. Lane wrote: > I agree with Chris here, I think we should make the switch to plain > squashfs unless someone can come up something dramatic that it will > break :) Does SquashFS support all the advanced features that are needed, such as extended attributes (used at least by SELinux),

Re: Fedora 32 system-wide change proposal: reduce installation media size by improving the compression ratio of SquashFS filesystem

2020-01-06 Thread Brian C. Lane
On Sun, Jan 05, 2020 at 10:08:07AM -0700, Chris Murphy wrote: > I've pretty much concluded Fedora is best off dropping the nested ext4 > in favor of plain squashfs, and using zstd. It's not required to do > both, but the benefit is additive and significant. The work in dracut > and lorax to

Re: Fedora 32 system-wide change proposal: reduce installation media size by improving the compression ratio of SquashFS filesystem

2020-01-06 Thread Kamil Paral
On Sun, Jan 5, 2020 at 1:24 PM Bohdan Khomutskyi wrote: > Summary > > Improve compression ratio of SquashFS filesystem on the installation media. > Hi Bohdan, as a member of QA, I'll happily support any proposal that improves the installation speed (the image size is not that impor

Re: Fedora 32 system-wide change proposal: reduce installation media size by improving the compression ratio of SquashFS filesystem

2020-01-06 Thread Ben Cotton
On Sun, Jan 5, 2020 at 7:24 AM Bohdan Khomutskyi wrote: > > I was unable to create an article in Fedora wiki system. > Since you don't have any non-CLA groups in FAS, I have added you to the wikiedit group. Please add this to the wiki ASAP. This proposal is past the deadline for Fedora 32

Re: Fedora 32 system-wide change proposal: reduce installation media size by improving the compression ratio of SquashFS filesystem

2020-01-06 Thread Vít Ondruch
> Improve compression ratio of SquashFS filesystem on the installation > media. > > > Owner > > Name: Bohdan Khomutskyi > > Email: bkhom...@redhat.com <mailto:bkhom...@redhat.com> > > > Current status > > Targeted release: I propose this change

Re: Fedora 32 system-wide change proposal: reduce installation media size by improving the compression ratio of SquashFS filesystem

2020-01-05 Thread John M. Harris Jr
On Sunday, January 5, 2020 5:23:12 AM MST Bohdan Khomutskyi wrote: > Summary > > Improve compression ratio of SquashFS filesystem on the installation media. > Owner > > Name: Bohdan Khomutskyi > > Email: bkhom...@redhat.com > Current status > > Target

Re: Fedora 32 system-wide change proposal: reduce installation media size by improving the compression ratio of SquashFS filesystem

2020-01-05 Thread Chris Murphy
On Sun, Jan 5, 2020 at 5:24 AM Bohdan Khomutskyi wrote: > > Summary > > Improve compression ratio of SquashFS filesystem on the installation media. On the issues of Fedora ISOs using excessive CPU, related to lzma decompression: https://bugzilla.redhat.com/show_bug.cgi?id=1

Fedora 32 system-wide change proposal: reduce installation media size by improving the compression ratio of SquashFS filesystem

2020-01-05 Thread Bohdan Khomutskyi
Summary Improve compression ratio of SquashFS filesystem on the installation media. Owner Name: Bohdan Khomutskyi Email: bkhom...@redhat.com Current status Targeted release: I propose this change for Fedora 32 Last updated: Jan 5 2020 Pagure.io issue: https://pagure.io/releng/issue/9127 I

Re: which old version of fedora can read a old iRIX XFS filesystem ?

2019-11-20 Thread J. Scheurich
Hi, | When trying to mount a old SGI IRIX64 XFS filesystem, current Linux | versions complain with: | function not implemented | So you have to use a older Linux version (e.g. 2.68). Just for the records: i was able to read a IRIX64 XFS MO-dsik with a USB MO-drive using a Ubuntu Linux 4.10

Re: which old version of fedora can read a old iRIX XFS filesystem ?

2019-11-18 Thread Stephen John Smoogen
On Sun, 17 Nov 2019 at 21:13, J. Scheurich wrote: > > Hi, > > When trying to mount a old SGI IRIX64 XFS filesystem, current Linux > versions complain with: > There are going to be a bunch of problems trying to mount this depending on how old the partition is: https://xfs.org/i

Re: which old version of fedora can read a old iRIX XFS filesystem ?

2019-11-17 Thread Neal Gompa
On Sun, Nov 17, 2019 at 9:13 PM J. Scheurich wrote: > > Hi, > > When trying to mount a old SGI IRIX64 XFS filesystem, current Linux > versions complain with: > > function not implemented > > So you have to use a older Linux version (e.g. 2.68). > > Which fedora

which old version of fedora can read a old iRIX XFS filesystem ?

2019-11-17 Thread J. Scheurich
Hi, When trying to mount a old SGI IRIX64 XFS filesystem, current Linux versions complain with: function not implemented So you have to use a older Linux version (e.g. 2.68). Which fedora version is old enough and are old fedora CD/DVD images still available ? so long MUFTI

[Bug 1568834] Missing BuildRequires: kde-filesystem in perl-Qt.spec

2018-05-18 Thread bugzilla
https://bugzilla.redhat.com/show_bug.cgi?id=1568834 Fedora Update System changed: What|Removed |Added Fixed In Version|perl-Qt-4.14.3-14.fc28

[Bug 1568834] Missing BuildRequires: kde-filesystem in perl-Qt.spec

2018-05-13 Thread bugzilla
https://bugzilla.redhat.com/show_bug.cgi?id=1568834 Fedora Update System changed: What|Removed |Added Fixed In Version|perl-Qt-4.14.3-14.fc28

[Bug 1568834] Missing BuildRequires: kde-filesystem in perl-Qt.spec

2018-05-13 Thread bugzilla
https://bugzilla.redhat.com/show_bug.cgi?id=1568834 Fedora Update System changed: What|Removed |Added Fixed In Version|perl-Qt-4.14.3-14.fc28

[Bug 1568834] Missing BuildRequires: kde-filesystem in perl-Qt.spec

2018-05-11 Thread bugzilla
https://bugzilla.redhat.com/show_bug.cgi?id=1568834 Fedora Update System changed: What|Removed |Added Status|ON_QA

[Bug 1568834] Missing BuildRequires: kde-filesystem in perl-Qt.spec

2018-05-03 Thread bugzilla
https://bugzilla.redhat.com/show_bug.cgi?id=1568834 Fedora Update System changed: What|Removed |Added Status|MODIFIED|ON_QA

  1   2   3   4   5   >