Re: [PATCH 0/2] Squashfs: add LZ4 compression
On 12/12/14 15:56, Bruno Wolff III wrote: On Fri, Dec 12, 2014 at 13:23:19 +0100, toki clover wrote: Now, I did not see any Linux FS devs activity/response to this... What a waste of time because if those patch don't make it for this merge window, rebasing/reposting will be, again, necessary. The patches got pulled into linux-next. For XZ, the patches sat in linux-next for a full release cycle. I don't know whether or not if that is the plan for the lz4 patches. . The plan is to send out the merge request this weekend. I've been too busy this week with my main job to do the merge request, sorry (I'll probably be working past midnight again tonight, the weeks leading up to Christmas are always really busy). Phillip -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
Re: [PATCH 0/2] Squashfs: add LZ4 compression
On Fri, Dec 12, 2014 at 13:23:19 +0100, toki clover wrote: Now, I did not see any Linux FS devs activity/response to this... What a waste of time because if those patch don't make it for this merge window, rebasing/reposting will be, again, necessary. The patches got pulled into linux-next. For XZ, the patches sat in linux-next for a full release cycle. I don't know whether or not if that is the plan for the lz4 patches. -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
Re: [PATCH 0/2] Squashfs: add LZ4 compression
Hi Philip, Thank you for your work on squashfs and your persistent effort on mainlining squashfs-lz4 support! I've been using squashfs with lz4 compression (together with aufs by Okajima) for my desktop, laptops, home router and bluetooth music player for about half a year. There was not a single issue. All I got were reduced latency compared to lzo compression, and drastically increased compression speed. The later is important to me because my application requires re-mksquashfs of the whole system in order to make software updates permanent. lz4 support (especially with -Xhc) is not only helpful, but also a valuable addition to squashfs. Regards, Guan -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
Re: [PATCH 0/2] Squashfs: add LZ4 compression
Thanks very much for keeping me in the loop. I'd like to put a big +1 on this patch inclusion. Looking forward to in-kernel support for LZ4 squashfs images. Thanks Anthony -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
Re: [PATCH 0/2] Squashfs: add LZ4 compression
Thanks very much for keeping me in the loop. I'd like to put a big +1 on this patch inclusion. Looking forward to in-kernel support for LZ4 squashfs images. Thanks Anthony -- To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
Re: [PATCH 0/2] Squashfs: add LZ4 compression
Hi Philip, Thank you for your work on squashfs and your persistent effort on mainlining squashfs-lz4 support! I've been using squashfs with lz4 compression (together with aufs by Okajima) for my desktop, laptops, home router and bluetooth music player for about half a year. There was not a single issue. All I got were reduced latency compared to lzo compression, and drastically increased compression speed. The later is important to me because my application requires re-mksquashfs of the whole system in order to make software updates permanent. lz4 support (especially with -Xhc) is not only helpful, but also a valuable addition to squashfs. Regards, Guan -- To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
Re: [PATCH 0/2] Squashfs: add LZ4 compression
On Fri, Dec 12, 2014 at 13:23:19 +0100, toki clover tokiclo...@gmail.com wrote: Now, I did not see any Linux FS devs activity/response to this... What a waste of time because if those patch don't make it for this merge window, rebasing/reposting will be, again, necessary. The patches got pulled into linux-next. For XZ, the patches sat in linux-next for a full release cycle. I don't know whether or not if that is the plan for the lz4 patches. -- To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
Re: [PATCH 0/2] Squashfs: add LZ4 compression
On 12/12/14 15:56, Bruno Wolff III wrote: On Fri, Dec 12, 2014 at 13:23:19 +0100, toki clover tokiclo...@gmail.com wrote: Now, I did not see any Linux FS devs activity/response to this... What a waste of time because if those patch don't make it for this merge window, rebasing/reposting will be, again, necessary. The patches got pulled into linux-next. For XZ, the patches sat in linux-next for a full release cycle. I don't know whether or not if that is the plan for the lz4 patches. . The plan is to send out the merge request this weekend. I've been too busy this week with my main job to do the merge request, sorry (I'll probably be working past midnight again tonight, the weeks leading up to Christmas are always really busy). Phillip -- To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
Re: [PATCH 0/2] Squashfs: add LZ4 compression
I'd like to support the inclusion of these patches. There's enough demand for LZ4-compressed squashfs that I received an unsolicited patch adding support to my FUSE implementation, squashfuse: https://github.com/vasi/squashfuse/pull/2 At least a few people are currently using squashfuse to mount their LZ4-compressed squashfs images. Ideally these users would be able to use the in-kernel squashfs for improved performance. Cheers, Dave Vasilevsky -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
Re: [PATCH 0/2] Squashfs: add LZ4 compression
I'd like to support the inclusion of these patches. There's enough demand for LZ4-compressed squashfs that I received an unsolicited patch adding support to my FUSE implementation, squashfuse: https://github.com/vasi/squashfuse/pull/2 At least a few people are currently using squashfuse to mount their LZ4-compressed squashfs images. Ideally these users would be able to use the in-kernel squashfs for improved performance. Cheers, Dave Vasilevsky -- To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
Re: [PATCH 0/2] Squashfs: add LZ4 compression
Hi: squashfs+lz4 / aufs to speed up my laptop Squashfs proves its usefulness especially in combination with aufs or overlayfs; I suppose that this combination will become more popular with the spreading of overlayfs (e.g. to save disk space etc.) For users with such a combination, it is especially important to get a fast (re)compression of huge directories. The speed of LZ4 for compression in such a setting is really incredible. Just for orientation for myself, I made a list of times/sizes on some machines I had access to: https://github.com/vaeth/squashmount/blob/master/compress.txt (I do not claim that this is a scientific benchmark - just a straightforward average over several runs). The results for the kernel source and libreoffice are really unbelievable, but I repeated them several times (and, as you can see, for the kernel sources on different machines). From the user perspective, it is mainly important that the files compressed in this way can be read by the kernel - the decompression speed is here secondary, so I made no comparison for this case, although lz4 is known to be very fast also for decompression. I would really like to see lz4 support included in the squashfs kernel driver. I cannot imagine any negative consequences, especially since squashfs and lz4 are in the kernel, anyway. Sincerely Martin Väth
Fwd: [PATCH 0/2] Squashfs: add LZ4 compression
-- Forwarded message -- From: Marcin Szychowski Date: 2014-11-27 15:50 GMT+00:00 Subject: Re: [PATCH 0/2] Squashfs: add LZ4 compression To: Bruno Wolff III Cc: Phillip Lougher , linux-kernel@vger.kernel.org, linux-fsde...@vger.kernel.org, texs...@gmail.com, mar...@mvath.de, guanx@gmail.com, d...@vasilevsky.ca, bly...@students.naropa.edu, tokiclo...@gmail.com, afm...@gmail.com, hugochevr...@gmail.com 2014-11-27 13:37 GMT+00:00 Bruno Wolff III : > > On Thu, Nov 27, 2014 at 08:00:47 +, > Phillip Lougher wrote: >> >> >> My intention is to submit them in the next kernel merge window. >> If you want LZ4 support in Squashfs now is a good time to publically >> support the inclusion of these patches. > > > Fedora has been supporting LZ4 functionallity in mksquashfs and unsquashfs > for about 6 months (in F19+), but the Fedora kernel team won't add support in > the kernel until LZ4 support is accepted for the upstream kernel. Hello everyone, Squashfs is awesome piece of code. It’s potential usage pattern analysis could turn into pretty decent PhD thesis – from simple archival purposes through embedded systems, to dynamic nearly-instant multi-server software deployment systems, and many others. On the other hand, LZ4 is fantastic compression algorithm with well-known list of advantages. As I wrote to Phillip earlier, I have been using squashfs+lz4 / aufs to speed up my laptop (and reclaim some space, too). That would not be possible without LZ4: I could have gain some speed with LZO or disk space with gzip or xz, but not both. LZ4 is comparable with LZO in terms of decompression speed and with gzip in terms of compression ratios. LZ4 is much faster in both compression and in particular decompression speed than gzip (1-9) and xz (1-9). It is just the best choice for many storage-related purposes (see ZFS on Linux [https://github.com/zfsonlinux/zfs/commit/9759c60f1a1503e48dc5c45a209c3edd5758319f] and [http://wiki.illumos.org/display/illumos/LZ4+Compression]) I don’t quite get why does anyone need to be convinced to merge advantages of two fine pieces of code, since both have been already in the mainline kernel for some time now. It’s like being forced to choose between big car and safe car, or delicious food and good-looking food. It is not about forcing anyone to use something, it is about ease of choice. Having squashfs with lz4 in mainline kernel sounds like next natural step. Please do not hesitate to take it. -- Regards, Marcin Szychowski +48.791460067 http://adastor.pl -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
Re: [PATCH 0/2] Squashfs: add LZ4 compression
On Thu, Nov 27, 2014 at 08:00:47 +, Phillip Lougher wrote: My intention is to submit them in the next kernel merge window. If you want LZ4 support in Squashfs now is a good time to publically support the inclusion of these patches. Fedora has been supporting LZ4 functionallity in mksquashfs and unsquashfs for about 6 months (in F19+), but the Fedora kernel team won't add support in the kernel until LZ4 support is accepted for the upstream kernel. -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
[PATCH 0/2] Squashfs: add LZ4 compression
Hi, The following is a repost of the Squashfs LZ4 compression patches updated to the latest -rc kernel. These patches were originally sent last year, but they did not receive much interest at the time. These patches are being reposted by popular demand. I have received many private and public requests to repost these patches and to get them mainlined. My intention is to submit them in the next kernel merge window. If you want LZ4 support in Squashfs now is a good time to publically support the inclusion of these patches. Phillip Lougher (2): Squashfs: add LZ4 compression support Squashfs: Add LZ4 compression configuration option Documentation/filesystems/squashfs.txt |8 +- fs/squashfs/Kconfig| 15 fs/squashfs/Makefile |1 + fs/squashfs/decompressor.c |7 ++ fs/squashfs/decompressor.h |4 + fs/squashfs/lz4_wrapper.c | 142 fs/squashfs/squashfs_fs.h |1 + 7 files changed, 174 insertions(+), 4 deletions(-) create mode 100644 fs/squashfs/lz4_wrapper.c These patches are also available in the git repository at: git://git.kernel.org/pub/scm/linux/kernel/git/pkl/squashfs-lz4.git master Squashfs-tools 4.3 already supports LZ4 compression. Phillip -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
[PATCH 0/2] Squashfs: add LZ4 compression
Hi, The following is a repost of the Squashfs LZ4 compression patches updated to the latest -rc kernel. These patches were originally sent last year, but they did not receive much interest at the time. These patches are being reposted by popular demand. I have received many private and public requests to repost these patches and to get them mainlined. My intention is to submit them in the next kernel merge window. If you want LZ4 support in Squashfs now is a good time to publically support the inclusion of these patches. Phillip Lougher (2): Squashfs: add LZ4 compression support Squashfs: Add LZ4 compression configuration option Documentation/filesystems/squashfs.txt |8 +- fs/squashfs/Kconfig| 15 fs/squashfs/Makefile |1 + fs/squashfs/decompressor.c |7 ++ fs/squashfs/decompressor.h |4 + fs/squashfs/lz4_wrapper.c | 142 fs/squashfs/squashfs_fs.h |1 + 7 files changed, 174 insertions(+), 4 deletions(-) create mode 100644 fs/squashfs/lz4_wrapper.c These patches are also available in the git repository at: git://git.kernel.org/pub/scm/linux/kernel/git/pkl/squashfs-lz4.git master Squashfs-tools 4.3 already supports LZ4 compression. Phillip -- To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
Re: [PATCH 0/2] Squashfs: add LZ4 compression
On Thu, Nov 27, 2014 at 08:00:47 +, Phillip Lougher phil...@squashfs.org.uk wrote: My intention is to submit them in the next kernel merge window. If you want LZ4 support in Squashfs now is a good time to publically support the inclusion of these patches. Fedora has been supporting LZ4 functionallity in mksquashfs and unsquashfs for about 6 months (in F19+), but the Fedora kernel team won't add support in the kernel until LZ4 support is accepted for the upstream kernel. -- To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
Fwd: [PATCH 0/2] Squashfs: add LZ4 compression
-- Forwarded message -- From: Marcin Szychowski szy...@gmail.com Date: 2014-11-27 15:50 GMT+00:00 Subject: Re: [PATCH 0/2] Squashfs: add LZ4 compression To: Bruno Wolff III br...@wolff.to Cc: Phillip Lougher phil...@squashfs.org.uk, linux-kernel@vger.kernel.org, linux-fsde...@vger.kernel.org, texs...@gmail.com, mar...@mvath.de, guanx@gmail.com, d...@vasilevsky.ca, bly...@students.naropa.edu, tokiclo...@gmail.com, afm...@gmail.com, hugochevr...@gmail.com 2014-11-27 13:37 GMT+00:00 Bruno Wolff III br...@wolff.to: On Thu, Nov 27, 2014 at 08:00:47 +, Phillip Lougher phil...@squashfs.org.uk wrote: My intention is to submit them in the next kernel merge window. If you want LZ4 support in Squashfs now is a good time to publically support the inclusion of these patches. Fedora has been supporting LZ4 functionallity in mksquashfs and unsquashfs for about 6 months (in F19+), but the Fedora kernel team won't add support in the kernel until LZ4 support is accepted for the upstream kernel. Hello everyone, Squashfs is awesome piece of code. It’s potential usage pattern analysis could turn into pretty decent PhD thesis – from simple archival purposes through embedded systems, to dynamic nearly-instant multi-server software deployment systems, and many others. On the other hand, LZ4 is fantastic compression algorithm with well-known list of advantages. As I wrote to Phillip earlier, I have been using squashfs+lz4 / aufs to speed up my laptop (and reclaim some space, too). That would not be possible without LZ4: I could have gain some speed with LZO or disk space with gzip or xz, but not both. LZ4 is comparable with LZO in terms of decompression speed and with gzip in terms of compression ratios. LZ4 is much faster in both compression and in particular decompression speed than gzip (1-9) and xz (1-9). It is just the best choice for many storage-related purposes (see ZFS on Linux [https://github.com/zfsonlinux/zfs/commit/9759c60f1a1503e48dc5c45a209c3edd5758319f] and [http://wiki.illumos.org/display/illumos/LZ4+Compression]) I don’t quite get why does anyone need to be convinced to merge advantages of two fine pieces of code, since both have been already in the mainline kernel for some time now. It’s like being forced to choose between big car and safe car, or delicious food and good-looking food. It is not about forcing anyone to use something, it is about ease of choice. Having squashfs with lz4 in mainline kernel sounds like next natural step. Please do not hesitate to take it. -- Regards, Marcin Szychowski +48.791460067 http://adastor.pl -- To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
Re: [PATCH 0/2] Squashfs: add LZ4 compression
Hi: squashfs+lz4 / aufs to speed up my laptop Squashfs proves its usefulness especially in combination with aufs or overlayfs; I suppose that this combination will become more popular with the spreading of overlayfs (e.g. to save disk space etc.) For users with such a combination, it is especially important to get a fast (re)compression of huge directories. The speed of LZ4 for compression in such a setting is really incredible. Just for orientation for myself, I made a list of times/sizes on some machines I had access to: https://github.com/vaeth/squashmount/blob/master/compress.txt (I do not claim that this is a scientific benchmark - just a straightforward average over several runs). The results for the kernel source and libreoffice are really unbelievable, but I repeated them several times (and, as you can see, for the kernel sources on different machines). From the user perspective, it is mainly important that the files compressed in this way can be read by the kernel - the decompression speed is here secondary, so I made no comparison for this case, although lz4 is known to be very fast also for decompression. I would really like to see lz4 support included in the squashfs kernel driver. I cannot imagine any negative consequences, especially since squashfs and lz4 are in the kernel, anyway. Sincerely Martin Väth
Re: [PATCH 0/2] Squashfs: add LZ4 compression
On 07/22/2013 01:04:59 AM, Gu Zheng wrote: On 07/22/2013 01:07 PM, Phillip Lougher wrote: > On 22 July 2013 04:05, Gu Zheng wrote: >> Hi Phillip, >> Have some tests been carried out to confirm that Squashfs really >> can get benefit from LZ4 compression, comparing with lzo? > > This seems to be a loaded question, in that it seems to be trying to > reopen the "why add lz4 when we already have lzo" debate all over > again. As LZ4 has been merged to mainline, this appears to be a > question that has already been answered. No, they are different. LZ4 can be merged to mainline, because we can see the benefit(faster compressing speed under the enabled unaligned memory access) it brings to us comparing with lzo. But it's hard to say that it also really can bring benefit to Squashfs. A compression format was added to the kernel. Philip hooked up the code that was already in the kernel to a filesystem that was already in the kernel. You consider this action controversial... Rob-- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
Re: [PATCH 0/2] Squashfs: add LZ4 compression
On 07/22/2013 01:04:59 AM, Gu Zheng wrote: On 07/22/2013 01:07 PM, Phillip Lougher wrote: On 22 July 2013 04:05, Gu Zheng guz.f...@cn.fujitsu.com wrote: Hi Phillip, Have some tests been carried out to confirm that Squashfs really can get benefit from LZ4 compression, comparing with lzo? This seems to be a loaded question, in that it seems to be trying to reopen the why add lz4 when we already have lzo debate all over again. As LZ4 has been merged to mainline, this appears to be a question that has already been answered. No, they are different. LZ4 can be merged to mainline, because we can see the benefit(faster compressing speed under the enabled unaligned memory access) it brings to us comparing with lzo. But it's hard to say that it also really can bring benefit to Squashfs. A compression format was added to the kernel. Philip hooked up the code that was already in the kernel to a filesystem that was already in the kernel. You consider this action controversial... Rob-- To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
Re: [PATCH 0/2] Squashfs: add LZ4 compression
On Tue, Jul 23, 2013 at 17:17:30 +0100, Phillip Lougher wrote: In otherwords I don't think it's wise yet to merge LZ4 onto stable, not until at least there's some positive feedback on the mailing list. Thoughts? Maybe some positive feedback? :-) I think it makes sense to tie inclusion in the kernel with inclusion into the stable branch. If this gets into the 3.11 kernel, I'm going to want to get it into Fedora releases that use that kernel. This will initially be Fedora 20 (which will branch from rawhide in a couple of weeks) and will eventually be in Fedora 19 and probably Fedora 18. So I'd like to see it in stable, since I would feel less comfortable using the master branch. If LZ4 support isn't in the kernel I think that there isn't a lot of need for support in Fedora since I don't think many people use it for archiving. It mostly gets used for live images. I'll make sure that LZ4 can be used for them, but I suspect most people will still prefer xz for them. But probably at least some people would prefer faster decompression rather than minimal size. As flash drives get bigger (for the same cost) more people will probably prefer speed over size. -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
Re: [PATCH 0/2] Squashfs: add LZ4 compression
On 23 July 2013 16:10, Bruno Wolff III wrote: > On Mon, Jul 22, 2013 at 03:21:01 +0100, > Phillip Lougher wrote: >> >> Hi >> >> Now that LZ4 compression support is in 3.11-rc1, I have written the >> following two patches for Squashfs to use it. > > > If this gets accepted are you going to move the LZ4 changes to > squashfs-tools into the stable branch? I'd like to make LZ4 work in > mksquashfs in at least rawhide once LZ4 is usable for squashfs file systems > in the kernel. So I was wondering whether to expect this to appear in stable > shortly or to expect to start doing builds using the master branch. Hmm, good point I was intending to merge the LZ4 work onto stable yesterday or today, but, I've received more resistance to the idea of LZ4 in Squashfs than I expected I'm not sure that merging LZ4 onto stable now gives the right message, because if it does not go into mainline, it will effectively be experimental or abandoned. In otherwords I don't think it's wise yet to merge LZ4 onto stable, not until at least there's some positive feedback on the mailing list. Thoughts? Maybe some positive feedback? :-) A V2 of the patches will be coming ASAP hopefully with some performance stats. Thanks Phillip -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
Re: [PATCH 0/2] Squashfs: add LZ4 compression
On Mon, Jul 22, 2013 at 03:21:01 +0100, Phillip Lougher wrote: Hi Now that LZ4 compression support is in 3.11-rc1, I have written the following two patches for Squashfs to use it. If this gets accepted are you going to move the LZ4 changes to squashfs-tools into the stable branch? I'd like to make LZ4 work in mksquashfs in at least rawhide once LZ4 is usable for squashfs file systems in the kernel. So I was wondering whether to expect this to appear in stable shortly or to expect to start doing builds using the master branch. -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
Re: [PATCH 0/2] Squashfs: add LZ4 compression
On Mon, Jul 22, 2013 at 03:21:01 +0100, Phillip Lougher phil...@squashfs.org.uk wrote: Hi Now that LZ4 compression support is in 3.11-rc1, I have written the following two patches for Squashfs to use it. If this gets accepted are you going to move the LZ4 changes to squashfs-tools into the stable branch? I'd like to make LZ4 work in mksquashfs in at least rawhide once LZ4 is usable for squashfs file systems in the kernel. So I was wondering whether to expect this to appear in stable shortly or to expect to start doing builds using the master branch. -- To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
Re: [PATCH 0/2] Squashfs: add LZ4 compression
On 23 July 2013 16:10, Bruno Wolff III br...@wolff.to wrote: On Mon, Jul 22, 2013 at 03:21:01 +0100, Phillip Lougher phil...@squashfs.org.uk wrote: Hi Now that LZ4 compression support is in 3.11-rc1, I have written the following two patches for Squashfs to use it. If this gets accepted are you going to move the LZ4 changes to squashfs-tools into the stable branch? I'd like to make LZ4 work in mksquashfs in at least rawhide once LZ4 is usable for squashfs file systems in the kernel. So I was wondering whether to expect this to appear in stable shortly or to expect to start doing builds using the master branch. Hmm, good point I was intending to merge the LZ4 work onto stable yesterday or today, but, I've received more resistance to the idea of LZ4 in Squashfs than I expected I'm not sure that merging LZ4 onto stable now gives the right message, because if it does not go into mainline, it will effectively be experimental or abandoned. In otherwords I don't think it's wise yet to merge LZ4 onto stable, not until at least there's some positive feedback on the mailing list. Thoughts? Maybe some positive feedback? :-) A V2 of the patches will be coming ASAP hopefully with some performance stats. Thanks Phillip -- To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
Re: [PATCH 0/2] Squashfs: add LZ4 compression
On Tue, Jul 23, 2013 at 17:17:30 +0100, Phillip Lougher phillip.loug...@gmail.com wrote: In otherwords I don't think it's wise yet to merge LZ4 onto stable, not until at least there's some positive feedback on the mailing list. Thoughts? Maybe some positive feedback? :-) I think it makes sense to tie inclusion in the kernel with inclusion into the stable branch. If this gets into the 3.11 kernel, I'm going to want to get it into Fedora releases that use that kernel. This will initially be Fedora 20 (which will branch from rawhide in a couple of weeks) and will eventually be in Fedora 19 and probably Fedora 18. So I'd like to see it in stable, since I would feel less comfortable using the master branch. If LZ4 support isn't in the kernel I think that there isn't a lot of need for support in Fedora since I don't think many people use it for archiving. It mostly gets used for live images. I'll make sure that LZ4 can be used for them, but I suspect most people will still prefer xz for them. But probably at least some people would prefer faster decompression rather than minimal size. As flash drives get bigger (for the same cost) more people will probably prefer speed over size. -- To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
Re: [PATCH 0/2] Squashfs: add LZ4 compression
On 22 July 2013 07:04, Gu Zheng wrote: > On 07/22/2013 01:07 PM, Phillip Lougher wrote: > >> On 22 July 2013 04:05, Gu Zheng wrote: >>> Hi Phillip, >>> Have some tests been carried out to confirm that Squashfs really >>> can get benefit from LZ4 compression, comparing with lzo? >> >> This seems to be a loaded question, in that it seems to be trying to >> reopen the "why add lz4 when we already have lzo" debate all over >> again. As LZ4 has been merged to mainline, this appears to be a >> question that has already been answered. > > No, they are different. LZ4 can be merged to mainline, because we can > see the benefit(faster compressing speed under the enabled unaligned > memory access) it brings to us comparing with lzo. The users of LZ4 that has been merged is for decompression of kernel and initramfs, not compression. So far I don't see any users of the LZ4 compression code in the kernel. So you're saying it was merged for fast compression despite there being no users of it? > But it's hard to say that it also really can bring benefit to Squashfs. Prejudiced statement without any evidence, if that's your contention prove it. > >> >> As far as Squashfs is concerned, I believe it is important to give >> people the choice of using LZ4 to compress Squashfs filesystems now >> its been mainlined. As far as expected benefits are concerned, >> Squashfs' use in embedded systems is very similar to compressing >> kernels and initramfs data, in that it tends to be used to compress >> root filesystems. As such the benefits of using LZ4 in Squashfs >> should be broadly similar to using LZ4 to compress kernels and >> initramfs data. Ultimately it is up to people to experiment and >> choose whatever compression is best for their systems. > > Yes, but the premise is that using LZ4 in Squashfs is better than lzo > in at least one actual situation. > No. All it takes is for LZ4 to be better/faster at decompressing the kernel or initramfs to make it advantageous to use LZ4 for Squashfs, thus avoiding the overhead of another decompressor in the kernel.. >> >> People are welcome to try the patches out and report their findings. > > Let's look and see other guys' feedbacks, they are more persuasive.:) Suit yourself, maybe when you start using evidence rather than unsubstantiated assertions, you'll be more persuasive too. So far all I see is wind. Phillip > > Regards, > Gu > >> >> Phillip >> >>> >>> Thanks, >>> Gu >>> >>> On 07/22/2013 10:21 AM, Phillip Lougher wrote: >>> Hi Now that LZ4 compression support is in 3.11-rc1, I have written the following two patches for Squashfs to use it. Phillip Lougher (2): Squashfs: add LZ4 compression support Squashfs: Add LZ4 compression configuration option Documentation/filesystems/squashfs.txt |8 +- fs/squashfs/Kconfig| 15 +++ fs/squashfs/Makefile |1 + fs/squashfs/decompressor.c |7 ++ fs/squashfs/decompressor.h |4 + fs/squashfs/lz4_wrapper.c | 163 fs/squashfs/squashfs_fs.h |1 + 7 files changed, 195 insertions(+), 4 deletions(-) create mode 100644 fs/squashfs/lz4_wrapper.c These patches are also available in the git tree here: browse: https://git.kernel.org/cgit/linux/kernel/git/pkl/squashfs-lz4.git git clone: git://git.kernel.org/pub/scm/linux/kernel/git/pkl/squashfs-lz4.git LZ4 support has (obviously) also been added to the squashfs-tools (Mksquashfs and Unsquashfs). This is available from the Squashfs-tools git repository here: browse: https://git.kernel.org/cgit/fs/squashfs/squashfs-tools.git git clone: git://git.kernel.org/pub/scm/fs/squashfs/squashfs-tools.git When building the squashfs-tools edit the Makefile to enable LZ4 support (by default it is disabled). LZ4 compression can be specified by using the -comp option, e.g. % mksquashfs xxx img.sqsh -comp lz4 The use of LZ4 high compression can be specified using -Xhc, e.g. % mksquashfs xxx img.sqsh -comp lz4 -Xhc Phillip -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/ >>> >>> >> > > > -- > To unsubscribe from this list: send the line "unsubscribe linux-kernel" in > the body of a message to majord...@vger.kernel.org > More majordomo info at http://vger.kernel.org/majordomo-info.html > Please read the FAQ at http://www.tux.org/lkml/ -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majord...@vger.kernel.org More majordomo info at
Re: [PATCH 0/2] Squashfs: add LZ4 compression
On 07/22/2013 01:07 PM, Phillip Lougher wrote: > On 22 July 2013 04:05, Gu Zheng wrote: >> Hi Phillip, >> Have some tests been carried out to confirm that Squashfs really >> can get benefit from LZ4 compression, comparing with lzo? > > This seems to be a loaded question, in that it seems to be trying to > reopen the "why add lz4 when we already have lzo" debate all over > again. As LZ4 has been merged to mainline, this appears to be a > question that has already been answered. No, they are different. LZ4 can be merged to mainline, because we can see the benefit(faster compressing speed under the enabled unaligned memory access) it brings to us comparing with lzo. But it's hard to say that it also really can bring benefit to Squashfs. > > As far as Squashfs is concerned, I believe it is important to give > people the choice of using LZ4 to compress Squashfs filesystems now > its been mainlined. As far as expected benefits are concerned, > Squashfs' use in embedded systems is very similar to compressing > kernels and initramfs data, in that it tends to be used to compress > root filesystems. As such the benefits of using LZ4 in Squashfs > should be broadly similar to using LZ4 to compress kernels and > initramfs data. Ultimately it is up to people to experiment and > choose whatever compression is best for their systems. Yes, but the premise is that using LZ4 in Squashfs is better than lzo in at least one actual situation. > > People are welcome to try the patches out and report their findings. Let's look and see other guys' feedbacks, they are more persuasive.:) Regards, Gu > > Phillip > >> >> Thanks, >> Gu >> >> On 07/22/2013 10:21 AM, Phillip Lougher wrote: >> >>> Hi >>> >>> Now that LZ4 compression support is in 3.11-rc1, I have written the >>> following two patches for Squashfs to use it. >>> >>> Phillip Lougher (2): >>> Squashfs: add LZ4 compression support >>> Squashfs: Add LZ4 compression configuration option >>> >>> Documentation/filesystems/squashfs.txt |8 +- >>> fs/squashfs/Kconfig| 15 +++ >>> fs/squashfs/Makefile |1 + >>> fs/squashfs/decompressor.c |7 ++ >>> fs/squashfs/decompressor.h |4 + >>> fs/squashfs/lz4_wrapper.c | 163 >>> >>> fs/squashfs/squashfs_fs.h |1 + >>> 7 files changed, 195 insertions(+), 4 deletions(-) >>> create mode 100644 fs/squashfs/lz4_wrapper.c >>> >>> These patches are also available in the git tree here: >>> >>> browse: https://git.kernel.org/cgit/linux/kernel/git/pkl/squashfs-lz4.git >>> git clone: >>> git://git.kernel.org/pub/scm/linux/kernel/git/pkl/squashfs-lz4.git >>> >>> LZ4 support has (obviously) also been added to the squashfs-tools >>> (Mksquashfs and Unsquashfs). This is available from the Squashfs-tools >>> git repository here: >>> >>> browse: https://git.kernel.org/cgit/fs/squashfs/squashfs-tools.git >>> git clone: git://git.kernel.org/pub/scm/fs/squashfs/squashfs-tools.git >>> >>> When building the squashfs-tools edit the Makefile to enable LZ4 >>> support (by default it is disabled). >>> >>> LZ4 compression can be specified by using the -comp option, e.g. >>> % mksquashfs xxx img.sqsh -comp lz4 >>> >>> The use of LZ4 high compression can be specified using -Xhc, e.g. >>> >>> % mksquashfs xxx img.sqsh -comp lz4 -Xhc >>> >>> Phillip >>> -- >>> To unsubscribe from this list: send the line "unsubscribe linux-kernel" in >>> the body of a message to majord...@vger.kernel.org >>> More majordomo info at http://vger.kernel.org/majordomo-info.html >>> Please read the FAQ at http://www.tux.org/lkml/ >>> >> >> > -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
Re: [PATCH 0/2] Squashfs: add LZ4 compression
On 07/22/2013 01:07 PM, Phillip Lougher wrote: On 22 July 2013 04:05, Gu Zheng guz.f...@cn.fujitsu.com wrote: Hi Phillip, Have some tests been carried out to confirm that Squashfs really can get benefit from LZ4 compression, comparing with lzo? This seems to be a loaded question, in that it seems to be trying to reopen the why add lz4 when we already have lzo debate all over again. As LZ4 has been merged to mainline, this appears to be a question that has already been answered. No, they are different. LZ4 can be merged to mainline, because we can see the benefit(faster compressing speed under the enabled unaligned memory access) it brings to us comparing with lzo. But it's hard to say that it also really can bring benefit to Squashfs. As far as Squashfs is concerned, I believe it is important to give people the choice of using LZ4 to compress Squashfs filesystems now its been mainlined. As far as expected benefits are concerned, Squashfs' use in embedded systems is very similar to compressing kernels and initramfs data, in that it tends to be used to compress root filesystems. As such the benefits of using LZ4 in Squashfs should be broadly similar to using LZ4 to compress kernels and initramfs data. Ultimately it is up to people to experiment and choose whatever compression is best for their systems. Yes, but the premise is that using LZ4 in Squashfs is better than lzo in at least one actual situation. People are welcome to try the patches out and report their findings. Let's look and see other guys' feedbacks, they are more persuasive.:) Regards, Gu Phillip Thanks, Gu On 07/22/2013 10:21 AM, Phillip Lougher wrote: Hi Now that LZ4 compression support is in 3.11-rc1, I have written the following two patches for Squashfs to use it. Phillip Lougher (2): Squashfs: add LZ4 compression support Squashfs: Add LZ4 compression configuration option Documentation/filesystems/squashfs.txt |8 +- fs/squashfs/Kconfig| 15 +++ fs/squashfs/Makefile |1 + fs/squashfs/decompressor.c |7 ++ fs/squashfs/decompressor.h |4 + fs/squashfs/lz4_wrapper.c | 163 fs/squashfs/squashfs_fs.h |1 + 7 files changed, 195 insertions(+), 4 deletions(-) create mode 100644 fs/squashfs/lz4_wrapper.c These patches are also available in the git tree here: browse: https://git.kernel.org/cgit/linux/kernel/git/pkl/squashfs-lz4.git git clone: git://git.kernel.org/pub/scm/linux/kernel/git/pkl/squashfs-lz4.git LZ4 support has (obviously) also been added to the squashfs-tools (Mksquashfs and Unsquashfs). This is available from the Squashfs-tools git repository here: browse: https://git.kernel.org/cgit/fs/squashfs/squashfs-tools.git git clone: git://git.kernel.org/pub/scm/fs/squashfs/squashfs-tools.git When building the squashfs-tools edit the Makefile to enable LZ4 support (by default it is disabled). LZ4 compression can be specified by using the -comp option, e.g. % mksquashfs xxx img.sqsh -comp lz4 The use of LZ4 high compression can be specified using -Xhc, e.g. % mksquashfs xxx img.sqsh -comp lz4 -Xhc Phillip -- To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/ -- To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
Re: [PATCH 0/2] Squashfs: add LZ4 compression
On 22 July 2013 07:04, Gu Zheng guz.f...@cn.fujitsu.com wrote: On 07/22/2013 01:07 PM, Phillip Lougher wrote: On 22 July 2013 04:05, Gu Zheng guz.f...@cn.fujitsu.com wrote: Hi Phillip, Have some tests been carried out to confirm that Squashfs really can get benefit from LZ4 compression, comparing with lzo? This seems to be a loaded question, in that it seems to be trying to reopen the why add lz4 when we already have lzo debate all over again. As LZ4 has been merged to mainline, this appears to be a question that has already been answered. No, they are different. LZ4 can be merged to mainline, because we can see the benefit(faster compressing speed under the enabled unaligned memory access) it brings to us comparing with lzo. The users of LZ4 that has been merged is for decompression of kernel and initramfs, not compression. So far I don't see any users of the LZ4 compression code in the kernel. So you're saying it was merged for fast compression despite there being no users of it? But it's hard to say that it also really can bring benefit to Squashfs. Prejudiced statement without any evidence, if that's your contention prove it. As far as Squashfs is concerned, I believe it is important to give people the choice of using LZ4 to compress Squashfs filesystems now its been mainlined. As far as expected benefits are concerned, Squashfs' use in embedded systems is very similar to compressing kernels and initramfs data, in that it tends to be used to compress root filesystems. As such the benefits of using LZ4 in Squashfs should be broadly similar to using LZ4 to compress kernels and initramfs data. Ultimately it is up to people to experiment and choose whatever compression is best for their systems. Yes, but the premise is that using LZ4 in Squashfs is better than lzo in at least one actual situation. No. All it takes is for LZ4 to be better/faster at decompressing the kernel or initramfs to make it advantageous to use LZ4 for Squashfs, thus avoiding the overhead of another decompressor in the kernel.. People are welcome to try the patches out and report their findings. Let's look and see other guys' feedbacks, they are more persuasive.:) Suit yourself, maybe when you start using evidence rather than unsubstantiated assertions, you'll be more persuasive too. So far all I see is wind. Phillip Regards, Gu Phillip Thanks, Gu On 07/22/2013 10:21 AM, Phillip Lougher wrote: Hi Now that LZ4 compression support is in 3.11-rc1, I have written the following two patches for Squashfs to use it. Phillip Lougher (2): Squashfs: add LZ4 compression support Squashfs: Add LZ4 compression configuration option Documentation/filesystems/squashfs.txt |8 +- fs/squashfs/Kconfig| 15 +++ fs/squashfs/Makefile |1 + fs/squashfs/decompressor.c |7 ++ fs/squashfs/decompressor.h |4 + fs/squashfs/lz4_wrapper.c | 163 fs/squashfs/squashfs_fs.h |1 + 7 files changed, 195 insertions(+), 4 deletions(-) create mode 100644 fs/squashfs/lz4_wrapper.c These patches are also available in the git tree here: browse: https://git.kernel.org/cgit/linux/kernel/git/pkl/squashfs-lz4.git git clone: git://git.kernel.org/pub/scm/linux/kernel/git/pkl/squashfs-lz4.git LZ4 support has (obviously) also been added to the squashfs-tools (Mksquashfs and Unsquashfs). This is available from the Squashfs-tools git repository here: browse: https://git.kernel.org/cgit/fs/squashfs/squashfs-tools.git git clone: git://git.kernel.org/pub/scm/fs/squashfs/squashfs-tools.git When building the squashfs-tools edit the Makefile to enable LZ4 support (by default it is disabled). LZ4 compression can be specified by using the -comp option, e.g. % mksquashfs xxx img.sqsh -comp lz4 The use of LZ4 high compression can be specified using -Xhc, e.g. % mksquashfs xxx img.sqsh -comp lz4 -Xhc Phillip -- To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/ -- To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/ -- To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
Re: [PATCH 0/2] Squashfs: add LZ4 compression
On 22 July 2013 04:05, Gu Zheng wrote: > Hi Phillip, > Have some tests been carried out to confirm that Squashfs really > can get benefit from LZ4 compression, comparing with lzo? This seems to be a loaded question, in that it seems to be trying to reopen the "why add lz4 when we already have lzo" debate all over again. As LZ4 has been merged to mainline, this appears to be a question that has already been answered. As far as Squashfs is concerned, I believe it is important to give people the choice of using LZ4 to compress Squashfs filesystems now its been mainlined. As far as expected benefits are concerned, Squashfs' use in embedded systems is very similar to compressing kernels and initramfs data, in that it tends to be used to compress root filesystems. As such the benefits of using LZ4 in Squashfs should be broadly similar to using LZ4 to compress kernels and initramfs data. Ultimately it is up to people to experiment and choose whatever compression is best for their systems. People are welcome to try the patches out and report their findings. Phillip > > Thanks, > Gu > > On 07/22/2013 10:21 AM, Phillip Lougher wrote: > >> Hi >> >> Now that LZ4 compression support is in 3.11-rc1, I have written the >> following two patches for Squashfs to use it. >> >> Phillip Lougher (2): >> Squashfs: add LZ4 compression support >> Squashfs: Add LZ4 compression configuration option >> >> Documentation/filesystems/squashfs.txt |8 +- >> fs/squashfs/Kconfig| 15 +++ >> fs/squashfs/Makefile |1 + >> fs/squashfs/decompressor.c |7 ++ >> fs/squashfs/decompressor.h |4 + >> fs/squashfs/lz4_wrapper.c | 163 >> >> fs/squashfs/squashfs_fs.h |1 + >> 7 files changed, 195 insertions(+), 4 deletions(-) >> create mode 100644 fs/squashfs/lz4_wrapper.c >> >> These patches are also available in the git tree here: >> >> browse: https://git.kernel.org/cgit/linux/kernel/git/pkl/squashfs-lz4.git >> git clone: git://git.kernel.org/pub/scm/linux/kernel/git/pkl/squashfs-lz4.git >> >> LZ4 support has (obviously) also been added to the squashfs-tools >> (Mksquashfs and Unsquashfs). This is available from the Squashfs-tools >> git repository here: >> >> browse: https://git.kernel.org/cgit/fs/squashfs/squashfs-tools.git >> git clone: git://git.kernel.org/pub/scm/fs/squashfs/squashfs-tools.git >> >> When building the squashfs-tools edit the Makefile to enable LZ4 >> support (by default it is disabled). >> >> LZ4 compression can be specified by using the -comp option, e.g. >> % mksquashfs xxx img.sqsh -comp lz4 >> >> The use of LZ4 high compression can be specified using -Xhc, e.g. >> >> % mksquashfs xxx img.sqsh -comp lz4 -Xhc >> >> Phillip >> -- >> To unsubscribe from this list: send the line "unsubscribe linux-kernel" in >> the body of a message to majord...@vger.kernel.org >> More majordomo info at http://vger.kernel.org/majordomo-info.html >> Please read the FAQ at http://www.tux.org/lkml/ >> > > -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
Re: [PATCH 0/2] Squashfs: add LZ4 compression
Hi Phillip, Have some tests been carried out to confirm that Squashfs really can get benefit from LZ4 compression, comparing with lzo? Thanks, Gu On 07/22/2013 10:21 AM, Phillip Lougher wrote: > Hi > > Now that LZ4 compression support is in 3.11-rc1, I have written the > following two patches for Squashfs to use it. > > Phillip Lougher (2): > Squashfs: add LZ4 compression support > Squashfs: Add LZ4 compression configuration option > > Documentation/filesystems/squashfs.txt |8 +- > fs/squashfs/Kconfig| 15 +++ > fs/squashfs/Makefile |1 + > fs/squashfs/decompressor.c |7 ++ > fs/squashfs/decompressor.h |4 + > fs/squashfs/lz4_wrapper.c | 163 > > fs/squashfs/squashfs_fs.h |1 + > 7 files changed, 195 insertions(+), 4 deletions(-) > create mode 100644 fs/squashfs/lz4_wrapper.c > > These patches are also available in the git tree here: > > browse: https://git.kernel.org/cgit/linux/kernel/git/pkl/squashfs-lz4.git > git clone: git://git.kernel.org/pub/scm/linux/kernel/git/pkl/squashfs-lz4.git > > LZ4 support has (obviously) also been added to the squashfs-tools > (Mksquashfs and Unsquashfs). This is available from the Squashfs-tools > git repository here: > > browse: https://git.kernel.org/cgit/fs/squashfs/squashfs-tools.git > git clone: git://git.kernel.org/pub/scm/fs/squashfs/squashfs-tools.git > > When building the squashfs-tools edit the Makefile to enable LZ4 > support (by default it is disabled). > > LZ4 compression can be specified by using the -comp option, e.g. > % mksquashfs xxx img.sqsh -comp lz4 > > The use of LZ4 high compression can be specified using -Xhc, e.g. > > % mksquashfs xxx img.sqsh -comp lz4 -Xhc > > Phillip > -- > To unsubscribe from this list: send the line "unsubscribe linux-kernel" in > the body of a message to majord...@vger.kernel.org > More majordomo info at http://vger.kernel.org/majordomo-info.html > Please read the FAQ at http://www.tux.org/lkml/ > -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
[PATCH 0/2] Squashfs: add LZ4 compression
Hi Now that LZ4 compression support is in 3.11-rc1, I have written the following two patches for Squashfs to use it. Phillip Lougher (2): Squashfs: add LZ4 compression support Squashfs: Add LZ4 compression configuration option Documentation/filesystems/squashfs.txt |8 +- fs/squashfs/Kconfig| 15 +++ fs/squashfs/Makefile |1 + fs/squashfs/decompressor.c |7 ++ fs/squashfs/decompressor.h |4 + fs/squashfs/lz4_wrapper.c | 163 fs/squashfs/squashfs_fs.h |1 + 7 files changed, 195 insertions(+), 4 deletions(-) create mode 100644 fs/squashfs/lz4_wrapper.c These patches are also available in the git tree here: browse: https://git.kernel.org/cgit/linux/kernel/git/pkl/squashfs-lz4.git git clone: git://git.kernel.org/pub/scm/linux/kernel/git/pkl/squashfs-lz4.git LZ4 support has (obviously) also been added to the squashfs-tools (Mksquashfs and Unsquashfs). This is available from the Squashfs-tools git repository here: browse: https://git.kernel.org/cgit/fs/squashfs/squashfs-tools.git git clone: git://git.kernel.org/pub/scm/fs/squashfs/squashfs-tools.git When building the squashfs-tools edit the Makefile to enable LZ4 support (by default it is disabled). LZ4 compression can be specified by using the -comp option, e.g. % mksquashfs xxx img.sqsh -comp lz4 The use of LZ4 high compression can be specified using -Xhc, e.g. % mksquashfs xxx img.sqsh -comp lz4 -Xhc Phillip -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
[PATCH 0/2] Squashfs: add LZ4 compression
Hi Now that LZ4 compression support is in 3.11-rc1, I have written the following two patches for Squashfs to use it. Phillip Lougher (2): Squashfs: add LZ4 compression support Squashfs: Add LZ4 compression configuration option Documentation/filesystems/squashfs.txt |8 +- fs/squashfs/Kconfig| 15 +++ fs/squashfs/Makefile |1 + fs/squashfs/decompressor.c |7 ++ fs/squashfs/decompressor.h |4 + fs/squashfs/lz4_wrapper.c | 163 fs/squashfs/squashfs_fs.h |1 + 7 files changed, 195 insertions(+), 4 deletions(-) create mode 100644 fs/squashfs/lz4_wrapper.c These patches are also available in the git tree here: browse: https://git.kernel.org/cgit/linux/kernel/git/pkl/squashfs-lz4.git git clone: git://git.kernel.org/pub/scm/linux/kernel/git/pkl/squashfs-lz4.git LZ4 support has (obviously) also been added to the squashfs-tools (Mksquashfs and Unsquashfs). This is available from the Squashfs-tools git repository here: browse: https://git.kernel.org/cgit/fs/squashfs/squashfs-tools.git git clone: git://git.kernel.org/pub/scm/fs/squashfs/squashfs-tools.git When building the squashfs-tools edit the Makefile to enable LZ4 support (by default it is disabled). LZ4 compression can be specified by using the -comp option, e.g. % mksquashfs xxx img.sqsh -comp lz4 The use of LZ4 high compression can be specified using -Xhc, e.g. % mksquashfs xxx img.sqsh -comp lz4 -Xhc Phillip -- To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
Re: [PATCH 0/2] Squashfs: add LZ4 compression
Hi Phillip, Have some tests been carried out to confirm that Squashfs really can get benefit from LZ4 compression, comparing with lzo? Thanks, Gu On 07/22/2013 10:21 AM, Phillip Lougher wrote: Hi Now that LZ4 compression support is in 3.11-rc1, I have written the following two patches for Squashfs to use it. Phillip Lougher (2): Squashfs: add LZ4 compression support Squashfs: Add LZ4 compression configuration option Documentation/filesystems/squashfs.txt |8 +- fs/squashfs/Kconfig| 15 +++ fs/squashfs/Makefile |1 + fs/squashfs/decompressor.c |7 ++ fs/squashfs/decompressor.h |4 + fs/squashfs/lz4_wrapper.c | 163 fs/squashfs/squashfs_fs.h |1 + 7 files changed, 195 insertions(+), 4 deletions(-) create mode 100644 fs/squashfs/lz4_wrapper.c These patches are also available in the git tree here: browse: https://git.kernel.org/cgit/linux/kernel/git/pkl/squashfs-lz4.git git clone: git://git.kernel.org/pub/scm/linux/kernel/git/pkl/squashfs-lz4.git LZ4 support has (obviously) also been added to the squashfs-tools (Mksquashfs and Unsquashfs). This is available from the Squashfs-tools git repository here: browse: https://git.kernel.org/cgit/fs/squashfs/squashfs-tools.git git clone: git://git.kernel.org/pub/scm/fs/squashfs/squashfs-tools.git When building the squashfs-tools edit the Makefile to enable LZ4 support (by default it is disabled). LZ4 compression can be specified by using the -comp option, e.g. % mksquashfs xxx img.sqsh -comp lz4 The use of LZ4 high compression can be specified using -Xhc, e.g. % mksquashfs xxx img.sqsh -comp lz4 -Xhc Phillip -- To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/ -- To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
Re: [PATCH 0/2] Squashfs: add LZ4 compression
On 22 July 2013 04:05, Gu Zheng guz.f...@cn.fujitsu.com wrote: Hi Phillip, Have some tests been carried out to confirm that Squashfs really can get benefit from LZ4 compression, comparing with lzo? This seems to be a loaded question, in that it seems to be trying to reopen the why add lz4 when we already have lzo debate all over again. As LZ4 has been merged to mainline, this appears to be a question that has already been answered. As far as Squashfs is concerned, I believe it is important to give people the choice of using LZ4 to compress Squashfs filesystems now its been mainlined. As far as expected benefits are concerned, Squashfs' use in embedded systems is very similar to compressing kernels and initramfs data, in that it tends to be used to compress root filesystems. As such the benefits of using LZ4 in Squashfs should be broadly similar to using LZ4 to compress kernels and initramfs data. Ultimately it is up to people to experiment and choose whatever compression is best for their systems. People are welcome to try the patches out and report their findings. Phillip Thanks, Gu On 07/22/2013 10:21 AM, Phillip Lougher wrote: Hi Now that LZ4 compression support is in 3.11-rc1, I have written the following two patches for Squashfs to use it. Phillip Lougher (2): Squashfs: add LZ4 compression support Squashfs: Add LZ4 compression configuration option Documentation/filesystems/squashfs.txt |8 +- fs/squashfs/Kconfig| 15 +++ fs/squashfs/Makefile |1 + fs/squashfs/decompressor.c |7 ++ fs/squashfs/decompressor.h |4 + fs/squashfs/lz4_wrapper.c | 163 fs/squashfs/squashfs_fs.h |1 + 7 files changed, 195 insertions(+), 4 deletions(-) create mode 100644 fs/squashfs/lz4_wrapper.c These patches are also available in the git tree here: browse: https://git.kernel.org/cgit/linux/kernel/git/pkl/squashfs-lz4.git git clone: git://git.kernel.org/pub/scm/linux/kernel/git/pkl/squashfs-lz4.git LZ4 support has (obviously) also been added to the squashfs-tools (Mksquashfs and Unsquashfs). This is available from the Squashfs-tools git repository here: browse: https://git.kernel.org/cgit/fs/squashfs/squashfs-tools.git git clone: git://git.kernel.org/pub/scm/fs/squashfs/squashfs-tools.git When building the squashfs-tools edit the Makefile to enable LZ4 support (by default it is disabled). LZ4 compression can be specified by using the -comp option, e.g. % mksquashfs xxx img.sqsh -comp lz4 The use of LZ4 high compression can be specified using -Xhc, e.g. % mksquashfs xxx img.sqsh -comp lz4 -Xhc Phillip -- To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/ -- To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
