Re: [ANN] Squashfs tools 4.3 released
Hi Phillip,
On Wed, May 14, 2014 at 3:35 AM, Phillip Lougher
wrote:
> I'm pleased to announce the release of Squashfs tools 4.3.
Thanks a lot!
> 8. The file being compressed/uncompressed in Mksquashfs/Unsquashfs is now
>displayed if CTRL-\ (SIGQUIT from keyboard) typed.
>
> 9. The status of the internal queues/caches in Mksquashfs/Unsquashfs is
>now displayed if CTRL-\ (SIGQUIT from keyboard) is typed twice within
>one second. Normally only useful for "power users", but it can be
>used to discover if there's any bottlenecks affecting performance
>(the bottleneck will normally be the compressors/fragment compressors).
Sorry for being a bit later, but I'm wondering if it would be better to use
SIGUSR1 (cfr. dd(1)), instead of modifying the behavior for a standard
signal like SIGQUIT?
Gr{oetje,eeting}s,
Geert
--
Geert Uytterhoeven -- There's lots of Linux beyond ia32 -- ge...@linux-m68k.org
In personal conversations with technical people, I call myself a hacker. But
when I'm talking to journalists I just say "programmer" or something like that.
-- Linus Torvalds
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majord...@vger.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/
Re: [ANN] Squashfs tools 4.3 released
Hi Phillip,
On Wed, May 14, 2014 at 3:35 AM, Phillip Lougher
phil...@lougher.demon.co.uk wrote:
I'm pleased to announce the release of Squashfs tools 4.3.
Thanks a lot!
8. The file being compressed/uncompressed in Mksquashfs/Unsquashfs is now
displayed if CTRL-\ (SIGQUIT from keyboard) typed.
9. The status of the internal queues/caches in Mksquashfs/Unsquashfs is
now displayed if CTRL-\ (SIGQUIT from keyboard) is typed twice within
one second. Normally only useful for power users, but it can be
used to discover if there's any bottlenecks affecting performance
(the bottleneck will normally be the compressors/fragment compressors).
Sorry for being a bit later, but I'm wondering if it would be better to use
SIGUSR1 (cfr. dd(1)), instead of modifying the behavior for a standard
signal like SIGQUIT?
Gr{oetje,eeting}s,
Geert
--
Geert Uytterhoeven -- There's lots of Linux beyond ia32 -- ge...@linux-m68k.org
In personal conversations with technical people, I call myself a hacker. But
when I'm talking to journalists I just say programmer or something like that.
-- Linus Torvalds
--
To unsubscribe from this list: send the line unsubscribe linux-kernel in
the body of a message to majord...@vger.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/
[ANN] Squashfs tools 4.3 released
Hi, I'm pleased to announce the release of Squashfs tools 4.3. This is the first release in over 3 years, and there are substantial improvements to stability, new compression options and compressors, speed optimisations, new options for Mksquashfs/Unsquashfs, and fixes for CVE-2012-4024 and CVE-2012-4025. The new release can be downloaded here: http://sourceforge.net/projects/squashfs/files/latest/download?source=files Changes in Squashfs-tools 4.3 - 1. Stability improvements. Better checking of user input for out of range/invalid values. Better handling of corrupted Squashfs filesystems (Mksquashfs append mode, and Unsquashfs). Better handling of buffer overflow/underflow. 2. GZIP compressor now supports compression options, allowing different compression levels to be used. 3. Rewritten LZO compressor with compression options, allowing different LZO algorithms and different compression levels to be used. 4. New LZ4 compressor (note not yet in mainline kernel) 5. Better default memory usage for Mksquashfs. Mksquashfs by default now uses 25% of physical memory. 6. Duplicate checking in Mksquashfs further optimised. With certain "problem filesystems" greater than 2x performance improvement. Filesystems with a lot of duplicates should see at least 10-20% speed improvement. 7. The -stat option in Unsquashfs now displays the compression options used to generate the original filesystem. Previously -stat only displayed the compression algorithm used. 8. The file being compressed/uncompressed in Mksquashfs/Unsquashfs is now displayed if CTRL-\ (SIGQUIT from keyboard) typed. 9. The status of the internal queues/caches in Mksquashfs/Unsquashfs is now displayed if CTRL-\ (SIGQUIT from keyboard) is typed twice within one second. Normally only useful for "power users", but it can be used to discover if there's any bottlenecks affecting performance (the bottleneck will normally be the compressors/fragment compressors). 10. Miscellaneous new options for Mksquashfs/Unsquashfs to fine tune behaviour. 11. Fixes for CVE-2012-4024 and CVE-2012-4025. Compatiblity Mksquashfs 4.3 generates 4.0 filesystems. These filesystems are fully compatible/interchangable with filesystems generated by Mksquashfs 4.0 and are mountable on 2.6.29 and later kernels. Compressors --- New compression options and compressors are now supported. The new options and compressors are: 1. gzip -Xcompression-level should be 1 .. 9 (default 9) -Xwindow-size should be 8 .. 15 (default 15) -Xstrategy strategy1,strategy2,...,strategyN Compress using strategy1,strategy2,...,strategyN in turn and choose the best compression. Available strategies: default, filtered, huffman_only, run_length_encoded and fixed 2. lzo -Xalgorithm Where is one of: lzo1x_1 lzo1x_1_11 lzo1x_1_12 lzo1x_1_15 lzo1x_999 (default) -Xcompression-level should be 1 .. 9 (default 8) Only applies to lzo1x_999 algorithm 3. lz4 -Xhc Compress using LZ4 High Compression The compression specific options are, obviously, specific to the compressor in question, and you should read the compressor documentation and check their web sites to understand their behaviour. In general the defaults used by Mksquashfs for each compressor are optimised to give the best performance for each compressor, where what constitutes best depends on the compressor. For gzip/xz best means highest compression (trying multiple filters/strategies can improve compression, but this is extremely expensive computationally, and hence, not suitable for the defaults), for LZO/LZ4 best means a tradeoff between compression and (de)-compression overhead (LZO/LZ4 by definition are intended for weaker processors). New Mksquashfs options -- 1. -mem Set the amount of memory used by Mksquashfs to bytes. G/M and K post-fixes are supported. By default Mksquashfs uses 25% of the physical memory. Increasing this with the -mem option can increase performance (note it does not have any effect on compression). Reducing it can prevent thrashing if the system is busy and there is not 25% of physical memory free (again, note it does not have any effect on compression). 2. -exit-on-error By default Mksquashfs treats certain errors as benign, if these errors occur Mksquashfs prints the error on the console but continues. These errors are typically failure to read a file from the source filesystem. This is deliberate, in many cases users prefer Mksquashfs to flag the error but continue rather than abort what may be hours of
[ANN] Squashfs tools 4.3 released
Hi, I'm pleased to announce the release of Squashfs tools 4.3. This is the first release in over 3 years, and there are substantial improvements to stability, new compression options and compressors, speed optimisations, new options for Mksquashfs/Unsquashfs, and fixes for CVE-2012-4024 and CVE-2012-4025. The new release can be downloaded here: http://sourceforge.net/projects/squashfs/files/latest/download?source=files Changes in Squashfs-tools 4.3 - 1. Stability improvements. Better checking of user input for out of range/invalid values. Better handling of corrupted Squashfs filesystems (Mksquashfs append mode, and Unsquashfs). Better handling of buffer overflow/underflow. 2. GZIP compressor now supports compression options, allowing different compression levels to be used. 3. Rewritten LZO compressor with compression options, allowing different LZO algorithms and different compression levels to be used. 4. New LZ4 compressor (note not yet in mainline kernel) 5. Better default memory usage for Mksquashfs. Mksquashfs by default now uses 25% of physical memory. 6. Duplicate checking in Mksquashfs further optimised. With certain problem filesystems greater than 2x performance improvement. Filesystems with a lot of duplicates should see at least 10-20% speed improvement. 7. The -stat option in Unsquashfs now displays the compression options used to generate the original filesystem. Previously -stat only displayed the compression algorithm used. 8. The file being compressed/uncompressed in Mksquashfs/Unsquashfs is now displayed if CTRL-\ (SIGQUIT from keyboard) typed. 9. The status of the internal queues/caches in Mksquashfs/Unsquashfs is now displayed if CTRL-\ (SIGQUIT from keyboard) is typed twice within one second. Normally only useful for power users, but it can be used to discover if there's any bottlenecks affecting performance (the bottleneck will normally be the compressors/fragment compressors). 10. Miscellaneous new options for Mksquashfs/Unsquashfs to fine tune behaviour. 11. Fixes for CVE-2012-4024 and CVE-2012-4025. Compatiblity Mksquashfs 4.3 generates 4.0 filesystems. These filesystems are fully compatible/interchangable with filesystems generated by Mksquashfs 4.0 and are mountable on 2.6.29 and later kernels. Compressors --- New compression options and compressors are now supported. The new options and compressors are: 1. gzip -Xcompression-level compression-level compression-level should be 1 .. 9 (default 9) -Xwindow-size window-size window-size should be 8 .. 15 (default 15) -Xstrategy strategy1,strategy2,...,strategyN Compress using strategy1,strategy2,...,strategyN in turn and choose the best compression. Available strategies: default, filtered, huffman_only, run_length_encoded and fixed 2. lzo -Xalgorithm algorithm Where algorithm is one of: lzo1x_1 lzo1x_1_11 lzo1x_1_12 lzo1x_1_15 lzo1x_999 (default) -Xcompression-level compression-level compression-level should be 1 .. 9 (default 8) Only applies to lzo1x_999 algorithm 3. lz4 -Xhc Compress using LZ4 High Compression The compression specific options are, obviously, specific to the compressor in question, and you should read the compressor documentation and check their web sites to understand their behaviour. In general the defaults used by Mksquashfs for each compressor are optimised to give the best performance for each compressor, where what constitutes best depends on the compressor. For gzip/xz best means highest compression (trying multiple filters/strategies can improve compression, but this is extremely expensive computationally, and hence, not suitable for the defaults), for LZO/LZ4 best means a tradeoff between compression and (de)-compression overhead (LZO/LZ4 by definition are intended for weaker processors). New Mksquashfs options -- 1. -mem size Set the amount of memory used by Mksquashfs to size bytes. G/M and K post-fixes are supported. By default Mksquashfs uses 25% of the physical memory. Increasing this with the -mem option can increase performance (note it does not have any effect on compression). Reducing it can prevent thrashing if the system is busy and there is not 25% of physical memory free (again, note it does not have any effect on compression). 2. -exit-on-error By default Mksquashfs treats certain errors as benign, if these errors occur Mksquashfs prints the error on the console but continues. These errors are typically failure to read a file from the source filesystem. This is deliberate, in
