Re: [xz-devel] Re: [PATCH] “xzdiff a.xz b.xz” exit status should reflect whether the files differ

2011-08-12 Thread Lasse Collin
need to wait a little more. The good news is that the lessons learned while working on the Java code should help with XZ Utils. -- Lasse Collin | IRC: Larhzu @ IRCnet Freenode

[xz-devel] XZ for Java 0.4

2011-08-19 Thread Lasse Collin
before 1.0. I don't have anything planned before 1.0 but maybe someone finds something that could be improved. :-) -- Lasse Collin | IRC: Larhzu @ IRCnet Freenode

Re: [xz-devel] Integration with TrueZIP

2011-09-12 Thread Lasse Collin
in a Maven repository would be useful also for Apache Commons Compress integration. -- Lasse Collin | IRC: Larhzu @ IRCnet Freenode

Re: [xz-devel] Use of XZ/LZMA compression in the ZIP file format

2011-09-21 Thread Lasse Collin
in decompressing ZIP files. Probably not in practice. The spec doesn't mention them, alas. The Java version doesn't support LZMA1. If it is adapted to support it, there's no similar limit of lc + lp = 4 as there is in liblzma because in Java the arrays are allocated one by one. -- Lasse Collin

[xz-devel] XZ for Java 1.0

2011-10-29 Thread Lasse Collin
XZ for Java 1.0 was released earlier this week: http://tukaani.org/xz/java.html The code is available also in Maven Central. The actual Java code is identical to the version 0.4, but I made a new release to make it clear that the code and API should now be stable. -- Lasse Collin | IRC

Re: [xz-devel] Is the xz format stable?

2011-11-07 Thread Lasse Collin
is also in xz -lvv --robot output so it should be easy to parse. The idea of --robot is to make parsing simple and stable across xz versions. I didn't update the man page yet. -- Lasse Collin | IRC: Larhzu @ IRCnet Freenode

[xz-devel] Memory usage limits again

2011-11-28 Thread Lasse Collin
it probably will need some sort of soft default limit to keep the maximum memory usage sane. The definition of sane is unclear though. It's not necessarily the same as for compression. -- Lasse Collin | IRC: Larhzu @ IRCnet Freenode

Re: [xz-devel] xz startup time for small files

2011-11-28 Thread Lasse Collin
On 2011-11-28 Thorsten Glaser wrote: Lasse Collin dixit: If xz does indeed know it needs a zero’d allocation and can express that in page sizes (pretty non-portable), _and_ has fallback code for mmap-less architectutes (e.g. several POSIX-for-Windows systems or ancient OSes) then sure

Re: [xz-devel] Oddities with --lzma2 options

2012-03-08 Thread Lasse Collin
--lzma2 -e the -e option is ignored. The -e only affects the presets -0 ... -9. If you want to take -8e as the starting point and then adjust the dictionary size, use this: xz --lzma2=preset=8e,dict=${DICT}KiB -- Lasse Collin | IRC: Larhzu @ IRCnet Freenode

Re: [xz-devel] keep and hard links

2012-06-11 Thread Lasse Collin
is modified, I think it should also allow (de)compression of symlinks and setuid, setgid, and sticky files. This way it would match what --force does. I would like to hear what people think about this. -- Lasse Collin | IRC: Larhzu @ IRCnet Freenode

[xz-devel] XZ Utils 5.0.4

2012-06-22 Thread Lasse Collin
for details. * Update French, German, Italian, and Polish translations. -- Lasse Collin | IRC: Larhzu @ IRCnet Freenode

Re: [xz-devel] next development release

2012-06-28 Thread Lasse Collin
On 2012-06-28 Denis Excoffier wrote: Is a xz-5.1.2alpha (or xz-5.1.1beta) release planned soon? 5.1.2alpha will be released soon. -- Lasse Collin | IRC: Larhzu @ IRCnet Freenode

[xz-devel] XZ for Java 1.1

2012-07-05 Thread Lasse Collin
UnsupportedOptionsException. * Fix bugs in the preset dictionary support in the LZMA2 encoder. -- Lasse Collin | IRC: Larhzu @ IRCnet Freenode

Re: [xz-devel] Wrong content of sources JAR on Maven Central

2012-07-16 Thread Lasse Collin
, then this is better done by providing an online source code repository (it's Git for XZ, isn't it) with a special tag for the release, say xz-1.1. Right. There is a source .zip on tukaani.org and releases have been tagged in the git repository. -- Lasse Collin | IRC: Larhzu @ IRCnet Freenode

Re: [xz-devel] xzgrep and '-h' option

2013-04-05 Thread Lasse Collin
On 2013-04-03 Pavel Raiskup wrote: Hi all, would you please consider the following patch? It is adding support for the '-h' grep option into xzgrep also. The author is Jeff Bastian. Thanks. Committed. -- Lasse Collin | IRC: Larhzu @ IRCnet Freenode

Re: [xz-devel] xz-utils streaming patch

2013-07-04 Thread Lasse Collin
for the decompression side too. I haven't decided yet how to fix it (e.g. require an option or perhaps always disable buffering). -- Lasse Collin | IRC: Larhzu @ IRCnet Freenode

[xz-devel] Optimizing lzma_memcmplen for non-x86 processors

2014-10-13 Thread Lasse Collin
implementations. The reason for using -e is that the relative improvement tends to be bigger when that option is used. On x86-64 I've seen even 25 % faster compression with some files compared to the byte-by-byte method. -- Lasse Collin | IRC: Larhzu @ IRCnet Freenode

Re: [xz-devel] How to compress a folder with xz ?

2014-11-11 Thread Lasse Collin
, compression, and possibly also encryption are done by a single file format and tool. When using tar with gzip/bzip2/xz/whatever the tasks are done by separate file formats and tools. -- Lasse Collin | IRC: Larhzu @ IRCnet Freenode

Re: [xz-devel] Fairly Complete MSVC 2013 Solution/Project

2015-02-03 Thread Lasse Collin
as there is just a single replacement header, other tricks could work. Since there might be other replacement headers in the future, it's no use to change this. It's simplest to add a one-line wrapper header for VS 2013. -- Lasse Collin | IRC: Larhzu @ IRCnet Freenode

[xz-devel] XZ Utils 5.2.1

2015-02-26 Thread Lasse Collin
. * Fixed xzdiff to be compatible with FreeBSD's mktemp which differs from most other mktemp implementations. * Changed CPU core count detection to use cpuset_getaffinity() on FreeBSD. -- Lasse Collin | IRC: Larhzu @ IRCnet Freenode

Re: [xz-devel] minimal liblzma MSVC2013 solution and project

2015-06-19 Thread Lasse Collin
On 2015-06-11 Lasse Collin wrote: On 2015-05-28 Adam Walling wrote: Everything is updated at https://github.com/adzm/xz_win now You can also grab them directly at http://adzm.net/xz_win/ Thanks! It looks good now. There are still a few unneeded headers listed, but those should have

Re: [xz-devel] valgrind conditional jump depends on uninitialized value

2015-11-04 Thread Lasse Collin
n even though the reason was known. I committed the fix to to the master branch (it will be in v5.2 before 5.2.3). -- Lasse Collin | IRC: Larhzu @ IRCnet & Freenode

Re: [xz-devel] minimal liblzma MSVC2013 solution and project

2015-07-12 Thread Lasse Collin
I'm sorry that it takes so long for me to reply. :-( On 2015-06-30 Adam Walling wrote: On Fri, Jun 19, 2015 at 1:42 PM, Lasse Collin lasse.col...@tukaani.org wrote: ... My understanding is that the symbols exported from a DLL should be marked with __declspec(dllexport) when building

Re: [xz-devel] Only single core used when trying multi-thread compression

2016-04-12 Thread Lasse Collin
inux issue (or similar), it would be good to report it to the distribution maintainers. -- Lasse Collin | IRC: Larhzu @ IRCnet & Freenode

Re: [xz-devel] Preserve file time on MinGW

2016-05-12 Thread Lasse Collin
e but it would be OK too if there were no other way. -- Lasse Collin | IRC: Larhzu @ IRCnet & Freenode

Re: [xz-devel] XZ and C99 multiple definition issue

2016-10-05 Thread Lasse Collin
ck of warnings doesn't mean that there aren't any aliasing issues. src/liblzma/common/memcmplen.h is another place where similar casts are done. It's a new file in 5.2.x (not present in 5.0.x) and was added to get a bit better performance for common buffer comparisons. -- Lasse Collin | IRC: Larhzu @ IRCnet & Freenode

[xz-devel] XZ for Java 1.6

2016-11-27 Thread Lasse Collin
w LZMA (i.e. LZMA1) streams and to the legacy .lzma format. -- Lasse Collin | IRC: Larhzu @ IRCnet & Freenode

Re: [xz-devel] xz and fsync()

2016-12-28 Thread Lasse Collin
Thanks for your comment! On 2016-12-18 John Reiser wrote: > On 12/18/2016 11:30 AM, Lasse Collin wrote: > > There's a bug report about data loss due computer losing power. > > fsync() or fdatasync() in xz would quite likely have avoided the > > data loss. > > >

Re: [xz-devel] Can "xz -T0 SMALLFILE1 SMALLFILE2 ... FILE99" be made multi-threaded?

2018-06-15 Thread Lasse Collin
he value that is internally available for --threads=0. -- Lasse Collin | IRC: Larhzu @ IRCnet & Freenode

[xz-devel] XZ Utils 5.2.4 and 5.3.1alpha

2018-04-29 Thread Lasse Collin
d lzma_file_info_decoder() into liblzma and use it in xz to implement the --list feature. * Capsicum sandbox support is enabled by default where available (FreeBSD >= 10). -- Lasse Collin | IRC: Larhzu @ IRCnet & Freenode

Re: [xz-devel] Automatic-Module-Name for XZ for Java?

2017-12-31 Thread Lasse Collin
> As XZ uses org.tukaani.xz as its OSGi bundle name, it seems logical to > use the same name for a module. The simple change below would achieve > that. Thanks. I will add that. There needs to be a new release soon anyway to fix the issue of XZ for Java 1.7 binaries in the Maven Central

[xz-devel] XZ for Java 1.8

2018-01-04 Thread Lasse Collin
t;ant". Set it to 1.6 or higher. The default value 1.5 isn't supported by OpenJDK 9 or later. * Add "Automatic-Module-Name" = "org.tukaani.xz". -- Lasse Collin | IRC: Larhzu @ IRCnet & Freenode

Re: [xz-devel] patch for Intel compiler - use of Intel compiler intrinsics e.g. bit-scan-reverse

2018-01-10 Thread Lasse Collin
ould be useful for testing compiler-specific things, but since I already have trouble getting things done, I probably am not going spend time on setting it up etc. in the foreseeable future. > In any source file that refers to Intel intrinsics, there should be a > #include of to futu

Re: [xz-devel] Automatic-Module-Name for XZ for Java?

2018-01-02 Thread Lasse Collin
On 2018-01-01 Stefan Bodewig wrote: > On 2017-12-31, Lasse Collin wrote: > > Would it be too complicated to turn XZ into a proper module? How > > useful is that? > > As XZ hasn't got any dependencies you'd only benefit from an explicit > module info if you wanted to rest

Re: [xz-devel] Adding fuzz testing support to liblzma

2018-10-29 Thread Lasse Collin
e input and output chunk sizes is probably needed to make the second version faster. You could try some odd values between 100 and 250, or maybe even up to 500. On the other hand, it's possible that I'm putting too much weight on the importance of fuzzing the stop & continue code paths. Thanks again! -- Lasse Collin | IRC: Larhzu @ IRCnet & Freenode

Re: [xz-devel] Adding fuzz testing support to liblzma

2018-10-30 Thread Lasse Collin
as valuable for fuzzing as I thought and we should just use the simple fast version. -- Lasse Collin | IRC: Larhzu @ IRCnet & Freenode

Re: [xz-devel] [PATCH] 'have have' typos

2018-11-22 Thread Lasse Collin
On 2018-11-22 Pavel Raiskup wrote: > --- > src/xz/signals.c | 2 +- > src/xz/xz.1 | 2 +- > 2 files changed, 2 insertions(+), 2 deletions(-) Thanks! Committed. -- Lasse Collin | IRC: Larhzu @ IRCnet & Freenode

Re: [xz-devel] Translation platform for XZ ?

2019-02-21 Thread Lasse Collin
.4 to be translated (or submit to a small subgroup to find out if something needs to be fixed at xz side first)? -- Lasse Collin | IRC: Larhzu @ IRCnet & Freenode

Re: [xz-devel] Internationalization of man pages

2019-06-22 Thread Lasse Collin
ons. > Once it works, xz needs a second translation domain at GNU TP. OK. The translations of the command line tools are temporarily stuck due to me at the moment. :-( -- Lasse Collin | IRC: Larhzu @ IRCnet & Freenode

Re: [xz-devel] Internationalization of man pages

2019-06-26 Thread Lasse Collin
On 2019-06-23 Mario Blättermann wrote: > Am Sa., 22. Juni 2019 um 23:53 Uhr schrieb Lasse Collin > : > > - Is xzdec-man.pot intentionally there or should it be part of > > xz-man.pot? > > > It's an artifact from a separate creation of a pot file for xzdec.1. >

Re: [xz-devel] Internationalization of man pages

2019-06-28 Thread Lasse Collin
On 2019-06-26 Lasse Collin wrote: > The overlong lines in --help simply should be fixed by the > translators. In the near future xz won't have auto-wrap support for > --help strings. I will reconsider this. It might be less painful to wrap multibyte strings in portable C than I ha

Re: [xz-devel] Internationalization of man pages

2019-07-14 Thread Lasse Collin
the line length and alignment problems for good. -- Lasse Collin | IRC: Larhzu @ IRCnet & Freenode

Re: [xz-devel] Internationalization of man pages

2020-02-12 Thread Lasse Collin
On 2020-02-12 Mario Blättermann wrote: > Lasse Collin schrieb am Fr., 7. Feb. 2020, > 15:32: > > - po4a is never needed when building from a release tarball. > > This means, distribution packagers don't have to bother with po4a, > and the translated man pages will be in

Re: [xz-devel] cmake support?

2020-02-24 Thread Lasse Collin
in that email are still valid. In addition to testing with MSVC, it can now be tested on other platforms too. At least I would like to know if it works with MSVC to build static and shared liblzma, and does it name the shared liblzma file "liblzma.dll" as I hope it does. Thanks! -- La

Re: [xz-devel] cmake support?

2020-02-28 Thread Lasse Collin
ds like a bug in the CMake files unless MSVC really supports __builtin_assume_aligned that GCC and Clang support. xz 5.2.4 doesn't recognize that define so it's harmless there. So this must be fixed too if it is broken. The above snapshot is good for testing this with CMake. -- Lasse Collin | IRC: Larhzu @ IRCnet & Freenode

Re: [xz-devel] cmake support?

2020-02-27 Thread Lasse Collin
y, more feedback from CMake users is welcome. The liblzma part should work on multiple operating systems; it's not Windows-only anymore. See the comment in the beginning of CMakeLists.txt in xz.git. -- Lasse Collin | IRC: Larhzu @ IRCnet & Freenode

Re: [xz-devel] Internationalization of man pages

2020-02-07 Thread Lasse Collin
ripting for those details is ugly). The test should be done so that there are translated man pages available in the po4a/man directory, e.g. by using de.po from the first post of this thread. -- Lasse Collin | IRC: Larhzu @ IRCnet & Freenode

Re: [xz-devel] cmake support?

2020-02-17 Thread Lasse Collin
ic to GNU/Linux" would be important (and a check if librt is needed for clock_gettime). The M4 macros are in m4/tuklib_cpucores.m4 and m4/tuklib_physmem.m4. These aren't a priority for now as the main reason for CMake support still is MSVC and gett

Re: [xz-devel] cmake support?

2020-02-16 Thread Lasse Collin
huge so it the command line lengths don't get too long, but is it bad/ugly on Windows? - NDEBUG shouldn't be #defined for debug builds. Thoughts, fixes, suggestions etc. are welcome. -- Lasse Collin |

Re: [xz-devel] Internationalization of man pages

2020-02-14 Thread Lasse Collin
On 2020-02-14 Mario Blättermann wrote: > Am Mi., 12. Feb. 2020 um 19:05 Uhr schrieb Lasse Collin > : > > On 2020-02-12 Mario Blättermann wrote: > > > Lasse Collin schrieb am Fr., 7. Feb. > > > 2020, 15:32: > > > > The extra po4a options like unkn

Re: [xz-devel] cmake support?

2020-02-16 Thread Lasse Collin
o liblzmaConfig.cmake since I got an impression from other sources that it is required. Thanks for your help! -- Lasse Collin | IRC: Larhzu @ IRCnet & Freenode # # # This provides very limited CMake support: #

Re: [xz-devel] cmake support?

2020-02-16 Thread Lasse Collin
On 2020-02-16 Lasse Collin wrote: > I quickly checked a few random things and didn't find anything else > that wouldn't be OK with 3.1. target_link_options needs 3.13. Seems that it can be avoided by using set_target_properties(liblzma PROPERTIES LINK_FLAGS -Wl,--version-

Re: [xz-devel] cmake support?

2020-02-16 Thread Lasse Collin
f supporting old versions largely depends on if the CMake support will become usable for more than building liblzma on Windows. > On Sun, Feb 16, 2020 at 4:48 PM Lasse Collin > wrote: > > If I use add_library(lzma ...) and PREFIX "lib", isn't the end > > result practic

Re: [xz-devel] cmake support?

2020-02-15 Thread Lasse Collin
rom vcpkg. A link to a known good CMakeLists.txt (and possible other files) would be nice along with an explanation what it builds (e.g. both static and shared liblzma?) and which targets are supported (e.g. is it MSVC only?). Thanks! -- Lasse Collin | IRC: Larhzu @ IRCnet & Freenode

Re: [xz-devel] Parallel decompression support

2020-04-18 Thread Lasse Collin
me other features) should have been implemented years ago. However, I haven't had energy to do it. -- Lasse Collin | IRC: Larhzu @ IRCnet & Freenode

Re: [xz-devel] Compress thousands of similar tarballs by xz

2020-05-11 Thread Lasse Collin
didn't get good results with with megabyte-sized files but perhaps I don't know how to use it correctly. Using a single .tar as a dictionary worked great though. In both cases you obviously need latest.tar to decompress the old*.tar{.delta,.zst} files. -- Lasse Collin | IRC: Larhzu @ IRCnet & Freenode

Re: [xz-devel] Parallel decompression support

2020-05-11 Thread Lasse Collin
busy all the time. With decompression one has to decide how much memory can be used by default. If there is no limit, in the extreme case a decoder could read the whole input file in RAM and allocate output buffer for the whole uncompressed file. This problem doesn't exist in your mmap (or pread) approach.

[xz-devel] XZ Utils 5.2.5

2020-03-17 Thread Lasse Collin
misaligned column headings in tables. In the future, many of these strings will be split and e.g. the table column alignment will be handled in software. This should make the strings easier to translate. -- Lasse Collin | IRC: Larhzu @ IRCnet & Freenode

Re: [xz-devel] [PATCH] CMake: Add missing include directory when building the shared library

2020-07-12 Thread Lasse Collin
t;https://tukaani.org/xz/> > Product version: 5.3.1alpha Looks good. I have finally committed it. Thanks! -- Lasse Collin | IRC: Larhzu @ IRCnet & Freenode

Re: [xz-devel] BUG: liblzma: LZMA+BCJ raw decode: output truncated last word

2020-07-12 Thread Lasse Collin
endian uint64_t; UINT64_MAX means unknown and then (and only then) EOPM must be present - LZMA2, possibly together with a BCJ or Delta filter, with lzma_raw_decoder() since LZMA2 always includes the end marker. -- Lasse Collin | IRC: Larhzu @ IRCnet & Freenode

Re: [xz-devel] LZMA_BUF_ERROR

2020-06-04 Thread Lasse Collin
o initialize lzma_alone_decoder(), pass the five bytes, then pass either the 64-bit uncompressed size (if EOS bit in .zip headers is unset) or eight 0xFF bytes (if EOS bit in .zip headers is set), and finally pass the actual LZMA data. -- Lasse Collin | IRC: Larhzu @ IRCnet & Freenode

Re: [xz-devel] [PATCH] CMake: Add missing include directory when building the shared library

2020-06-04 Thread Lasse Collin
on/common_w32res.rc @@ -6,7 +6,9 @@ */ #include -#include "config.h" +#ifdef HAVE_CONFIG_H +# include "config.h" +#endif #define LZMA_H_INTERNAL #define LZMA_H_INTERNAL_RC #include "lzma/version.h" -- Lasse Collin | IRC: Larhzu @ IRCnet & Freenode