On 2023-12-22 at 01:58:58 +0100, luigi scarso wrote: > On Fri, 22 Dec 2023 at 01:21, Reinhard Kotucha via luatex <luatex@tug.org> > wrote: > > > On 2023-12-21 at 10:27:48 +0100, Hans Hagen wrote: > > > > > I stop here as I've written plenty about performance the last > > > decades in various docs, > > > > Hi Hans, > > please let me mention this though: > > > > A few months ago I uncompressed the lualatex format file and > > compressed it with lz4. The lz4-compressed file was smaller than the > > original format file. Though I know that luatex doesn't use maximum > > gzip compression, I didn't really expect this. > > > > 26702648 lualatex.fmt-uncompressed > > 12201683 lualatex.fmt > > 9926586 lualatex.fmt.lz4 > > > > But what I absolutely didn't expect is that de-compression of lz4 > > files is about 7.5 times as fast as de-compression of the gzip'ed > > format file. > > > > In order to determine speed I directed the de-compressed output to > > /dev/null because when writing to disk results differ much more > > between successive runs and a format file is extracted in memory and > > not written to disk. > > > > Maybe it's worthwhile to keep an eye on lz4. > > > > > Good to know. A quick search, just for the record: > https://manishrjain.com/compression-algo-moving-data > > But I think lz4 is better than zstd for a format.
Please note that I didn't try anything else but lz4. There might be other compressors worth to be considered nowadays. I just tried lz4 because someone mentioned it at TUG-2023 (not in a talk but at dinner). Regards, Reinhard -- ------------------------------------------------------------------ Reinhard Kotucha Phone: +49-511-3373112 Marschnerstr. 25 D-30167 Hannover mailto:reinhard.kotu...@gmx.de ------------------------------------------------------------------
