[issue17004] Expand zipimport to include other compression methods

Change by Chih-Hsuan Yen : -- nosy: -yan12125 ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe:

[issue17004] Expand zipimport to include other compression methods

Change by Christian Heimes : -- versions: +Python 3.11 -Python 3.8 ___ Python tracker ___ ___ Python-bugs-list mailing list

[issue17004] Expand zipimport to include other compression methods

Change by Brett Cannon : -- nosy: -brett.cannon ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe:

[issue17004] Expand zipimport to include other compression methods

Serhiy Storchaka added the comment: zipimport has been rewritten in pure Python (issue25711). Now it is easier to add support of other compression methods. Although I don't think that reducing the size by 3-8% is worth complicating the code. If you still need this, I think that the simplest

[issue17004] Expand zipimport to include other compression methods

Chi Hsuan Yen added the comment: +1 for that. I like XZ support so that our application size can be reduced. -- nosy: +Chi Hsuan Yen ___ Python tracker

[issue17004] Expand zipimport to include other compression methods

Changes by Eric Snow ericsnowcurren...@gmail.com: -- nosy: +gregory.p.smith, superluser versions: +Python 3.6 -Python 3.4 ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue17004 ___

[issue17004] Expand zipimport to include other compression methods

Eric Snow added the comment: related: issue #17630 and issue #5950 -- nosy: +eric.snow ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue17004 ___ ___

[issue17004] Expand zipimport to include other compression methods

Brett Cannon added the comment: So this seems like a confluence of both supporting compressed files for loading source code as well as supporting new archive formats (e.g. xz vs. tar); zip just happens to do both implicitly. And there is also the question of if you explicitly plan to do this

[issue17004] Expand zipimport to include other compression methods

New submission from Raymond Hettinger: Only a little of the existing logic is tied to the zipfile format. Consider adding support for xz, tar, tar.gz, tar.bz2, etc. In particular, xz has better compression, resulting in both space savings and faster load times. -- messages: 180307

[issue17004] Expand zipimport to include other compression methods

Changes by Brian Curtin br...@python.org: -- components: +Library (Lib) nosy: +brian.curtin ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue17004 ___

[issue17004] Expand zipimport to include other compression methods

Serhiy Storchaka added the comment: tar.* is not a good choice because it doesn't allow random access. Bare tar better than zip only in case when you need to save additional file attributes (Unix file access mode, times, owner, group, links). ZIP format supports all this too, but not zipfile

[issue17004] Expand zipimport to include other compression methods

Serhiy Storchaka added the comment: Here are some tests. time 7z a -tzip -mx=0 python-0.zip $(find Lib -type f -name '*.py') /dev/null time 7z a -tzip python.zip $(find Lib -type f -name '*.py') /dev/null time 7z a -tzip -mx=9 python-9.zip $(find Lib -type f -name '*.py') /dev/null time 7z a

[issue17004] Expand zipimport to include other compression methods

Antoine Pitrou added the comment: Here are some tests. I think you want to put pyc files in the zip file as well. -- nosy: +pitrou ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue17004 ___

[issue17004] Expand zipimport to include other compression methods

Raymond Hettinger added the comment: xz will likely be the best win -- it is purported to compress smaller than bz2 while retaining the decompression speed of zip. As Antoine says, the usual practice is to add py, pyc, and pyo files to the compressed library; otherwise, there is an added cost

[issue17004] Expand zipimport to include other compression methods

Serhiy Storchaka added the comment: Well. ./python -m compileall $(find Lib -type f -name '*.py') ./python -O -m compileall $(find Lib -type f -name '*.py') Tests: FILES=$(find Lib -name '*.py' -o -name '*.py[co]') time 7z a -tzip -mx=0 python-0.zip $FILES /dev/null time 7z a -tzip python.zip

[issue17004] Expand zipimport to include other compression methods

Antoine Pitrou added the comment: Agreed it doesn't look very promising. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue17004 ___ ___