[issue21751] Expand zipimport to support bzip2 and lzma

2014-06-15 Thread Serhiy Storchaka
Serhiy Storchaka added the comment: You can use deflate for Python files and advanced compression methods for large well-compressable package data. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue21751

[issue21751] Expand zipimport to support bzip2 and lzma

2014-06-14 Thread Serhiy Storchaka
Changes by Serhiy Storchaka storch...@gmail.com: -- resolution: - duplicate status: open - closed superseder: - Expand zipimport to include other compression methods ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue21751

[issue21751] Expand zipimport to support bzip2 and lzma

2014-06-14 Thread Serhiy Storchaka
Serhiy Storchaka added the comment: As shown in msg180323, using lzma compression for typical *.py and *.pyc produces 8% less zip file, but reading from it is 2.5 times slower. The bzip2 compression is even worse. So there is no large benefit in supporting other compression methods.

[issue21751] Expand zipimport to support bzip2 and lzma

2014-06-14 Thread Donald Stufft
Donald Stufft added the comment: I disagree that there is no large benefit. Python files aren't the only files that could exist inside of a zip file. Supporting LZMA import (or bz2) would make it easier to have LZMA or bzip2 wheels in the future without losing the ability to import them.

[issue21751] Expand zipimport to support bzip2 and lzma

2014-06-14 Thread Serhiy Storchaka
Serhiy Storchaka added the comment: For non-Python files you don't need support of bzip2 or lzma compression in zipimport. Use zipfile which supports advanced compression. -- ___ Python tracker rep...@bugs.python.org

[issue21751] Expand zipimport to support bzip2 and lzma

2014-06-14 Thread Donald Stufft
Donald Stufft added the comment: I'm not sure what that statement means. There is package data that sits alongside python files. These cannot use anything but DEFLATED because zipimport doesn't support it. -- ___ Python tracker

[issue21751] Expand zipimport to support bzip2 and lzma

2014-06-14 Thread Eric Snow
Eric Snow added the comment: related: issue #17630 -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue21751 ___ ___ Python-bugs-list mailing list

[issue21751] Expand zipimport to support bzip2 and lzma

2014-06-14 Thread Nick Coghlan
Nick Coghlan added the comment: Another use case is more aggressively shrinking the bundled copy of pip. We don't really care about speed of execution there (since we only run it directly once at install time to do the bootstrapping), but we do care about the impact on the installer size.

[issue21751] Expand zipimport to support bzip2 and lzma

2014-06-13 Thread Donald Stufft
New submission from Donald Stufft: Since Python 3.3 the zipfile module has support bzip2 and lzma compression, however the zipimporter does not support these. It would be awesome if zipimport did support them. -- messages: 220477 nosy: brett.cannon, dstufft, eric.snow, ncoghlan

[issue21751] Expand zipimport to support bzip2 and lzma

2014-06-13 Thread R. David Murray
R. David Murray added the comment: See also issue 17004 and issue 5950. -- nosy: +r.david.murray ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue21751 ___

[issue21751] Expand zipimport to support bzip2 and lzma

2014-06-13 Thread Brett Cannon
Brett Cannon added the comment: Zipimporter doesn't use zipfile (the former is written in C), so it unfortunately doesn't fall through for support. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue21751

[issue21751] Expand zipimport to support bzip2 and lzma

2014-06-13 Thread Donald Stufft
Donald Stufft added the comment: Right, but it could still have support for those things implemented yea? -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue21751 ___

[issue21751] Expand zipimport to support bzip2 and lzma

2014-06-13 Thread Brett Cannon
Brett Cannon added the comment: On Jun 13, 2014 7:39 PM, Donald Stufft rep...@bugs.python.org wrote: Donald Stufft added the comment: Right, but it could still have support for those things implemented yea? Yes, it's just zipimport has a history of being difficult to maintain.