[issue41566] Include much faster DEFLATE implementations in Python's gzip and zlib libraries. (isa-l)

Ruben Vorderman added the comment: Hi, thanks all for the comments and the help. I have created the bindings using Cython. The project is still a work in progress as of this moment. I leave the link here for future reference. Special thanks for the Cython developers for enabling these

[issue41566] Include much faster DEFLATE implementations in Python's gzip and zlib libraries. (isa-l)

Ruben Vorderman added the comment: > If you take this route, please don't write it directly against the CPython > C-API (as you would for a CPython stdlib module). Thanks for reminding me of this. I was planning to take the laziest route possible anyway, reusing as much code from cpython as

[issue41566] Include much faster DEFLATE implementations in Python's gzip and zlib libraries. (isa-l)

Julia Frances added the comment: those are strong and good vocabulary skills you have just keep on making more comments or responses and get that to me as soon as possible *Julia Frances pascack hills* On Thu, Aug 20, 2020 at 11:48 AM Stefan Behnel wrote: > > Stefan Behnel added the

[issue41566] Include much faster DEFLATE implementations in Python's gzip and zlib libraries. (isa-l)

Stefan Behnel added the comment: > On the whole I think the arguments to make a module are very strong. So I > think that is the appropriate way forward. If you take this route, please don't write it directly against the CPython C-API (as you would for a CPython stdlib module). It is much

[issue41566] Include much faster DEFLATE implementations in Python's gzip and zlib libraries. (isa-l)

Ruben Vorderman added the comment: > Within the stdlib, I'd focus only on using things that can be used in a 100% > api compatible way with the existing modules. > Otherwise creating a new module and putting it up on PyPI to expose the > functionality from the libraries you want makes sense

[issue41566] Include much faster DEFLATE implementations in Python's gzip and zlib libraries. (isa-l)

Gregory P. Smith added the comment: fwiw, no PEP is needed for things like this. it'd just be an alternative library implementing the core of the zlib and/or gzip modules behind the scenes. normally this kind of thing would be done using a check for the availability of the library in

[issue41566] Include much faster DEFLATE implementations in Python's gzip and zlib libraries. (isa-l)

Change by Gregory P. Smith : -- pull_requests: -21037 ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe:

[issue41566] Include much faster DEFLATE implementations in Python's gzip and zlib libraries. (isa-l)

Julia Frances added the comment: welcome to python.org in this website there are many ways to do python coding. You need to follow the guide and the rules on how to do python coding. -- hgrepos: +392 keywords: +patch message_count: 8.0 -> 9.0 nosy: +jfrances21 nosy_count: 3.0 -> 4.0

[issue41566] Include much faster DEFLATE implementations in Python's gzip and zlib libraries. (isa-l)

Ruben Vorderman added the comment: I just find out that libdeflate does not support streaming: https://github.com/ebiggers/libdeflate/issues/73 . I should have read the manual better. So that explains the memory usage. Because of that I don't think it is suitable for usage in CPython.

[issue41566] Include much faster DEFLATE implementations in Python's gzip and zlib libraries. (isa-l)

Ruben Vorderman added the comment: > That might be an option then. CPython could use the existing library if it is > available. Dynamic linking indeed seems like a great option here! Users who care about this will probably have the 'isal' and 'libdeflateO' packages installed on their

[issue41566] Include much faster DEFLATE implementations in Python's gzip and zlib libraries. (isa-l)

Change by jack1142 : -- nosy: +jack1142 ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe:

[issue41566] Include much faster DEFLATE implementations in Python's gzip and zlib libraries. (isa-l)

Stefan Behnel added the comment: > libdeflate and isa-l use different compression ratio's for the levels. I don't see why these would need to translate 1:1. The zlib module is a Python API wrapper, it can do its own mapping here, or use the libraries selectively only for some compression

[issue41566] Include much faster DEFLATE implementations in Python's gzip and zlib libraries. (isa-l)

Ruben Vorderman added the comment: nasm or yasm will work. I only have experience building it with nasm. But yes that is indeed a dependency. Personally I do not see the problem with adding nasm as a build dependency, as it opens up possibilities for even more performance optimizations in

[issue41566] Include much faster DEFLATE implementations in Python's gzip and zlib libraries. (isa-l)

Stefan Behnel added the comment: What about building the library? The readme says it needs nasm? That's not a standard dependency for the CPython build currently, which relies solely on a C compiler. -- ___ Python tracker

[issue41566] Include much faster DEFLATE implementations in Python's gzip and zlib libraries. (isa-l)

Stefan Behnel added the comment: > This has to be in a PEP No, the bug tracker seems fine for this. -- nosy: +scoder resolution: not a bug -> stage: resolved -> needs patch status: closed -> open type: -> performance ___ Python tracker

[issue41566] Include much faster DEFLATE implementations in Python's gzip and zlib libraries. (isa-l)

Ruben Vorderman added the comment: This has to be in a PEP. I am sorry I missplaced it on the bugtracker. -- resolution: -> not a bug stage: -> resolved status: open -> closed ___ Python tracker

[issue41566] Include much faster DEFLATE implementations in Python's gzip and zlib libraries. (isa-l)

New submission from Ruben Vorderman : The gzip file format is quite ubiquitous and so is its first (?) free/libre implementation zlib with the gzip command line tool. This uses the DEFLATE algorithm. Lately some faster algorithms (most notable zstd) have popped up which have better speed