[ZODB-Dev] Build compression into ZODB 3.11?
I'm pretty happy with how zc.zlibstorage has worked out. Should I build this into ZODB 3.11? BTW, lz4 compression looks interesting. The Python binding (at least from PyPI) is broken. I submitted an issue. Hopefully it will be fixed. Jim -- Jim Fulton http://www.linkedin.com/in/jimfulton ___ For more information about ZODB, see http://zodb.org/ ZODB-Dev mailing list - ZODB-Dev@zope.org https://mail.zope.org/mailman/listinfo/zodb-dev
Re: [ZODB-Dev] Build compression into ZODB 3.11?
On 14 March 2012 17:47, Jim Fulton j...@zope.com wrote: I'm pretty happy with how zc.zlibstorage has worked out. Should I build this into ZODB 3.11? +1 BTW, lz4 compression looks interesting. The Python binding (at least from PyPI) is broken. I submitted an issue. Hopefully it will be fixed. FWIW, I experimented with c_zlib from https://gist.github.com/242459 in order to use a zlib default dictionary - a 32KB string used to pre-fill the compression buffer. Using a ~75MB Data.fs from a Plone site that compressed down to ~30MB with zc.zlibstorage normally, the most successful dictionary I tried was the end of the Data.fs itself which saved only an additional 6% over an empty dictionary. That feels like an unfair test to me, probably deduplicating serialized catalog bucket values. The next best was the last 32KB from another Plone Data.fs which only managed to save an additional 2.5% and a fairly short dictionary with common pickled classes saved an additional 2%. None of those savings seem worthwhile pursuing further given the extra brittleness involved. Laurence ___ For more information about ZODB, see http://zodb.org/ ZODB-Dev mailing list - ZODB-Dev@zope.org https://mail.zope.org/mailman/listinfo/zodb-dev
Re: [ZODB-Dev] Build compression into ZODB 3.11?
Am 14.03.2012 18:47, schrieb Jim Fulton: I'm pretty happy with how zc.zlibstorage has worked out. Should I build this into ZODB 3.11? BTW, lz4 compression looks interesting. The Python binding (at least from PyPI) is broken. I submitted an issue. Hopefully it will be fixed. Jim +1 best regards, Jürgen -- XLhost.de ® - Webhosting von supersmall bis eXtra Large XLhost.de GmbH Jürgen Herrmann, Geschäftsführer Boelckestrasse 21, 93051 Regensburg, Germany Geschäftsführer: Jürgen Herrmann Registriert unter: HRB9918 Umsatzsteuer-Identifikationsnummer: DE245931218 Fon: +49 (0)800 XLHOSTDE [0800 95467833] Fax: +49 (0)800 95467830 Web: http://www.XLhost.de ___ For more information about ZODB, see http://zodb.org/ ZODB-Dev mailing list - ZODB-Dev@zope.org https://mail.zope.org/mailman/listinfo/zodb-dev
Re: [ZODB-Dev] Build compression into ZODB 3.11?
On Wed, Mar 14, 2012 at 18:47, Jim Fulton j...@zope.com wrote: I'm pretty happy with how zc.zlibstorage has worked out. Should I build this into ZODB 3.11? Sounds like a good idea. //Lennart ___ For more information about ZODB, see http://zodb.org/ ZODB-Dev mailing list - ZODB-Dev@zope.org https://mail.zope.org/mailman/listinfo/zodb-dev
