[ZODB-Dev] Zope memory usage

2008-09-17 Thread Izak Burger
Hi all, I'm sure this question has been asked before, but it drives me nuts so I figured I'll ask again. This is a problem that has been bugging me for ages. Why does zope memory use never decrease? Okay, I've seen it decrease maybe by a couple megabyte, but never by much. It seems the general

[ZODB-Dev] FileStorage: getting rid of tid cache

2008-09-17 Thread Jim Fulton
Several years ago, we added a "tid" cache, that cached current ttransaction ids (tids) for objects. The intent was to speed both stores and full cache verification. We've since realized that full verification is a bad idea for databases large enough that caching is needed. It's not clea

Re: [ZODB-Dev] Zope memory usage

2008-09-17 Thread Alan Runyan
There was a recent modification to limit the ZODB cache to a set size. i.e. Limit the size of memory usage to 128MB. The original feature was implemented here: http://svn.zope.org/ZODB/branches/dm-memory_size_limited-cache/ You can get the feature+3.8 branch of the ZODB from: http://svn.zope

Re: [ZODB-Dev] RFC: Reimplementing Pickle Cache in Python

2008-09-17 Thread Dieter Maurer
Tres Seaver wrote at 2008-9-12 06:35 -0400: > ... >Reimplementing Pickle Cache in Python >= > ... >from zope.interface import Attribute >from zope.interface import Interface >class IPickleCache(Interface): >""" API of the cache for a ZODB conn

Re: [ZODB-Dev] Zope memory usage

2008-09-17 Thread Roché Compaan
Hi Alan Thanks for the notice. We'll give this a go and report back. Do you know how exactly it is decided what stays in the cache?  -- Roché Compaan Upfront Systems http://www.upfrontsystems.co.za On Wed, 2008-09-17 at 10:26 -0500, Alan Runyan wrote: > There was a recent mo

Re: [ZODB-Dev] Experiences with Relstorage performance for setups with heavy writes

2008-09-17 Thread Dieter Maurer
Andreas Jung wrote at 2008-9-12 10:31 +0200: >anyone having experiences with the performance of Relstorage on Zope >installations which heavy parallel writes (which is often a bottleneck). >Does Relstorage provide any significant advantages over ZEO. As "Relstorage" emulates "FileStorage" behavi

Re: [ZODB-Dev] Zope memory usage

2008-09-17 Thread Dieter Maurer
Izak Burger wrote at 2008-9-17 12:10 +0200: >I'm sure this question has been asked before, but it drives me nuts so I >figured I'll ask again. This is a problem that has been bugging me for >ages. Why does zope memory use never decrease? Okay, I've seen it >decrease maybe by a couple megabyte, b

Re: [ZODB-Dev] RFC: Reimplementing Pickle Cache in Python

2008-09-17 Thread Tres Seaver
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Dieter Maurer wrote: > Tres Seaver wrote at 2008-9-12 06:35 -0400: >> ... >> Reimplementing Pickle Cache in Python >> = >> ... >>from zope.interface import Attribute >>from zope.interface import Interface >>

Re: [ZODB-Dev] Experiences with Relstorage performance for setups with heavy writes

2008-09-17 Thread Shane Hathaway
Dieter Maurer wrote: > Andreas Jung wrote at 2008-9-12 10:31 +0200: >> anyone having experiences with the performance of Relstorage on Zope >> installations which heavy parallel writes (which is often a bottleneck). >> Does Relstorage provide any significant advantages over ZEO. > > As "Relstora

Re: [ZODB-Dev] Zope memory usage

2008-09-17 Thread Manuel Vazquez Acosta
Alan, I'm replying to the Zope list also, because this issue is perhaps related to other components there. I'm running into the same situation: The python process running my Plone site is steadyly growing. I'm using Zope2.9.8-final (the one which works with Plone 2.5.5). What is the plan for Zo