Re: [Zope-dev] Re: Zcatalog bloat problem (berkeleydb is a solution?)

2001-06-29 Thread Giovanni Maruzzelli
t; <[EMAIL PROTECTED]> To: "Giovanni Maruzzelli" <[EMAIL PROTECTED]> Cc: <[EMAIL PROTECTED]>; "Chris McDonough" <[EMAIL PROTECTED]>; <[EMAIL PROTECTED]>; <[EMAIL PROTECTED]>; <[EMAIL PROTECTED]>; <[EMAIL PROTECTED]>; <[EMAIL PROTECTED]&

Re: [Zope-dev] Re: Zcatalog bloat problem (berkeleydb is a solution?)

2001-06-26 Thread Giovanni Maruzzelli
We think that Abel is absolutely right: if in the same almost empty folder we add and catalog an object with one word (and now we have optimized and reduced the number of indexes to 11) it make a transaction of 73K, while if the object contains 300 words with the same other indexes or properties,

Re: [Zope-dev] Re: Zcatalog bloat problem (berkeleydb is a solution?)

2001-06-26 Thread Giovanni Maruzzelli
ducts/ZCatalog/Catalog.py, line 204, in _convertBTrees File /fs1root/zope/Zope-2.3.3b1-src/lib/python/SearchIndex/UnTextIndex.py, line 211, in _convertBTrees TypeError: (see above) - Original Message - From: "Chris Withers" <[EMAIL PROTECTED]> To: <[EMAIL PROTECTED]&g

Re: [Zope-dev] Re: Zcatalog bloat problem (berkeleydb is a solution?)

2001-06-26 Thread Giovanni Maruzzelli
t;Toby Dickenson" <[EMAIL PROTECTED]> To: "Giovanni Maruzzelli" <[EMAIL PROTECTED]> Cc: "Chris McDonough" <[EMAIL PROTECTED]>; <[EMAIL PROTECTED]>; <[EMAIL PROTECTED]>; <[EMAIL PROTECTED]>; <[EMAIL PROTECTED]>; <[EMAIL PROTECTED]&

Re: [Zope-dev] Re: Zcatalog bloat problem (berkeleydb is a solution?)

2001-06-26 Thread Giovanni Maruzzelli
I use 2.3.3 with python 1.5.2 on freebsd 3 I'm not so picky about bloating, but adding a document of 1K adds some 400K, and keeps growing. How much eat for you (I know you cataloged some 50K documents)? -giovanni - Original Message - Sent: Tuesday, June 26, 2001 1:48 PM Subject: Re: [Zo

[Zope-dev] Re: Zcatalog bloat problem (berkeleydb is a solution?)

2001-06-26 Thread Giovanni Maruzzelli
orate this problem a bit by > keeping the data that is normally stored in the _objects tuple in its > own persistent object (a btree). > > Are you breaking the content up into subfolders? This is recommended. > > I'm temped to postulate that perhaps your problem isn't a

[Zope-dev] Re: Zcatalog bloat problem (berkeleydb is a solution?)

2001-06-26 Thread Giovanni Maruzzelli
Hello Zopistas, thank'you all for your replies. Our doubts still unresolved :-( With a clever hack that Toby Dickenson made on the very useful tranalyzer, we was able to see what happen when we add or catalog an object. (BTW, we don't use CatalogAware). We can send the output of tranalyzer2 to

[Zope-dev] Zcatalog bloat problem (berkeleydb is a solution?)

2001-06-25 Thread Giovanni Maruzzelli
Hello Zopistas, we are developing a Zope 2.3.3 (py 1.5.2) application that will add, index and reindex some tens of thousands objects (Zclass that are DTMLDocument on steroids) on some twenty properties each day, while the absolute number of objects cataloged keeps growing (think at content manag