[Zope3-Users] Extent catalog question
In my experience (zope2), large full textindexes require more and more cpu time for every new object added to the point where it takes several minutes for each new article uploaded! To avoid this problem, I was hoping to break the index into smaller pieces by using extent catalogs to filter by year. Can extent catalogs help mitigate a scaling issue like this? I've been able to instanciate one extent catalog per year, but it doesn't automatically index content like a normal Catalog. It requires a manual reindex. And to automate indexing content, do I need to implement something like these for an extent catalog? subscriber handler=.catalog.indexDocSubscriber for=zope.app.intid.interfaces.IIntIdAddedEvent / subscriber handler=.catalog.reindexDocSubscriber for=zope.lifecycleevent.interfaces.IObjectModifiedEvent / subscriber handler=.catalog.unindexDocSubscriber for=zope.app.intid.interfaces.IIntIdRemovedEvent / Thanks in advance, Kevin Smith ___ Zope3-users mailing list Zope3-users@zope.org http://mail.zope.org/mailman/listinfo/zope3-users
Re: [Zope3-Users] Extent catalog question
On Jan 11, 2007, at 1:42 PM, [EMAIL PROTECTED] ksmith93940- [EMAIL PROTECTED] wrote: In my experience (zope2), large full textindexes require more and more cpu time for every new object added to the point where it takes several minutes for each new article uploaded! To avoid this problem, I was hoping to break the index into smaller pieces by using extent catalogs to filter by year. Can extent catalogs help mitigate a scaling issue like this? Sure. There might be considerations with sharing the lexicon or not, but I don't have any advice off the top of my head. I've been able to instanciate one extent catalog per year, but it doesn't automatically index content like a normal Catalog. It requires a manual reindex. And to automate indexing content, do I need to implement something like these for an extent catalog? Neither of these match our experience. :-( I'm not sure what the difference is between our set up and yours. Did you register the extent catalog as an ICatalog? We do... Gary ___ Zope3-users mailing list Zope3-users@zope.org http://mail.zope.org/mailman/listinfo/zope3-users
Re: [Zope3-Users] Extent catalog question
Nice call. Registering as ICatalog (instead of IExtentCatalog) works perfectly. Thanks! Kevin Smith Gary Poster [EMAIL PROTECTED] wrote: On Jan 11, 2007, at 1:42 PM, [EMAIL PROTECTED] wrote: In my experience (zope2), large full textindexes require more and more cpu time for every new object added to the point where it takes several minutes for each new article uploaded! To avoid this problem, I was hoping to break the index into smaller pieces by using extent catalogs to filter by year. Can extent catalogs help mitigate a scaling issue like this? Sure. There might be considerations with sharing the lexicon or not, but I don't have any advice off the top of my head. I've been able to instanciate one extent catalog per year, but it doesn't automatically index content like a normal Catalog. It requires a manual reindex. And to automate indexing content, do I need to implement something like these for an extent catalog? Neither of these match our experience. :-( I'm not sure what the difference is between our set up and yours. Did you register the extent catalog as an ICatalog? We do... Gary ___ Zope3-users mailing list Zope3-users@zope.org http://mail.zope.org/mailman/listinfo/zope3-users
