Re: [Zope3-Users] Extent catalog question

2007-01-11 Thread Gary Poster


On Jan 11, 2007, at 1:42 PM, [EMAIL PROTECTED] ksmith93940- 
[EMAIL PROTECTED] wrote:


In my experience (zope2), large full textindexes require more and  
more cpu time for every new object added to the point where it  
takes several minutes for each new article uploaded!


To avoid this problem,  I was hoping to break the index into  
smaller pieces by using extent catalogs to filter by year. Can  
extent catalogs help mitigate a scaling issue like this?


Sure.

There might be considerations with sharing the lexicon or not, but I  
don't have any advice off the top of my head.


I've been able to instanciate one extent catalog per year, but it  
doesn't automatically index content like a normal Catalog. It  
requires a manual reindex.
And to automate indexing content, do I need to implement something  
like these for an extent catalog?


Neither of these match our experience. :-(

I'm not sure what the difference is between our set up and yours. 
Did you register the extent catalog as an ICatalog?  We do...


Gary

___
Zope3-users mailing list
Zope3-users@zope.org
http://mail.zope.org/mailman/listinfo/zope3-users


Re: [Zope3-Users] Extent catalog question

2007-01-11 Thread ksmith93940-dev
Nice call. Registering as ICatalog (instead of IExtentCatalog) works perfectly.

Thanks!

Kevin Smith

Gary Poster [EMAIL PROTECTED] wrote: 
On Jan 11, 2007, at 1:42 PM,  
[EMAIL PROTECTED] wrote:

 In my experience (zope2), large full textindexes require more and  
 more cpu time for every new object added to the point where it  
 takes several minutes for each new article uploaded!

 To avoid this problem,  I was hoping to break the index into  
 smaller pieces by using extent catalogs to filter by year. Can  
 extent catalogs help mitigate a scaling issue like this?

Sure.

There might be considerations with sharing the lexicon or not, but I  
don't have any advice off the top of my head.

 I've been able to instanciate one extent catalog per year, but it  
 doesn't automatically index content like a normal Catalog. It  
 requires a manual reindex.
 And to automate indexing content, do I need to implement something  
 like these for an extent catalog?

Neither of these match our experience. :-(

I'm not sure what the difference is between our set up and yours. 
Did you register the extent catalog as an ICatalog?  We do...

Gary


___
Zope3-users mailing list
Zope3-users@zope.org
http://mail.zope.org/mailman/listinfo/zope3-users