Re: [Zope-dev] ZCatalog and indexes cleanup

On 29.06.09 19:33, yuppie wrote: > Hi Andreas! > > > Andreas Jung wrote: > >> On 29.06.09 12:48, yuppie wrote: >> >>> 3.) remove security declarations from ZCTextIndex and DateRangeIndex >>> >>> All the other indexes don't have security declarations. AFAICS there is >>> no way to access in

Re: [Zope-dev] ZCatalog and indexes cleanup

Hi Andreas! Andreas Jung wrote: > On 29.06.09 12:48, yuppie wrote: >> 3.) remove security declarations from ZCTextIndex and DateRangeIndex >> >> All the other indexes don't have security declarations. AFAICS there is >> no way to access indexes from untrusted code without having the 'Manage >>

Re: [Zope-dev] ZCatalog and indexes cleanup

On 29.06.09 12:48, yuppie wrote: > Hi! > > > I did plan to work on a small catalog improvement, but after looking at > the code I'd like to do some cleanup first: > > > 1.) remove the deprecated TextIndex > > The deprecation warning says: > 'Using TextIndex is deprecated (will be removed in Zope '

Re: [Zope-dev] ZCatalog and indexes cleanup

On 6/29/09 12:48 PM, yuppie wrote: > Hi! > > > I did plan to work on a small catalog improvement, but after looking at > the code I'd like to do some cleanup first: > > > 1.) remove the deprecated TextIndex > > The deprecation warning says: > 'Using TextIndex is deprecated (will be removed in Zope'

[Zope-dev] ZCatalog and indexes cleanup

Hi! I did plan to work on a small catalog improvement, but after looking at the code I'd like to do some cleanup first: 1.) remove the deprecated TextIndex The deprecation warning says: 'Using TextIndex is deprecated (will be removed in Zope ' '2.12). Use ZCTextIndex instead.' 2.) remove CH

Re: [Zope-dev] ZCatalog caching with memcached

Despite protestations to the existence of a ZCatalog caching tool I've finally released it to http://pypi.python.org/pypi/collective.catalogcache :) A disclaimer is on order here: I agree that there are many other places where performance needs to be addressed and that catalogcache masks those

Re: [Zope-dev] ZCatalog caching with memcached

Hedley Roos wrote: > Since memcached is distributed only a single Zope client needs to > perform that query and the result is available to all other Zope > clients. This is where you'll get the big win: no need to load all the catalog-related objects into the zodb cache on all the clients which

Re: [Zope-dev] ZCatalog caching with memcached

-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Roché Compaan wrote: > On Sun, 2008-10-26 at 14:07 -0400, Tres Seaver wrote: >> -BEGIN PGP SIGNED MESSAGE- >> Hash: SHA1 >> >> Roché Compaan wrote: >>> On Sat, 2008-10-25 at 09:20 +0200, Hedley Roos wrote: > Have you measures the time needs

Re: [Zope-dev] ZCatalog caching with memcached

On 27.10.2008 17:18 Uhr, Rudá Porto Filgueiras wrote: On Mon, Oct 27, 2008 at 12:33 PM, Andreas Jung<[EMAIL PROTECTED]> wrote: On 27.10.2008 16:28 Uhr, Rudá Porto Filgueiras wrote: I will sugest a package called zope.memcached (like zope.sqlalchemy does for SQLAlchemy integration). That way a

Re: [Zope-dev] ZCatalog caching with memcached

On Mon, Oct 27, 2008 at 12:33 PM, Andreas Jung <[EMAIL PROTECTED]> wrote: > On 27.10.2008 16:28 Uhr, Rudá Porto Filgueiras wrote: > >> I will sugest a package called zope.memcached (like zope.sqlalchemy >> does for SQLAlchemy integration). >> That way any application who need to talk memcached can

Re: [Zope-dev] ZCatalog caching with memcached

On 27.10.2008 16:28 Uhr, Rudá Porto Filgueiras wrote: I will sugest a package called zope.memcached (like zope.sqlalchemy does for SQLAlchemy integration). That way any application who need to talk memcached can do it with out loose atomicit. I don't see a particular reason for creating a new

Re: [Zope-dev] ZCatalog caching with memcached

Roché, On Mon, Oct 27, 2008 at 9:08 AM, Roché Compaan <[EMAIL PROTECTED]> wrote: > I agree that one should look at improving performance without caching as > well. But this is a lot harder and takes significantly more development > and debugging time than introducing some form caching. So I'm not

Re: [Zope-dev] ZCatalog caching with memcached

On 27 Oct 2008, at 13:10, Roché Compaan wrote: Improving the performance of indexes is really really hard. In this case I really don't think caching is a band-aid, it is a good solution. Even with optimised indexes, you will find that you need caching to get reasonable performance i

Re: [Zope-dev] ZCatalog caching with memcached

On Mon, 2008-10-27 at 13:41 +0100, Jens Vagelpohl wrote: > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA1 > > > On Oct 27, 2008, at 13:32 , Roché Compaan wrote: > > > On Mon, 2008-10-27 at 13:23 +0100, Jens Vagelpohl wrote: > >> When it comes to integrating anything in Zope itself I'd choose th

Re: [Zope-dev] ZCatalog caching with memcached

On Mon, 2008-10-27 at 12:42 +, Russ Ferriday wrote: > Have you looked at whether you are overflowing the zeocache and having > to fetch your catalog from disk too often? The timing mentioned in > this thread seems about right for that to be the case. > > I have a client with about a 300k small

Re: [Zope-dev] ZCatalog caching with memcached

Have you looked at whether you are overflowing the zeocache and having to fetch your catalog from disk too often? The timing mentioned in this thread seems about right for that to be the case. I have a client with about a 300k small documents, for whom I have separated the catalog from the

Re: [Zope-dev] ZCatalog caching with memcached

-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On Oct 27, 2008, at 13:32 , Roché Compaan wrote: > On Mon, 2008-10-27 at 13:23 +0100, Jens Vagelpohl wrote: >> When it comes to integrating anything in Zope itself I'd choose the >> latter. > > Sure, we're not trying to get this into Zope, we're just

Re: [Zope-dev] ZCatalog caching with memcached

On Mon, 2008-10-27 at 13:23 +0100, Jens Vagelpohl wrote: > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA1 > > > On Oct 27, 2008, at 13:08 , Roché Compaan wrote: > > > On Sun, 2008-10-26 at 14:07 -0400, Tres Seaver wrote: > >> - Plone uses too many indexes, and in particular, uses multiple text

Re: [Zope-dev] ZCatalog caching with memcached

-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On Oct 27, 2008, at 13:08 , Roché Compaan wrote: > On Sun, 2008-10-26 at 14:07 -0400, Tres Seaver wrote: >> - Plone uses too many indexes, and in particular, uses multiple text >> indexes. Having extra indexes around "just in case" is a sure lose

Re: [Zope-dev] ZCatalog caching with memcached

On Sun, 2008-10-26 at 14:07 -0400, Tres Seaver wrote: > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA1 > > Roché Compaan wrote: > > On Sat, 2008-10-25 at 09:20 +0200, Hedley Roos wrote: > >>> Have you measures the time needs for some "standard" ZCatalog queries > >>> used with a Plone site with t

Re: [Zope-dev] ZCatalog caching with memcached

On 26.10.2008 19:05 Uhr, Roché Compaan wrote: On Sun, 2008-10-26 at 18:50 +0100, Andreas Jung wrote: On 26.10.2008 18:43 Uhr, Roché Compaan wrote: On Sat, 2008-10-25 at 09:20 +0200, Hedley Roos wrote: I suspect specific indexes are just performing suboptimally and needs to be improved. ExtendPa

Re: [Zope-dev] ZCatalog caching with memcached

Very Nice. Have a nice holiday :-) On Sun, Oct 26, 2008 at 3:58 PM, Roché Compaan <[EMAIL PROTECTED]>wrote: > Hi Fabio > > The funkload tests were project specific. I plan to write up my findings > and to do benchmarks on a standard Plone instance and blog about it. > This will unfortunately hav

Re: [Zope-dev] ZCatalog caching with memcached

-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Roché Compaan wrote: > On Sat, 2008-10-25 at 09:20 +0200, Hedley Roos wrote: >>> Have you measures the time needs for some "standard" ZCatalog queries >>> used with a Plone site with the communication overhead with memcached? >>> Generally spoken: I th

Re: [Zope-dev] ZCatalog caching with memcached

On Sun, 2008-10-26 at 18:50 +0100, Andreas Jung wrote: > On 26.10.2008 18:43 Uhr, Roché Compaan wrote: > > On Sat, 2008-10-25 at 09:20 +0200, Hedley Roos wrote: > > > > > I suspect specific indexes are just performing suboptimally and needs to > > be improved. ExtendPathIndex in Plone seems to be

Re: [Zope-dev] ZCatalog caching with memcached

Hi Fabio The funkload tests were project specific. I plan to write up my findings and to do benchmarks on a standard Plone instance and blog about it. This will unfortunately have to wait since I'm on holiday this week :-) -- Roché Compaan Upfront Systems http://www.upfrontsyst

Re: [Zope-dev] ZCatalog caching with memcached

Hi Roché, I can see your funkload profile? On Sun, Oct 26, 2008 at 3:43 PM, Roché Compaan <[EMAIL PROTECTED]>wrote: > On Sat, 2008-10-25 at 09:20 +0200, Hedley Roos wrote: > > > Have you measures the time needs for some "standard" ZCatalog queries > > > used with a Plone site with the communicat

Re: [Zope-dev] ZCatalog caching with memcached

On 26.10.2008 18:43 Uhr, Roché Compaan wrote: On Sat, 2008-10-25 at 09:20 +0200, Hedley Roos wrote: I suspect specific indexes are just performing suboptimally and needs to be improved. ExtendPathIndex in Plone seems to be one of them. Path indexes and fulltext indexes have a much more comp

Re: [Zope-dev] ZCatalog caching with memcached

On Sat, 2008-10-25 at 09:20 +0200, Hedley Roos wrote: > > Have you measures the time needs for some "standard" ZCatalog queries > > used with a Plone site with the communication overhead with memcached? > > Generally spoken: I think the ZCatalog is in general fast. Queries using a > > fulltext inde

Re: [Zope-dev] ZCatalog caching with memcached

Previously Andreas Jung wrote: > On 25.10.2008 14:37 Uhr, Christian Theune wrote: > >Hi, > > > >On Fri, 2008-10-24 at 15:41 +0200, Hedley Roos wrote: > >>The product is a monkey patch to Catalog.py. I'd love some feedback and > >>suggestions. > > > >I'd love if this wouldn't be a monkey patch. > >

Re: [Zope-dev] ZCatalog caching with memcached

On Sat, 2008-10-25 at 14:55 +0200, Hedley Roos wrote: > > > > In addition, you need to include a serial in your cache keys to avoid > > dirty reads. > > The cache invalidation code actively removes items from the cache. Am > I understanding you correctly? I wasn't even talking about invalidation

Re: [Zope-dev] ZCatalog caching with memcached

On Sat, 2008-10-25 at 15:14 +0200, Hedley Roos wrote: > >> Additionally when another transaction is already running in parallel, it > >> will see cache inserts from other transactions. > > > > A possible solution is to keep a module level cache which can be > committed to the memcache on transacti

Re: [Zope-dev] ZCatalog caching with memcached

>> Additionally when another transaction is already running in parallel, it >> will see cache inserts from other transactions. > A possible solution is to keep a module level cache which can be committed to the memcache on transaction boundaries. That way I'll incur no performance penalty. H

Re: [Zope-dev] ZCatalog caching with memcached

> If you catalog an object, then search for it and then abort the > transaction, your cache will have data in it that isn't committed. > Kind of like how I came to the same conclusion in parallel to you and stuffed up this thread :) > Additionally when another transaction is already running in pa

Re: [Zope-dev] ZCatalog caching with memcached

On Sat, Oct 25, 2008 at 2:57 PM, Andreas Jung <[EMAIL PROTECTED]> wrote: > On 25.10.2008 14:53 Uhr, Hedley Roos wrote: >>> >>> I'd love if this wouldn't be a monkey patch. >> >> So would I, but I couldn't find another way in this case. >> >>> Also, there is nothing that makes this integrate correct

Re: [Zope-dev] ZCatalog caching with memcached

On Sat, 2008-10-25 at 14:53 +0200, Hedley Roos wrote: > > I'd love if this wouldn't be a monkey patch. > > So would I, but I couldn't find another way in this case. > > > > > Also, there is nothing that makes this integrate correctly with > > transactions. Your cache will happily deliver never-co

Re: [Zope-dev] ZCatalog caching with memcached

On 25.10.2008 14:53 Uhr, Hedley Roos wrote: I'd love if this wouldn't be a monkey patch. So would I, but I couldn't find another way in this case. Also, there is nothing that makes this integrate correctly with transactions. Your cache will happily deliver never-committed data and also it wil

Re: [Zope-dev] ZCatalog caching with memcached

> > In addition, you need to include a serial in your cache keys to avoid > dirty reads. The cache invalidation code actively removes items from the cache. Am I understanding you correctly? H ___ Zope-Dev maillist - Zope-Dev@zope.org http://mail.zope.

Re: [Zope-dev] ZCatalog caching with memcached

> I'd love if this wouldn't be a monkey patch. So would I, but I couldn't find another way in this case. > > Also, there is nothing that makes this integrate correctly with > transactions. Your cache will happily deliver never-committed data and > also it will not isolate transactions from each o

Re: [Zope-dev] ZCatalog caching with memcached

On Sat, 2008-10-25 at 14:43 +0200, Andreas Jung wrote: > On 25.10.2008 14:37 Uhr, Christian Theune wrote: > > Hi, > > > > On Fri, 2008-10-24 at 15:41 +0200, Hedley Roos wrote: > >> The product is a monkey patch to Catalog.py. I'd love some feedback and > >> suggestions. > > > > I'd love if this wou

Re: [Zope-dev] ZCatalog caching with memcached

On 25.10.2008 14:37 Uhr, Christian Theune wrote: Hi, On Fri, 2008-10-24 at 15:41 +0200, Hedley Roos wrote: The product is a monkey patch to Catalog.py. I'd love some feedback and suggestions. I'd love if this wouldn't be a monkey patch. Also, there is nothing that makes this integrate correc

Re: [Zope-dev] ZCatalog caching with memcached

Hi, On Fri, 2008-10-24 at 15:41 +0200, Hedley Roos wrote: > The product is a monkey patch to Catalog.py. I'd love some feedback and > suggestions. I'd love if this wouldn't be a monkey patch. Also, there is nothing that makes this integrate correctly with transactions. Your cache will happily d

Re: [Zope-dev] ZCatalog caching with memcached

Hedley Roos wrote: > As for "standard" queries on a Plone site the typical folder contents > query is a good example. The query will be fast unless it sorts on > sortable_title (a ZCTextIndex) right? Not sure right now. sortable_title is a field index and shouldn't be slower than any other index

Re: [Zope-dev] ZCatalog caching with memcached

> Have you measures the time needs for some "standard" ZCatalog queries > used with a Plone site with the communication overhead with memcached? > Generally spoken: I think the ZCatalog is in general fast. Queries using a > fulltext index are known to be more expensive or if you have to deal with >

Re: [Zope-dev] ZCatalog caching with memcached

On 25.10.2008 8:48 Uhr, Hedley Roos wrote: The usual Plone catalogs (portal_catalog, uid_catalog, reference_catalog and membrane_tool) all run above 90% hit rate if the server is up to it. portal_catalog is invalidated the most so it fluctuates the most. If the server is severely underpowered th

Re: [Zope-dev] ZCatalog caching with memcached

The usual Plone catalogs (portal_catalog, uid_catalog, reference_catalog and membrane_tool) all run above 90% hit rate if the server is up to it. portal_catalog is invalidated the most so it fluctuates the most. If the server is severely underpowered then catalogcache is much less effective. porta

Re: [Zope-dev] ZCatalog caching with memcached

On 24.10.2008 15:41 Uhr, Hedley Roos wrote: Hi all The past few weeks I've been optimizing a busy Plone site and so collective.catalogcache was born. It uses memcached as a distributed ZCatalog cache. It is currently in production and seems to be holding just fine. The site went from being unus

[Zope-dev] ZCatalog caching with memcached

Hi all The past few weeks I've been optimizing a busy Plone site and so collective.catalogcache was born. It uses memcached as a distributed ZCatalog cache. It is currently in production and seems to be holding just fine. The site went from being unusable to serving quite a bit of data. I'll

Re: [Zope-dev] ZCatalog sorting issue

--On 10. Juli 2008 15:06:53 +0200 Martijn Jacobs <[EMAIL PROTECTED]> wrote: Wat denk je hiervan? Hello. In zope 2.10.5 (and probably 2.10.6 and 2.11 and, as I've read, all releases above 2.7) we've encountered a sorting bug in a dtml-in call when querying the catalog. I don't think it's d

[Zope-dev] ZCatalog sorting issue

Wat denk je hiervan? Hello. In zope 2.10.5 (and probably 2.10.6 and 2.11 and, as I've read, all releases above 2.7) we've encountered a sorting bug in a dtml-in call when querying the catalog. I don't think it's dtml only related, but I'm not sure about that. It is the same bug as found on :

Re: [Zope-dev] ZCatalog: updateMetadata and comparing string and unicode

Dieter Maurer wrote: "sys.setdefaultencoding" is only available at startup. Thus, setting "defaultencoding" must happen in a "sitecustomize" or "site" module. Or if you're sufficiently devious, it's available any time (not that actually using it is a good idea, but...): >>> im

Re: [Zope-dev] ZCatalog: updateMetadata and comparing string and unicode

Maurits van Rees wrote at 2008-3-5 23:57 +: > ... >I have an item in the portal_catalog of my Plone site that has some >string as description. The real object meanwhile has had a code >change so the description field now returns unicode. When I now >recatalog that object it throws an error: >

[Zope-dev] ZCatalog: updateMetadata and comparing string and unicode

Hi all, I have an item in the portal_catalog of my Plone site that has some string as description. The real object meanwhile has had a code change so the description field now returns unicode. When I now recatalog that object it throws an error: Module Products.ZCatalog.Catalog, line 359, in

Re: [Zope-dev] ZCatalog "Key Error" question

[EMAIL PROTECTED] wrote at 2006-9-3 18:06 -0400: > >Thank you so much for following-up with me, here. I think you're right >about this having to do with the indexes on the ZCatalog. > >The catalog has: >1. Seven "FieldIndex" indexes. >2. A "DateIndex" index >3. Three "ZCTextIndex" indexes I ha

Re: [Zope-dev] ZCatalog "Key Error" question

Thank you so much for following-up with me, here. I think you're right about this having to do with the indexes on the ZCatalog. The catalog has: 1. Seven "FieldIndex" indexes. 2. A "DateIndex" index 3. Three "ZCTextIndex" indexes I actually create these from python in a function that accept

Re: [Zope-dev] ZCatalog "Key Error" question

Dieter Maurer wrote at 2006-9-3 19:22 +0200: >[EMAIL PROTECTED] wrote at 2006-9-1 13:29 -0400: >> >>Traceback for my Key Error (Dieter, thank you for alerting me on where >>to find this): >> >>Traceback (innermost last): >> ... >> - Physical Path: /nephron_links/news_dtml >> Module DocumentTempl

Re: [Zope-dev] ZCatalog "Key Error" question

[EMAIL PROTECTED] wrote at 2006-9-1 13:29 -0400: > >Traceback for my Key Error (Dieter, thank you for alerting me on where >to find this): > >Traceback (innermost last): > ... > - Physical Path: /nephron_links/news_dtml > Module DocumentTemplate.DT_String, line 476, in __call__ > Module Documen

Re: [Zope-dev] ZCatalog "Key Error" question

Traceback for my Key Error (Dieter, thank you for alerting me on where to find this): Traceback (innermost last): Module ZPublisher.Publish, line 113, in publish Module ZPublisher.mapply, line 88, in mapply Module ZPublisher.Publish, line 40, in call_object Module Shared.DC.Scripts.Bindin

Re: [Zope-dev] ZCatalog "Key Error" question

[EMAIL PROTECTED] wrote at 2006-9-1 02:54 -0400: >I have a Zope product that relies heavily on a ZCatalog to search for >objects within a folder matching certain criteria. The ZCatalog >frequently becomes corrupt, and on searching the catalog, the catalog >gives me key errors. I'm trying to figur

Re: [Zope-dev] ZCatalog "Key Error" question

> Read or Write conflict errors? I'm getting the "Key Error" traceback on Reads, but my guess is that the actual "error" happens sometime before the "Key Error", when the ZCatalog itself is corrupted. I am not sure what that is, because it does not generate an error. However, I see the error w

Re: [Zope-dev] ZCatalog "Key Error" question

--On 1. September 2006 02:54:26 -0400 [EMAIL PROTECTED] wrote: I have a Zope product that relies heavily on a ZCatalog to search for objects within a folder matching certain criteria. The ZCatalog frequently becomes corrupt, and on searching the catalog, the catalog gives me key errors. I

[Zope-dev] ZCatalog "Key Error" question

I have a Zope product that relies heavily on a ZCatalog to search for objects within a folder matching certain criteria. The ZCatalog frequently becomes corrupt, and on searching the catalog, the catalog gives me key errors. I'm trying to figure out what causes the corruption so I can stop doing

Re: [Zope-dev] ZCatalog getObject broken

--On Donnerstag, 10. März 2005 12:49 Uhr +0100 Florent Guillaume <[EMAIL PROTECTED]> wrote: Guys, Dieter Maurer <[EMAIL PROTECTED]> wrote: Roché Compaan wrote at 2005-2-25 17:22 +0200: > Last year in March the following checkin was made that changed > ZCatalog's getObject to use restrictedTrave

Re: [Zope-dev] ZCatalog getObject broken

Guys, Dieter Maurer <[EMAIL PROTECTED]> wrote: > Roché Compaan wrote at 2005-2-25 17:22 +0200: > >Last year in March the following checkin was made that changed > >ZCatalog's getObject to use restrictedTraverse instead of > >unrestrictedTraverse. See: > > > >http://mail.zope.org/pipermail/zope-ch

Re: [Zope-dev] ZCatalog getObject broken

Roché Compaan wrote at 2005-3-3 22:36 +0200: >On Thu, 2005-03-03 at 19:36 +0100, Dieter Maurer wrote: >> Roché Compaan wrote at 2005-3-3 09:53 +0200: >> > ... >> >-return self.aq_parent.restrictedTraverse(self.getPath(), None) >> >+obj = self.aq_parent.unrestrictedTraverse(self.getP

Re: [Zope-dev] ZCatalog getObject broken

On Thu, 2005-03-03 at 19:36 +0100, Dieter Maurer wrote: > Roché Compaan wrote at 2005-3-3 09:53 +0200: > > ... > >-return self.aq_parent.restrictedTraverse(self.getPath(), None) > >+obj = self.aq_parent.unrestrictedTraverse(self.getPath(), None) > >+if obj and securityManage

Re: [Zope-dev] ZCatalog getObject broken

Roché Compaan wrote at 2005-3-3 09:53 +0200: > ... >-return self.aq_parent.restrictedTraverse(self.getPath(), None) >+obj = self.aq_parent.unrestrictedTraverse(self.getPath(), None) >+if obj and securityManager.validate(obj, obj, None, None): I think this is not correct: "v

Re: [Zope-dev] ZCatalog getObject broken

On Thu, 2005-03-03 at 14:56 +, Chris Withers wrote: > Roché Compaan wrote: > > +obj = self.aq_parent.unrestrictedTraverse(self.getPath(), None) > > +if obj and securityManager.validate(obj, obj, None, None): > > +return obj > > +else: > > +return

Re: [Zope-dev] ZCatalog getObject broken

Roché Compaan wrote: +obj = self.aq_parent.unrestrictedTraverse(self.getPath(), None) +if obj and securityManager.validate(obj, obj, None, None): +return obj +else: +return None Urm, Roche, doesn't the above seek to do exactly what... return self.aq_p

Re: [Zope-dev] ZCatalog getObject broken

On Fri, 2005-02-25 at 21:06 +0100, Andreas Jung wrote: > > --On Freitag, 25. Februar 2005 20:21 Uhr +0100 Dieter Maurer > <[EMAIL PROTECTED]> wrote: > > > Roché Compaan wrote at 2005-2-25 17:22 +0200: > >> Last year in March the following checkin was made that changed > >> ZCatalog's getObject t

Re: [Zope-dev] ZCatalog getObject broken

--On Mittwoch, 2. März 2005 9:56 Uhr + Chris Withers <[EMAIL PROTECTED]> wrote: Roché Compaan wrote: Maybe, a bug report to the collector will help? Well, I posted just such an issue a few months back. I'm working offline so can't give you the exac

Re: [Zope-dev] ZCatalog getObject broken

Roché Compaan wrote: Maybe, a bug report to the collector will help? Well, I posted just such an issue a few months back. I'm working offline so can't give you the exact number but have a search and you should find it. I seem to remember Andreas rejecti

Re: [Zope-dev] ZCatalog getObject broken

--On Freitag, 25. Februar 2005 20:21 Uhr +0100 Dieter Maurer <[EMAIL PROTECTED]> wrote: Roché Compaan wrote at 2005-2-25 17:22 +0200: Last year in March the following checkin was made that changed ZCatalog's getObject to use restrictedTraverse instead of unrestrictedTraverse. See: http://mail.zo

Re: [Zope-dev] ZCatalog getObject broken

On Fri, 2005-02-25 at 20:21 +0100, Dieter Maurer wrote: > Roché Compaan wrote at 2005-2-25 17:22 +0200: > >Last year in March the following checkin was made that changed > >ZCatalog's getObject to use restrictedTraverse instead of > >unrestrictedTraverse. See: > > > >http://mail.zope.org/pipermail/

Re: [Zope-dev] ZCatalog getObject broken

Roché Compaan wrote at 2005-2-25 17:22 +0200: >Last year in March the following checkin was made that changed >ZCatalog's getObject to use restrictedTraverse instead of >unrestrictedTraverse. See: > >http://mail.zope.org/pipermail/zope-checkins/2004-March/026846.html > >In my opininion this is wron

[Zope-dev] ZCatalog getObject broken

Last year in March the following checkin was made that changed ZCatalog's getObject to use restrictedTraverse instead of unrestrictedTraverse. See: http://mail.zope.org/pipermail/zope-checkins/2004-March/026846.html In my opininion this is wrong, and just cost me a good three hours to figure out

Re: [Zope-dev] ZCatalog and Zope 2.8

--On Montag, 31. Januar 2005 20:20 Uhr +0100 Dieter Maurer <[EMAIL PROTECTED]> wrote: I am not with you with respect to "number of indexed objects" versus "size of the index". In fact *BOTH* as index specific (otherwise, it would not make any sense to list it in an index specific column). Maybe,

Re: [Zope-dev] ZCatalog and Zope 2.8

Andreas Jung wrote at 2005-1-31 18:50 +0100: > ... [AJ] >>> - some indexes show the number of indexed objects vs the number of >>> indexes terms >>>within the ZMI which is totally inconsistent. I think the ZMI should >>> show the number >>>of indexed objects. Index specific information e.g

Re: [Zope-dev] ZCatalog and Zope 2.8

--On Sonntag, 30. Januar 2005 19:17 Uhr +0100 Dieter Maurer <[EMAIL PROTECTED]> wrote: - some indexes show the number of indexed objects vs the number of indexes terms within the ZMI which is totally inconsistent. I think the ZMI should show the number of indexed objects. Index specific i

Re: [Zope-dev] ZCatalog and Zope 2.8

Andreas Jung wrote at 2005-1-30 15:30 +0100: > ... >Outstanding issues: > > - some indexes show the number of indexed objects vs the number of indexes >terms >within the ZMI which is totally inconsistent. I think the ZMI should >show the number >of indexed objects. Index specific informat

[Zope-dev] ZCatalog and Zope 2.8

I changed the ZCatalog and indexes codebase for Zope 2.8 in the following way: - ZCatalog and indexes derived from UnIndex used a nasty implementation of __len__ which lead to problems in Zope 2.8 with new-style classes. The corresponding code has been cleaned up. For ZCatalog instances t

Re: [Zope-dev] ZCatalog fast as admin, dog slow as anonymous and other users

Seb, I've replaced the following date indexes that werer FieldIndexes with DateIndexes Date effective expires modified i'll let you know what kind of speed improvement I get. Jason Spisak wrote: Zopistas, My ZCatalog is fast as admin, but dog slow as anonymous and other users. Anyone had th

Re: [Zope-dev] ZCatalog fast as admin, dog slow as anonymous and other users

Seb, thanks! i'll give that a shot. i also thought of adding daterange indexes for the calendar portion or things. does that also garner any speed improvement? Seb Bacon wrote: Jason Spisak wrote: Zopistas, My ZCatalog is fast as admin, but dog slow as anonymous and other users. Anyone

Re: [Zope-dev] ZCatalog fast as admin, dog slow as anonymous and other users

Jason Spisak wrote: Zopistas, My ZCatalog is fast as admin, but dog slow as anonymous and other users. Anyone had this same experience? Details: This is certainly to do with queries which run against FieldIndexes only for anonymous users. This is something the CMF does (e.g. expires and effe

[Zope-dev] ZCatalog fast as admin, dog slow as anonymous and other users

Zopistas, My ZCatalog is fast as admin, but dog slow as anonymous and other users. Anyone had this same experience? Details: marjors: Zope 2.6.2 CMF 1.3 Plone 1.0.5 about 50,000 cataloged objects (dual xenon server, plenty of ram, RAID) User folder has 15k users in it, but admin is one of t

Re: [Zope-dev] ZCatalog Indexes tab crawls...

Dieter Maurer wrote: But overall, unless you have special (non DC derived) indexes, That can well be the case... Anyway, what are we going to do about this crawling tab? Chris ___ Zope-Dev maillist - [EMAIL PROTECTED] http://mail.zope.org/mailman/l

Re: [Zope-dev] ZCatalog Indexes tab crawls...

Chris Withers wrote at 2003-7-21 08:22 +0100: > Dieter Maurer wrote: > > "#objects" suggests that it is the number of objects indexed by > > this index. Who is interested in this information? > > Well, it's been useful to be on several occasions when I've seen one index has > less objects i

Re: [Zope-dev] ZCatalog Indexes tab crawls...

Dieter Maurer wrote: "#objects" suggests that it is the number of objects indexed by this index. Who is interested in this information? Well, it's been useful to be on several occasions when I've seen one index has less objects in than another... Unless one has inhomogeous objects, almost all obj

Re: [Zope-dev] ZCatalog Indexes tab crawls...

Anthony Baxter wrote at 2003-7-18 15:14 +1000: > > >>> Andreas Jung wrote > > I agree but the current implementation sux. Switching to a counter based > > solution would solve the problem. The only problem I see is to keep the > > code fully backward compatible. > > if there's no counter p

Re: [Zope-dev] ZCatalog Indexes tab crawls...

On Friday 18 July 2003 01:29 pm, Dieter Maurer wrote: > Anthony Baxter wrote at 2003-7-18 15:14 +1000: > > > > >>> Andreas Jung wrote > > > I agree but the current implementation sux. Switching to a counter based > > > solution would solve the problem. The only problem I see is to keep the >

Re: [Zope-dev] ZCatalog Indexes tab crawls...

--On Freitag, 18. Juli 2003 13:53 Uhr +0100 Chris Withers <[EMAIL PROTECTED]> wrote: Anthony Baxter wrote: if there's no counter present: create one, do a count of the docs, initialise the counter display counter Sounds good, what needs to happen to make this happen? Since this is a bug fix

Re: [Zope-dev] ZCatalog Indexes tab crawls...

--On Freitag, 18. Juli 2003 13:52 Uhr +0100 Chris Withers <[EMAIL PROTECTED]> wrote: Dieter Maurer wrote: I suggest to change the title to "# index terms" and revert for the indexes to the old behaviour. If that'll make it quicker, cool :-) I am usually not interested in the number of index ter

Re: [Zope-dev] ZCatalog Indexes tab crawls...

Anthony Baxter wrote: if there's no counter present: create one, do a count of the docs, initialise the counter display counter Sounds good, what needs to happen to make this happen? Since this is a bug fix, can it go on the 2.6 branch? cheers, Chris _

Re: [Zope-dev] ZCatalog Indexes tab crawls...

Dieter Maurer wrote: I suggest to change the title to "# index terms" and revert for the indexes to the old behaviour. If that'll make it quicker, cool :-) Others pointed out, that also the size determination for an index may be expensive. However, it is at most linear in the number (rather than q

Re: [Zope-dev] ZCatalog Indexes tab crawls...

Casey Duncan wrote: Actually I regard the current behavior as a feature. Using a stopwatch and a slide-rule I can estimate to within 100 objects, how many values are indexed in a catalog by measuring the time it takes to draw the indexes page. Please do not remove this most valued feature! I see

Re: [Zope-dev] ZCatalog Indexes tab crawls...

>>> Andreas Jung wrote > I agree but the current implementation sux. Switching to a counter based > solution would solve the problem. The only problem I see is to keep the > code fully backward compatible. if there's no counter present: create one, do a count of the docs, initialise the counte

Re: [Zope-dev] ZCatalog Indexes tab crawls...

--On Donnerstag, 17. Juli 2003 18:22 Uhr -0400 Casey Duncan <[EMAIL PROTECTED]> wrote: Actually I regard the current behavior as a feature. Using a stopwatch and a slide-rule I can estimate to within 100 objects, how many values are indexed in a catalog by measuring the time it takes to draw

Re: [Zope-dev] ZCatalog Indexes tab crawls...

Actually I regard the current behavior as a feature. Using a stopwatch and a slide-rule I can estimate to within 100 objects, how many values are indexed in a catalog by measuring the time it takes to draw the indexes page. Please do not remove this most valued feature! -Casey On Thursday 17 J

Re: [Zope-dev] ZCatalog Indexes tab crawls...

Chris Withers wrote at 2003-7-17 11:12 +0100: > Has anyone noticed that the ZCatalog Indexes tab crawls if you have loads of > objects indexed. > > My guess is that some types of index take way too long to figure out how many > objects are indexed. Anyone know which index types those could

Re: [Zope-dev] ZCatalog indexes tab - which Index Types are guilty?

--On Donnerstag, 17. Juli 2003 12:29 Uhr +0100 Chris Withers <[EMAIL PROTECTED]> wrote: The problem is caused by calling len() on the indexes btrees. Instead a counter implemented btree.Length should be used in the future. Which Index types are currently guilty of this? I think all except ZCTex

[Zope-dev] ZCatalog indexes tab - which Index Types are guilty?

The problem is caused by calling len() on the indexes btrees. Instead a counter implemented btree.Length should be used in the future. Which Index types are currently guilty of this? How about re-naming the column to "Number of Documents Indexed" and making sure this is actually what the indexes

  1   2   3   4   5   >