Re: [Zope-dev] catalog performance: query plan

2008-11-10 Thread Roché Compaan
benchmarks with query plan and it didn't make any noticeable difference. What might be true or is becoming more likely is that indexes are used where they don't fit the use case rather than that the indexes themselves need optimisation. -- Roché Compaan Upfront Systems http

Re: [Zope-dev] catalog performance: query plan

2008-11-10 Thread Roché Compaan
site with 300,000 remember based users and roughly 150,000 documents and images indexed. -- Roché Compaan Upfront Systems http://www.upfrontsystems.co.za ___ Zope-Dev maillist - Zope-Dev@zope.org http://mail.zope.org/mailman/listinfo

Re: [Zope-dev] catalog performance: query plan

2008-11-09 Thread Roché Compaan
|0.105|95165.88 getFullname |ZCTextIndex |0.104|95313.06 getRoles |FieldIndex |0.104|95385.31 getUserName |ZCTextIndex |0.103|96692.46 -- Roché Compaan Upfront Systems http

Re: [Zope-dev] ZCatalog caching with memcached

2008-10-27 Thread Roché Compaan
On Sun, 2008-10-26 at 14:07 -0400, Tres Seaver wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Roché Compaan wrote: On Sat, 2008-10-25 at 09:20 +0200, Hedley Roos wrote: Have you measures the time needs for some standard ZCatalog queries used with a Plone site

Re: [Zope-dev] ZCatalog caching with memcached

2008-10-27 Thread Roché Compaan
On Mon, 2008-10-27 at 13:23 +0100, Jens Vagelpohl wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On Oct 27, 2008, at 13:08 , Roché Compaan wrote: On Sun, 2008-10-26 at 14:07 -0400, Tres Seaver wrote: - Plone uses too many indexes, and in particular, uses multiple text

Re: [Zope-dev] ZCatalog caching with memcached

2008-10-27 Thread Roché Compaan
On Mon, 2008-10-27 at 13:41 +0100, Jens Vagelpohl wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On Oct 27, 2008, at 13:32 , Roché Compaan wrote: On Mon, 2008-10-27 at 13:23 +0100, Jens Vagelpohl wrote: When it comes to integrating anything in Zope itself I'd choose the latter

Re: [Zope-dev] ZCatalog caching with memcached

2008-10-26 Thread Roché Compaan
Hi Fabio The funkload tests were project specific. I plan to write up my findings and to do benchmarks on a standard Plone instance and blog about it. This will unfortunately have to wait since I'm on holiday this week :-) -- Roché Compaan Upfront Systems http

Re: [Zope-dev] ZCatalog caching with memcached

2008-10-26 Thread Roché Compaan
On Sun, 2008-10-26 at 18:50 +0100, Andreas Jung wrote: On 26.10.2008 18:43 Uhr, Roché Compaan wrote: On Sat, 2008-10-25 at 09:20 +0200, Hedley Roos wrote: I suspect specific indexes are just performing suboptimally and needs to be improved. ExtendPathIndex in Plone seems to be one

[Zope-dev] Zope 3 catalog

2007-11-02 Thread Roché Compaan
Where can one find Zope 3 catalog? Or is it simply zope.index? -- Roché Compaan Upfront Systems http://www.upfrontsystems.co.za ___ Zope-Dev maillist - Zope-Dev@zope.org http://mail.zope.org/mailman/listinfo/zope-dev ** No cross

Re: [Zope-dev] Re: Zope 3 catalog

2007-11-02 Thread Roché Compaan
On Fri, 2007-11-02 at 11:44 -0700, Ross Patterson wrote: Roché Compaan [EMAIL PROTECTED] writes: Where can one find Zope 3 catalog? Or is it simply zope.index? I think zope.app.catalog is what you're looking for. Thanks. I was looking at the Zope 3 version distributed with Zope 2.10 which

Re: [Zope-dev] Re: More resilient indexes

2007-09-19 Thread Roché Compaan
On Tue, 2007-09-18 at 20:01 +0200, Dieter Maurer wrote: Roché Compaan wrote at 2007-9-18 08:55 +0200: ... Sorry if I was unclear but what I'm really asking is if it is possible to improve the conflict handling of the current indexes that we have in Zope. I am also asking if concurrent

Re: [Zope-dev] Re: More resilient indexes

2007-09-18 Thread Roché Compaan
On Mon, 2007-09-17 at 19:57 -0400, Tres Seaver wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Roché Compaan wrote: Hi there Are the current indexing solutions that we have in Zope 2 and 3 the best that we can have? Is there any way to improve the amount of concurrent indexing

[Zope-dev] More resilient indexes

2007-09-17 Thread Roché Compaan
like to make the ZODB work for me here. Are there solutions here? Can one employ some of the QueueCatalog conflict resolution strategies to make indexes more resilient? Or should one use some locking strategy instead? -- Roché Compaan Upfront Systems http

[Zope-dev] Bug in Traversable.py

2007-03-23 Thread Roché Compaan
) != next): raise Unauthorized(name) If you agree that his is a bug, I'll log it. -- Roché Compaan Upfront Systems http://www.upfrontsystems.co.za ___ Zope-Dev maillist - Zope-Dev@zope.org

Re: [Zope-dev] Re: Caching ZCatalog results

2007-02-25 Thread Roché Compaan
On Sat, 2007-02-24 at 09:48 +0100, Dieter Maurer wrote: Roché Compaan wrote at 2007-2-23 22:00 +0200: ... Thanks for that pointer. It's good that way, it should make invalidation easier. It could be as simple as invalidating any cached result that contains the documentId being indexed. Do

Re: [Zope-dev] Re: Caching ZCatalog results

2007-02-25 Thread Roché Compaan
heavily on the catalog, optimisation of catalog operations can surely help improving scalability. -- Roché Compaan Upfront Systems http://www.upfrontsystems.co.za ___ Zope-Dev maillist - Zope-Dev@zope.org http://mail.zope.org

[Zope-dev] Caching ZCatalog results

2007-02-23 Thread Roché Compaan
with a Plone site that is a heavy user of the catalog) -- Roché Compaan Upfront Systems http://www.upfrontsystems.co.za ___ Zope-Dev maillist - Zope-Dev@zope.org http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding

Re: [Zope-dev] Re: Caching ZCatalog results

2007-02-23 Thread Roché Compaan
On Fri, 2007-02-23 at 06:55 -0500, Tres Seaver wrote: Roché Compaan wrote: I'm curious, has anybody played around with the idea of caching ZCatalog results and if I submitted a patch to do this would it be excepted? I quickly coded some basic caching of results on a volatile attribute

Re: [Zope-dev] Re: Caching ZCatalog results

2007-02-23 Thread Roché Compaan
On Fri, 2007-02-23 at 12:09 -0500, Tres Seaver wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Tres Seaver wrote: Roché Compaan wrote: On Fri, 2007-02-23 at 06:55 -0500, Tres Seaver wrote: Roché Compaan wrote: I'm curious, has anybody played around with the idea of caching

Re: [Zope-dev] Re: Caching ZCatalog results

2007-02-23 Thread Roché Compaan
On Fri, 2007-02-23 at 20:43 +0100, Dieter Maurer wrote: Roché Compaan wrote at 2007-2-23 18:44 +0200: ... Cool idea. I haven't done any coding involving OFS.Cache though. Looking at it briefly it looks like one can modify the catalog to subclass OFS.Cacheable and then use the ZCacheable_get

Re: [Zope-dev] brain.getObject and traversal

2005-03-31 Thread Roché Compaan
that this is communicated properly at release time. -- Roché Compaan Upfront Systems http://www.upfrontsystems.co.za ___ Zope-Dev maillist - Zope-Dev@zope.org http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding

Re: [Zope-dev] Re: ZCatalog getObject broken

2005-03-11 Thread Roché Compaan
basically boils down to figure out if the user is allowed to access C or not. -- Roché Compaan Upfront Systems http://www.upfrontsystems.co.za ___ Zope-Dev maillist - Zope-Dev@zope.org http://mail.zope.org/mailman/listinfo/zope-dev

Re: [Zope-dev] Re: ZCatalog getObject broken

2005-03-11 Thread Roché Compaan
On Fri, 2005-03-11 at 19:10 +0100, Max M wrote: Roché Compaan wrote: The rest of the discussion basically boils down to figure out if the user is allowed to access C or not. Hasn't it been raised allready that there is no way of knowing that? A single method might be public

Re: [Zope-dev] Re: ZCatalog getObject broken

2005-03-10 Thread Roché Compaan
should guard access to its attributes. -- Roché Compaan Upfront Systems http://www.upfrontsystems.co.za ___ Zope-Dev maillist - Zope-Dev@zope.org http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding

Re: [Zope-dev] Re: ZCatalog getObject broken

2005-03-03 Thread Roché Compaan
On Thu, 2005-03-03 at 09:27 +0100, Max M wrote: Roché Compaan wrote: I'm unsure about the security check in the patch below - I copied the way restrictedTraverse does it. I read through validate in the default security policy but it is one of those methods where all the security

Re: [Zope-dev] ZCatalog getObject broken

2005-03-03 Thread Roché Compaan
On Thu, 2005-03-03 at 14:56 +, Chris Withers wrote: Roché Compaan wrote: +obj = self.aq_parent.unrestrictedTraverse(self.getPath(), None) +if obj and securityManager.validate(obj, obj, None, None): +return obj +else: +return None

Re: [Zope-dev] ZCatalog getObject broken

2005-03-03 Thread Roché Compaan
On Thu, 2005-03-03 at 19:36 +0100, Dieter Maurer wrote: Roché Compaan wrote at 2005-3-3 09:53 +0200: ... -return self.aq_parent.restrictedTraverse(self.getPath(), None) +obj = self.aq_parent.unrestrictedTraverse(self.getPath(), None) +if obj

Re: [Zope-dev] ZCatalog getObject broken

2005-03-02 Thread Roché Compaan
On Fri, 2005-02-25 at 21:06 +0100, Andreas Jung wrote: --On Freitag, 25. Februar 2005 20:21 Uhr +0100 Dieter Maurer [EMAIL PROTECTED] wrote: Roché Compaan wrote at 2005-2-25 17:22 +0200: Last year in March the following checkin was made that changed ZCatalog's getObject to use

[Zope-dev] ZCatalog getObject broken

2005-02-25 Thread Roché Compaan
work because restrictedTraverse already fails when traversing the 'documents' folder. I would propose that getObject does an unrestrictedTraverse of the path and then checks if the user has permission to access that the object. -- Roché Compaan Upfront Systems http

Re: [Zope-dev] Referencial Integrity in ZCatalogs

2004-08-02 Thread Roché Compaan
Have a look at Archetypes, it does what you want. http://sourceforge.net/projects/archetypes -- Roché Compaan Upfront Systems http://www.upfrontsystems.co.za Santi Camps wrote: Hi all, I've been developing database oriented applications for about 10 years, using zope

Re: [Zope-dev] Referencial Integrity in ZCatalogs

2004-08-02 Thread Roché Compaan
Santi Camps wrote: En/na Roché Compaan ha escrit: Have a look at Archetypes, it does what you want. http://sourceforge.net/projects/archetypes I think you are talking about SQLStorage of Archetypes. I was actually thinking of the implementation of References, which uses the ZCatalog in manner

Re: [Zope-dev] Making a ZSQL.DA fully multi-threaded?

2004-07-10 Thread Roché Compaan
about writing DA's but '_v_' attributes are *volatile* attributes and they are not persisted, see http://zope.org/Wikis/ZODB/VolatileAttributes. -- Roché Compaan Upfront Systems http://www.upfrontsystems.co.za ___ Zope-Dev maillist

Re: Sotring __of__(self) wrapped Objects OK? (was Re: [Zope-dev] Storing references ... accross requests)

2004-06-23 Thread Roché Compaan
PersonObject.aq_base rather than just PersonObject? No, because the ZODB already strips acquisition wrappers - like Dieter pointed out above. You only have to make sure that you wrap objects in the original acquisition context when you retrieve them. -- Roché Compaan Upfront Systems

Re: [Zope-dev] KeywordIndex errors: This should not happen.

2002-10-01 Thread Roché Compaan
On Mon, 30 Sep 2002 09:50:56 -0400 Casey Duncan [EMAIL PROTECTED] wrote: On Monday 30 September 2002 08:36 am, Roché Compaan wrote: Don't know if this will help but these errors specifically occur with 'lines' properties with Keyword Indexes on them. What is also significant

Re: [Zope-dev] KeywordIndex errors: This should not happen.

2002-09-30 Thread Roché Compaan
have thought that only unique values should be stored in the index data. -- Roché Compaan Upfront Systems http://www.upfrontsystems.co.za On Mon, 30 Sep 2002 14:17:17 +0200 Jean Jordaan [EMAIL PROTECTED] wrote: Hi all Our app has been hitting these errors for months: 2002

[Zope-dev] Interesting namespace observation

2002-05-27 Thread Roché Compaan
something with the namespace that makes it impossible for the subsequent dtml-in tag to find the getProxies method in the root. Any ideas why? -- Roché Compaan Upfront Systems http://www.upfrontsystems.co.za ___ Zope-Dev maillist

Re: [Zope] Re: [Zope-dev] Interesting namespace observation

2002-05-27 Thread Roché Compaan
On Mon, 2002-05-27 at 18:31, Leonardo Rochael Almeida wrote: On Mon, 2002-05-27 at 11:45, Roché Compaan wrote: [...] dtml-in getProxies('Platform') sort=Name prefix=platform This is not a valid syntax, you should have:: dtml-in getProxies('Platform') sort=Name prefix=platform

RE: [Zope-dev] Zope process killed

2002-05-18 Thread Roché Compaan
simply upgrade and my problem will go away :) And it did! Just thought I'd mention this since I didn't find anything in the collector about it. -- Roché Compaan Upfront Systems http://www.upfrontsystems.co.za ___ Zope-Dev maillist

[Zope-dev] Zope process killed

2002-05-17 Thread Roché Compaan
) = f-f_stacksize' failed. Any help will be much appreciated. -- Roché Compaan Upfront Systems http://www.upfrontsystems.co.za ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts

[Zope-dev] ZPatterns and Transactions

2001-05-31 Thread Roché Compaan
I have a ZPatterns application that uses the ZODB as storage. When I delete an object only the name of the script that deleted the object is shown in the Undo log. Is there any way to determine the ID of the object that was deleted? Is there a way that one can get a handle on the object that