[Zope-dev] RE: [Zope] New location for Zope Collectors

2003-10-23 Thread Chris McDonough
OK, I thought it was fixed (and is fixed for the collector) but I guess
a workaround was just put in for collectors because other batches are
still limited to 200... should be safe to remove it and close some
zope.org bugs.

On Thu, 2003-10-23 at 22:09, Brian Lloyd wrote:
> Er - this one's my fault :) When I first started triage on nzo 
> there were a number of places where it was doing totally unbounded 
> searches and them sorting them for good measure. I put that in as 
> a stopgap so it would quit dying while I was trying to find the 
> culprits and forgot to remove it.
> 
> 
> Brian Lloyd[EMAIL PROTECTED]
> V.P. Engineering   540.361.1716  
> Zope Corporation   http://www.zope.com
> 
> 
> > -Original Message-
> > From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] Behalf Of
> > Chris McDonough
> > Sent: Thursday, October 23, 2003 3:51 PM
> > To: Jens Vagelpohl
> > Cc: [EMAIL PROTECTED]; [EMAIL PROTECTED]
> > Subject: Re: [Zope] New location for Zope Collectors
> > 
> > 
> > I see it's already fixed, thanks...
> > 
> > On Thu, 2003-10-23 at 16:39, Chris McDonough wrote:
> > > Aha!  This is likely due to the monkey-patched searchResults method of
> > > the catalog tool.  It is patched from within the ZopeOrg product's
> > > __init__.py:
> > > 
> > > if not kw.has_key('sort_limit'):
> > > kw['sort_limit'] = 200
> > > 
> > > I'm sure this was put into there to foil some sort of DOS, but I think
> > > it should be taken out on the appserver and we should see what happens
> > > from there... do you think you can do this Jens?
> > > 
> > > On Thu, 2003-10-23 at 16:05, Chris McDonough wrote:
> > > > On the new collector instances the high size of a collection 
> > of objects
> > > > seems to be limited to 200.  Aha!  Here we have evidence that someone
> > > > has hardcoded the number "200" as the upper limit for the number of
> > > > catalog results returned from the portal catalog on zope.org.  This
> > > > happens with howtos and products too.  I suspect that if we grep the
> > > > source for 200 we'll likely be able to fix it.  I'll do that now...
> > > > 
> > > > On Thu, 2003-10-23 at 14:37, Jens Vagelpohl wrote:
> > > > > Hi everyone,
> > > > > 
> > > > > The issue collectors formerly hosted on collector.zope.org 
> > have been 
> > > > > migrated to the main zope.org website and are now available at the 
> > > > > following address::
> > > > > 
> > > > > http://www.zope.org/Collectors/
> > > > > 
> > > > > I have tried to find all links to these collectors, but 
> > there might be 
> > > > > old links in various places that still point to 
> > collector.zope.org. The 
> > > > > hostname collector.zope.org will, once the DNS change has 
> > propagated, 
> > > > > point to www.zope.org.
> > > > > 
> > > > > jens
> > > > > 
> > > > > 
> > > > > ___
> > > > > Zope maillist  -  [EMAIL PROTECTED]
> > > > > http://mail.zope.org/mailman/listinfo/zope
> > > > > **   No cross posts or HTML encoding!  **
> > > > > (Related lists - 
> > > > >  http://mail.zope.org/mailman/listinfo/zope-announce
> > > > >  http://mail.zope.org/mailman/listinfo/zope-dev )
> > > > 
> > > > 
> > > > ___
> > > > Zope maillist  -  [EMAIL PROTECTED]
> > > > http://mail.zope.org/mailman/listinfo/zope
> > > > **   No cross posts or HTML encoding!  **
> > > > (Related lists - 
> > > >  http://mail.zope.org/mailman/listinfo/zope-announce
> > > >  http://mail.zope.org/mailman/listinfo/zope-dev )
> > > 
> > > 
> > > ___
> > > Zope maillist  -  [EMAIL PROTECTED]
> > > http://mail.zope.org/mailman/listinfo/zope
> > > **   No cross posts or HTML encoding!  **
> > > (Related lists - 
> > >  http://mail.zope.org/mailman/listinfo/zope-announce
> > >  http://mail.zope.org/mailman/listinfo/zope-dev )
> > 
> > 
> > ___
> > Zope maillist  -  [EMAIL PROTECTED]
> > http://mail.zope.org/mailman/listinfo/zope
> > **   No cross posts or HTML encoding!  **
> > (Related lists - 
> >  http://mail.zope.org/mailman/listinfo/zope-announce
> >  http://mail.zope.org/mailman/listinfo/zope-dev )
> > 


___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://mail.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope )


[Zope-dev] RE: [Zope] New location for Zope Collectors

2003-10-23 Thread Brian Lloyd
Er - this one's my fault :) When I first started triage on nzo 
there were a number of places where it was doing totally unbounded 
searches and them sorting them for good measure. I put that in as 
a stopgap so it would quit dying while I was trying to find the 
culprits and forgot to remove it.


Brian Lloyd[EMAIL PROTECTED]
V.P. Engineering   540.361.1716  
Zope Corporation   http://www.zope.com 


> -Original Message-
> From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] Behalf Of
> Chris McDonough
> Sent: Thursday, October 23, 2003 3:51 PM
> To: Jens Vagelpohl
> Cc: [EMAIL PROTECTED]; [EMAIL PROTECTED]
> Subject: Re: [Zope] New location for Zope Collectors
> 
> 
> I see it's already fixed, thanks...
> 
> On Thu, 2003-10-23 at 16:39, Chris McDonough wrote:
> > Aha!  This is likely due to the monkey-patched searchResults method of
> > the catalog tool.  It is patched from within the ZopeOrg product's
> > __init__.py:
> > 
> > if not kw.has_key('sort_limit'):
> > kw['sort_limit'] = 200
> > 
> > I'm sure this was put into there to foil some sort of DOS, but I think
> > it should be taken out on the appserver and we should see what happens
> > from there... do you think you can do this Jens?
> > 
> > On Thu, 2003-10-23 at 16:05, Chris McDonough wrote:
> > > On the new collector instances the high size of a collection 
> of objects
> > > seems to be limited to 200.  Aha!  Here we have evidence that someone
> > > has hardcoded the number "200" as the upper limit for the number of
> > > catalog results returned from the portal catalog on zope.org.  This
> > > happens with howtos and products too.  I suspect that if we grep the
> > > source for 200 we'll likely be able to fix it.  I'll do that now...
> > > 
> > > On Thu, 2003-10-23 at 14:37, Jens Vagelpohl wrote:
> > > > Hi everyone,
> > > > 
> > > > The issue collectors formerly hosted on collector.zope.org 
> have been 
> > > > migrated to the main zope.org website and are now available at the 
> > > > following address::
> > > > 
> > > > http://www.zope.org/Collectors/
> > > > 
> > > > I have tried to find all links to these collectors, but 
> there might be 
> > > > old links in various places that still point to 
> collector.zope.org. The 
> > > > hostname collector.zope.org will, once the DNS change has 
> propagated, 
> > > > point to www.zope.org.
> > > > 
> > > > jens
> > > > 
> > > > 
> > > > ___
> > > > Zope maillist  -  [EMAIL PROTECTED]
> > > > http://mail.zope.org/mailman/listinfo/zope
> > > > **   No cross posts or HTML encoding!  **
> > > > (Related lists - 
> > > >  http://mail.zope.org/mailman/listinfo/zope-announce
> > > >  http://mail.zope.org/mailman/listinfo/zope-dev )
> > > 
> > > 
> > > ___
> > > Zope maillist  -  [EMAIL PROTECTED]
> > > http://mail.zope.org/mailman/listinfo/zope
> > > **   No cross posts or HTML encoding!  **
> > > (Related lists - 
> > >  http://mail.zope.org/mailman/listinfo/zope-announce
> > >  http://mail.zope.org/mailman/listinfo/zope-dev )
> > 
> > 
> > ___
> > Zope maillist  -  [EMAIL PROTECTED]
> > http://mail.zope.org/mailman/listinfo/zope
> > **   No cross posts or HTML encoding!  **
> > (Related lists - 
> >  http://mail.zope.org/mailman/listinfo/zope-announce
> >  http://mail.zope.org/mailman/listinfo/zope-dev )
> 
> 
> ___
> Zope maillist  -  [EMAIL PROTECTED]
> http://mail.zope.org/mailman/listinfo/zope
> **   No cross posts or HTML encoding!  **
> (Related lists - 
>  http://mail.zope.org/mailman/listinfo/zope-announce
>  http://mail.zope.org/mailman/listinfo/zope-dev )
> 

___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://mail.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope )


[Zope-dev] Re: [Zope] New location for Zope Collectors

2003-10-23 Thread Chris McDonough
I see it's already fixed, thanks...

On Thu, 2003-10-23 at 16:39, Chris McDonough wrote:
> Aha!  This is likely due to the monkey-patched searchResults method of
> the catalog tool.  It is patched from within the ZopeOrg product's
> __init__.py:
> 
> if not kw.has_key('sort_limit'):
> kw['sort_limit'] = 200
> 
> I'm sure this was put into there to foil some sort of DOS, but I think
> it should be taken out on the appserver and we should see what happens
> from there... do you think you can do this Jens?
> 
> On Thu, 2003-10-23 at 16:05, Chris McDonough wrote:
> > On the new collector instances the high size of a collection of objects
> > seems to be limited to 200.  Aha!  Here we have evidence that someone
> > has hardcoded the number "200" as the upper limit for the number of
> > catalog results returned from the portal catalog on zope.org.  This
> > happens with howtos and products too.  I suspect that if we grep the
> > source for 200 we'll likely be able to fix it.  I'll do that now...
> > 
> > On Thu, 2003-10-23 at 14:37, Jens Vagelpohl wrote:
> > > Hi everyone,
> > > 
> > > The issue collectors formerly hosted on collector.zope.org have been 
> > > migrated to the main zope.org website and are now available at the 
> > > following address::
> > > 
> > > http://www.zope.org/Collectors/
> > > 
> > > I have tried to find all links to these collectors, but there might be 
> > > old links in various places that still point to collector.zope.org. The 
> > > hostname collector.zope.org will, once the DNS change has propagated, 
> > > point to www.zope.org.
> > > 
> > > jens
> > > 
> > > 
> > > ___
> > > Zope maillist  -  [EMAIL PROTECTED]
> > > http://mail.zope.org/mailman/listinfo/zope
> > > **   No cross posts or HTML encoding!  **
> > > (Related lists - 
> > >  http://mail.zope.org/mailman/listinfo/zope-announce
> > >  http://mail.zope.org/mailman/listinfo/zope-dev )
> > 
> > 
> > ___
> > Zope maillist  -  [EMAIL PROTECTED]
> > http://mail.zope.org/mailman/listinfo/zope
> > **   No cross posts or HTML encoding!  **
> > (Related lists - 
> >  http://mail.zope.org/mailman/listinfo/zope-announce
> >  http://mail.zope.org/mailman/listinfo/zope-dev )
> 
> 
> ___
> Zope maillist  -  [EMAIL PROTECTED]
> http://mail.zope.org/mailman/listinfo/zope
> **   No cross posts or HTML encoding!  **
> (Related lists - 
>  http://mail.zope.org/mailman/listinfo/zope-announce
>  http://mail.zope.org/mailman/listinfo/zope-dev )


___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://mail.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope )


[Zope-dev] Re: [Zope] New location for Zope Collectors

2003-10-23 Thread Chris McDonough
Aha!  This is likely due to the monkey-patched searchResults method of
the catalog tool.  It is patched from within the ZopeOrg product's
__init__.py:

if not kw.has_key('sort_limit'):
kw['sort_limit'] = 200

I'm sure this was put into there to foil some sort of DOS, but I think
it should be taken out on the appserver and we should see what happens
from there... do you think you can do this Jens?

On Thu, 2003-10-23 at 16:05, Chris McDonough wrote:
> On the new collector instances the high size of a collection of objects
> seems to be limited to 200.  Aha!  Here we have evidence that someone
> has hardcoded the number "200" as the upper limit for the number of
> catalog results returned from the portal catalog on zope.org.  This
> happens with howtos and products too.  I suspect that if we grep the
> source for 200 we'll likely be able to fix it.  I'll do that now...
> 
> On Thu, 2003-10-23 at 14:37, Jens Vagelpohl wrote:
> > Hi everyone,
> > 
> > The issue collectors formerly hosted on collector.zope.org have been 
> > migrated to the main zope.org website and are now available at the 
> > following address::
> > 
> > http://www.zope.org/Collectors/
> > 
> > I have tried to find all links to these collectors, but there might be 
> > old links in various places that still point to collector.zope.org. The 
> > hostname collector.zope.org will, once the DNS change has propagated, 
> > point to www.zope.org.
> > 
> > jens
> > 
> > 
> > ___
> > Zope maillist  -  [EMAIL PROTECTED]
> > http://mail.zope.org/mailman/listinfo/zope
> > **   No cross posts or HTML encoding!  **
> > (Related lists - 
> >  http://mail.zope.org/mailman/listinfo/zope-announce
> >  http://mail.zope.org/mailman/listinfo/zope-dev )
> 
> 
> ___
> Zope maillist  -  [EMAIL PROTECTED]
> http://mail.zope.org/mailman/listinfo/zope
> **   No cross posts or HTML encoding!  **
> (Related lists - 
>  http://mail.zope.org/mailman/listinfo/zope-announce
>  http://mail.zope.org/mailman/listinfo/zope-dev )


___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://mail.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope )


[Zope-dev] Re: [Zope] New location for Zope Collectors

2003-10-23 Thread Chris McDonough
On the new collector instances the high size of a collection of objects
seems to be limited to 200.  Aha!  Here we have evidence that someone
has hardcoded the number "200" as the upper limit for the number of
catalog results returned from the portal catalog on zope.org.  This
happens with howtos and products too.  I suspect that if we grep the
source for 200 we'll likely be able to fix it.  I'll do that now...

On Thu, 2003-10-23 at 14:37, Jens Vagelpohl wrote:
> Hi everyone,
> 
> The issue collectors formerly hosted on collector.zope.org have been 
> migrated to the main zope.org website and are now available at the 
> following address::
> 
> http://www.zope.org/Collectors/
> 
> I have tried to find all links to these collectors, but there might be 
> old links in various places that still point to collector.zope.org. The 
> hostname collector.zope.org will, once the DNS change has propagated, 
> point to www.zope.org.
> 
> jens
> 
> 
> ___
> Zope maillist  -  [EMAIL PROTECTED]
> http://mail.zope.org/mailman/listinfo/zope
> **   No cross posts or HTML encoding!  **
> (Related lists - 
>  http://mail.zope.org/mailman/listinfo/zope-announce
>  http://mail.zope.org/mailman/listinfo/zope-dev )


___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://mail.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope )