[Zope-dev] RE: [Zope] New location for Zope Collectors
OK, I thought it was fixed (and is fixed for the collector) but I guess a workaround was just put in for collectors because other batches are still limited to 200... should be safe to remove it and close some zope.org bugs. On Thu, 2003-10-23 at 22:09, Brian Lloyd wrote: > Er - this one's my fault :) When I first started triage on nzo > there were a number of places where it was doing totally unbounded > searches and them sorting them for good measure. I put that in as > a stopgap so it would quit dying while I was trying to find the > culprits and forgot to remove it. > > > Brian Lloyd[EMAIL PROTECTED] > V.P. Engineering 540.361.1716 > Zope Corporation http://www.zope.com > > > > -Original Message- > > From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] Behalf Of > > Chris McDonough > > Sent: Thursday, October 23, 2003 3:51 PM > > To: Jens Vagelpohl > > Cc: [EMAIL PROTECTED]; [EMAIL PROTECTED] > > Subject: Re: [Zope] New location for Zope Collectors > > > > > > I see it's already fixed, thanks... > > > > On Thu, 2003-10-23 at 16:39, Chris McDonough wrote: > > > Aha! This is likely due to the monkey-patched searchResults method of > > > the catalog tool. It is patched from within the ZopeOrg product's > > > __init__.py: > > > > > > if not kw.has_key('sort_limit'): > > > kw['sort_limit'] = 200 > > > > > > I'm sure this was put into there to foil some sort of DOS, but I think > > > it should be taken out on the appserver and we should see what happens > > > from there... do you think you can do this Jens? > > > > > > On Thu, 2003-10-23 at 16:05, Chris McDonough wrote: > > > > On the new collector instances the high size of a collection > > of objects > > > > seems to be limited to 200. Aha! Here we have evidence that someone > > > > has hardcoded the number "200" as the upper limit for the number of > > > > catalog results returned from the portal catalog on zope.org. This > > > > happens with howtos and products too. I suspect that if we grep the > > > > source for 200 we'll likely be able to fix it. I'll do that now... > > > > > > > > On Thu, 2003-10-23 at 14:37, Jens Vagelpohl wrote: > > > > > Hi everyone, > > > > > > > > > > The issue collectors formerly hosted on collector.zope.org > > have been > > > > > migrated to the main zope.org website and are now available at the > > > > > following address:: > > > > > > > > > > http://www.zope.org/Collectors/ > > > > > > > > > > I have tried to find all links to these collectors, but > > there might be > > > > > old links in various places that still point to > > collector.zope.org. The > > > > > hostname collector.zope.org will, once the DNS change has > > propagated, > > > > > point to www.zope.org. > > > > > > > > > > jens > > > > > > > > > > > > > > > ___ > > > > > Zope maillist - [EMAIL PROTECTED] > > > > > http://mail.zope.org/mailman/listinfo/zope > > > > > ** No cross posts or HTML encoding! ** > > > > > (Related lists - > > > > > http://mail.zope.org/mailman/listinfo/zope-announce > > > > > http://mail.zope.org/mailman/listinfo/zope-dev ) > > > > > > > > > > > > ___ > > > > Zope maillist - [EMAIL PROTECTED] > > > > http://mail.zope.org/mailman/listinfo/zope > > > > ** No cross posts or HTML encoding! ** > > > > (Related lists - > > > > http://mail.zope.org/mailman/listinfo/zope-announce > > > > http://mail.zope.org/mailman/listinfo/zope-dev ) > > > > > > > > > ___ > > > Zope maillist - [EMAIL PROTECTED] > > > http://mail.zope.org/mailman/listinfo/zope > > > ** No cross posts or HTML encoding! ** > > > (Related lists - > > > http://mail.zope.org/mailman/listinfo/zope-announce > > > http://mail.zope.org/mailman/listinfo/zope-dev ) > > > > > > ___ > > Zope maillist - [EMAIL PROTECTED] > > http://mail.zope.org/mailman/listinfo/zope > > ** No cross posts or HTML encoding! ** > > (Related lists - > > http://mail.zope.org/mailman/listinfo/zope-announce > > http://mail.zope.org/mailman/listinfo/zope-dev ) > > ___ Zope-Dev maillist - [EMAIL PROTECTED] http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
[Zope-dev] RE: [Zope] New location for Zope Collectors
Er - this one's my fault :) When I first started triage on nzo there were a number of places where it was doing totally unbounded searches and them sorting them for good measure. I put that in as a stopgap so it would quit dying while I was trying to find the culprits and forgot to remove it. Brian Lloyd[EMAIL PROTECTED] V.P. Engineering 540.361.1716 Zope Corporation http://www.zope.com > -Original Message- > From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] Behalf Of > Chris McDonough > Sent: Thursday, October 23, 2003 3:51 PM > To: Jens Vagelpohl > Cc: [EMAIL PROTECTED]; [EMAIL PROTECTED] > Subject: Re: [Zope] New location for Zope Collectors > > > I see it's already fixed, thanks... > > On Thu, 2003-10-23 at 16:39, Chris McDonough wrote: > > Aha! This is likely due to the monkey-patched searchResults method of > > the catalog tool. It is patched from within the ZopeOrg product's > > __init__.py: > > > > if not kw.has_key('sort_limit'): > > kw['sort_limit'] = 200 > > > > I'm sure this was put into there to foil some sort of DOS, but I think > > it should be taken out on the appserver and we should see what happens > > from there... do you think you can do this Jens? > > > > On Thu, 2003-10-23 at 16:05, Chris McDonough wrote: > > > On the new collector instances the high size of a collection > of objects > > > seems to be limited to 200. Aha! Here we have evidence that someone > > > has hardcoded the number "200" as the upper limit for the number of > > > catalog results returned from the portal catalog on zope.org. This > > > happens with howtos and products too. I suspect that if we grep the > > > source for 200 we'll likely be able to fix it. I'll do that now... > > > > > > On Thu, 2003-10-23 at 14:37, Jens Vagelpohl wrote: > > > > Hi everyone, > > > > > > > > The issue collectors formerly hosted on collector.zope.org > have been > > > > migrated to the main zope.org website and are now available at the > > > > following address:: > > > > > > > > http://www.zope.org/Collectors/ > > > > > > > > I have tried to find all links to these collectors, but > there might be > > > > old links in various places that still point to > collector.zope.org. The > > > > hostname collector.zope.org will, once the DNS change has > propagated, > > > > point to www.zope.org. > > > > > > > > jens > > > > > > > > > > > > ___ > > > > Zope maillist - [EMAIL PROTECTED] > > > > http://mail.zope.org/mailman/listinfo/zope > > > > ** No cross posts or HTML encoding! ** > > > > (Related lists - > > > > http://mail.zope.org/mailman/listinfo/zope-announce > > > > http://mail.zope.org/mailman/listinfo/zope-dev ) > > > > > > > > > ___ > > > Zope maillist - [EMAIL PROTECTED] > > > http://mail.zope.org/mailman/listinfo/zope > > > ** No cross posts or HTML encoding! ** > > > (Related lists - > > > http://mail.zope.org/mailman/listinfo/zope-announce > > > http://mail.zope.org/mailman/listinfo/zope-dev ) > > > > > > ___ > > Zope maillist - [EMAIL PROTECTED] > > http://mail.zope.org/mailman/listinfo/zope > > ** No cross posts or HTML encoding! ** > > (Related lists - > > http://mail.zope.org/mailman/listinfo/zope-announce > > http://mail.zope.org/mailman/listinfo/zope-dev ) > > > ___ > Zope maillist - [EMAIL PROTECTED] > http://mail.zope.org/mailman/listinfo/zope > ** No cross posts or HTML encoding! ** > (Related lists - > http://mail.zope.org/mailman/listinfo/zope-announce > http://mail.zope.org/mailman/listinfo/zope-dev ) > ___ Zope-Dev maillist - [EMAIL PROTECTED] http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
[Zope-dev] Re: [Zope] New location for Zope Collectors
I see it's already fixed, thanks... On Thu, 2003-10-23 at 16:39, Chris McDonough wrote: > Aha! This is likely due to the monkey-patched searchResults method of > the catalog tool. It is patched from within the ZopeOrg product's > __init__.py: > > if not kw.has_key('sort_limit'): > kw['sort_limit'] = 200 > > I'm sure this was put into there to foil some sort of DOS, but I think > it should be taken out on the appserver and we should see what happens > from there... do you think you can do this Jens? > > On Thu, 2003-10-23 at 16:05, Chris McDonough wrote: > > On the new collector instances the high size of a collection of objects > > seems to be limited to 200. Aha! Here we have evidence that someone > > has hardcoded the number "200" as the upper limit for the number of > > catalog results returned from the portal catalog on zope.org. This > > happens with howtos and products too. I suspect that if we grep the > > source for 200 we'll likely be able to fix it. I'll do that now... > > > > On Thu, 2003-10-23 at 14:37, Jens Vagelpohl wrote: > > > Hi everyone, > > > > > > The issue collectors formerly hosted on collector.zope.org have been > > > migrated to the main zope.org website and are now available at the > > > following address:: > > > > > > http://www.zope.org/Collectors/ > > > > > > I have tried to find all links to these collectors, but there might be > > > old links in various places that still point to collector.zope.org. The > > > hostname collector.zope.org will, once the DNS change has propagated, > > > point to www.zope.org. > > > > > > jens > > > > > > > > > ___ > > > Zope maillist - [EMAIL PROTECTED] > > > http://mail.zope.org/mailman/listinfo/zope > > > ** No cross posts or HTML encoding! ** > > > (Related lists - > > > http://mail.zope.org/mailman/listinfo/zope-announce > > > http://mail.zope.org/mailman/listinfo/zope-dev ) > > > > > > ___ > > Zope maillist - [EMAIL PROTECTED] > > http://mail.zope.org/mailman/listinfo/zope > > ** No cross posts or HTML encoding! ** > > (Related lists - > > http://mail.zope.org/mailman/listinfo/zope-announce > > http://mail.zope.org/mailman/listinfo/zope-dev ) > > > ___ > Zope maillist - [EMAIL PROTECTED] > http://mail.zope.org/mailman/listinfo/zope > ** No cross posts or HTML encoding! ** > (Related lists - > http://mail.zope.org/mailman/listinfo/zope-announce > http://mail.zope.org/mailman/listinfo/zope-dev ) ___ Zope-Dev maillist - [EMAIL PROTECTED] http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
[Zope-dev] Re: [Zope] New location for Zope Collectors
Aha! This is likely due to the monkey-patched searchResults method of the catalog tool. It is patched from within the ZopeOrg product's __init__.py: if not kw.has_key('sort_limit'): kw['sort_limit'] = 200 I'm sure this was put into there to foil some sort of DOS, but I think it should be taken out on the appserver and we should see what happens from there... do you think you can do this Jens? On Thu, 2003-10-23 at 16:05, Chris McDonough wrote: > On the new collector instances the high size of a collection of objects > seems to be limited to 200. Aha! Here we have evidence that someone > has hardcoded the number "200" as the upper limit for the number of > catalog results returned from the portal catalog on zope.org. This > happens with howtos and products too. I suspect that if we grep the > source for 200 we'll likely be able to fix it. I'll do that now... > > On Thu, 2003-10-23 at 14:37, Jens Vagelpohl wrote: > > Hi everyone, > > > > The issue collectors formerly hosted on collector.zope.org have been > > migrated to the main zope.org website and are now available at the > > following address:: > > > > http://www.zope.org/Collectors/ > > > > I have tried to find all links to these collectors, but there might be > > old links in various places that still point to collector.zope.org. The > > hostname collector.zope.org will, once the DNS change has propagated, > > point to www.zope.org. > > > > jens > > > > > > ___ > > Zope maillist - [EMAIL PROTECTED] > > http://mail.zope.org/mailman/listinfo/zope > > ** No cross posts or HTML encoding! ** > > (Related lists - > > http://mail.zope.org/mailman/listinfo/zope-announce > > http://mail.zope.org/mailman/listinfo/zope-dev ) > > > ___ > Zope maillist - [EMAIL PROTECTED] > http://mail.zope.org/mailman/listinfo/zope > ** No cross posts or HTML encoding! ** > (Related lists - > http://mail.zope.org/mailman/listinfo/zope-announce > http://mail.zope.org/mailman/listinfo/zope-dev ) ___ Zope-Dev maillist - [EMAIL PROTECTED] http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
[Zope-dev] Re: [Zope] New location for Zope Collectors
On the new collector instances the high size of a collection of objects seems to be limited to 200. Aha! Here we have evidence that someone has hardcoded the number "200" as the upper limit for the number of catalog results returned from the portal catalog on zope.org. This happens with howtos and products too. I suspect that if we grep the source for 200 we'll likely be able to fix it. I'll do that now... On Thu, 2003-10-23 at 14:37, Jens Vagelpohl wrote: > Hi everyone, > > The issue collectors formerly hosted on collector.zope.org have been > migrated to the main zope.org website and are now available at the > following address:: > > http://www.zope.org/Collectors/ > > I have tried to find all links to these collectors, but there might be > old links in various places that still point to collector.zope.org. The > hostname collector.zope.org will, once the DNS change has propagated, > point to www.zope.org. > > jens > > > ___ > Zope maillist - [EMAIL PROTECTED] > http://mail.zope.org/mailman/listinfo/zope > ** No cross posts or HTML encoding! ** > (Related lists - > http://mail.zope.org/mailman/listinfo/zope-announce > http://mail.zope.org/mailman/listinfo/zope-dev ) ___ Zope-Dev maillist - [EMAIL PROTECTED] http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )