Re: [Zope] High Traffic Zope Portal

2005-09-17 Thread Dieter Maurer
Jeronimo Zucco wrote at 2005-9-16 15:09 -0300:
 ...
The python processes occupied 100% of machines resources (cpu and
memory), and the load average increased quickly. We evidenced that the
problems had occurred before user authentication, only trying access the
initial page of the Zope portal.

Use a profiler (e.g. my ZopeProfiler) to find out
where the time is spent. Optimize the hotspots.


Furthermore, carefully check what pages, part of pages or
page resources (such as database query results) can be
cached. Use caching as agressive as possible.

Zope supports caching in many ways:

   *  setting HTTP cache headers such that an external cache
  (SQUID, Apache, ...) can intelligently cache pages

  -- HTTPCacheManager, caching_policy_manager

   *  caching parts of pages via the RAMCacheManager

   *  caching the result of relational database queries

   *  more caching types can be supported in your own
  products.

-- 
Dieter
___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )


Re: [Zope] High Traffic Zope Portal

2005-09-16 Thread Paul Winkler
 Have someone experience in sites of great traffic using Zope? If so,
 please give us some tip for tunning the system or discover the
 bootleneck points.

This is a FAQ* and has been discussed recently; the list archives
might be helpful.

I have a bunch of links to performance docs here:
http://www.slinkp.com/code/zopestuff

* unfortunately, there is no real FAQ list for this mailing list
that I know of.

-PW


___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )


Re: [Zope] High Traffic Zope Portal

2005-09-16 Thread Andreas Jung



--On 16. September 2005 15:09:37 -0300 Jeronimo Zucco [EMAIL PROTECTED] 
wrote:

We posted a dynamic document for the students (35.000). The document is
generated using queries in MySql database, after user autentication
using mysqluserfolder.

The python processes occupied 100% of machines resources (cpu and
memory), and the load average increased quickly. We evidenced that the
problems had occurred before user authentication, only trying access the
initial page of the Zope portal.

We estimated that the simultaneous accesses to our portal are
approximately 1 people in a moment, that finished generating a DoS
(Denial of Service) in our portal.



Short answer: all requests are processed by four worker thread - one after 
each other. If the threads are busy, all other requests have to wait in the 
request pipeline.


When you document is generated but static for all users then you should 
make it cachable and so it can be emitted through the Apache cache.


-aj

pgpLRQTe1tc53.pgp
Description: PGP signature
___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )