Re: [Zope] Upscaling of performance

2000-11-02 Thread Cees de Groot

Petr van Blokland <[EMAIL PROTECTED]> said:
>Hi,
>does have anyone reference on or information about
>the upscaling of Zope for *very* large hit performance:
>1.000.000 per day or so?
>
I've sketched the following upgrade path for our Zope server which
eventually should host multiple ten/hundred thousand websites:
- At the moment, I have a single box with Zope and a Squid cache in front
  of it. "Static" DTML pages are tagged so that Squid will cache their
  rendition - this increased the throughput by a factor of ~6 on my box. 
- Move Squid on a separate box.
- Move mySQL on a separate box.
- Move ZODB on a separate box (ZEO).
- Put a Linux Virtual Server director in front of your Squid box,
  and start adding Squid/Zope boxes (I figure ~3 Squid boxes per Zope
  box, depends on the amount of interactive content you've got) under
  the same IP.

On my home box (Dual PII/400, 256Mb RAM) I can do 120 hits per
second at the moment (with everything - Zope, Squid, mySQL, DNS *and*
the testing scripts running 5,000 normal websites and 95,000 "under
construction" sites), and I figure that I'll easily scale to twenty times
that much on a Linux Virtual Server cluster with all functions on separated
boxes (that are optimized for their tasks).

-- 
Cees de Groot   http://www.cdegroot.com <[EMAIL PROTECTED]>
GnuPG 1024D/E0989E8B 0016 F679 F38D 5946 4ECD  1986 F303 937F E098 9E8B
Forge your CipherSaber and list it: http://www.xs4all.nl/~cg/ciphersaber/

___
Zope maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope-dev )




Re: [Zope] Upscaling of performance

2000-11-02 Thread Erik Enge

On Thu, 2 Nov 2000, J. Atwood wrote:

> On some good hardware it can handle about 100 Requests per second (8,640,000
> per day). 

Well, now.  That truly depends on what Zope would be doing.  Fire away a
couple of objectValues() and the process will kneel _a lot_ sooner.  Of
course, this you could solve with a context oriented Catalog, and moving
as much application logic as possible away from DTML (not that you should
put it there in the first place).
 
> Beyond that you need two things... ZEO and hardware.

And good programmers...

BonusFrust:  Zope actually crashed my Debian box yesterday, twice.  
(Indirectly or directly, I don't know, I'm looking into it.) 


___
Zope maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope-dev )




Re: [Zope] Upscaling of performance

2000-11-02 Thread Ender

has anyone tried the asyncore.c module from nightmare.com to speed up
zserver?

Kapil

"J. Atwood" wrote:
> 
> 1,000,000 hits is not that much but you can check out the Zope Benchmarks
> 
> http://www.zope.org/Members/BwanaZulia/benchmarks.html
> 
> On some good hardware it can handle about 100 Requests per second (8,640,000
> per day).
> 
> Beyond that you need two things... ZEO and hardware.
> 
> Cheers,
> J
> 
> > From: Petr van Blokland <[EMAIL PROTECTED]>
> > Organization: Buro Petr van Blokland + Claudia Mens
> > Reply-To: [EMAIL PROTECTED]
> > Date: Thu, 02 Nov 2000 18:19:24 +0100
> > To: zope list <[EMAIL PROTECTED]>
> > Subject: [Zope] Upscaling of performance
> >
> > Hi,
> > does have anyone reference on or information about
> > the upscaling of Zope for *very* large hit performance:
> > 1.000.000 per day or so?
> >
> > Petr van Blokland
> > [EMAIL PROTECTED]
> >
> >
> > ___
> > Zope maillist  -  [EMAIL PROTECTED]
> > http://lists.zope.org/mailman/listinfo/zope
> > **   No cross posts or HTML encoding!  **
> > (Related lists -
> > http://lists.zope.org/mailman/listinfo/zope-announce
> > http://lists.zope.org/mailman/listinfo/zope-dev )
> >
> >
> 
> ___
> Zope maillist  -  [EMAIL PROTECTED]
> http://lists.zope.org/mailman/listinfo/zope
> **   No cross posts or HTML encoding!  **
> (Related lists -
>  http://lists.zope.org/mailman/listinfo/zope-announce
>  http://lists.zope.org/mailman/listinfo/zope-dev )

___
Zope maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope-dev )




Re: [Zope] Upscaling of performance

2000-11-02 Thread J. Atwood

1,000,000 hits is not that much but you can check out the Zope Benchmarks

http://www.zope.org/Members/BwanaZulia/benchmarks.html

On some good hardware it can handle about 100 Requests per second (8,640,000
per day). 

Beyond that you need two things... ZEO and hardware.

Cheers,
J



> From: Petr van Blokland <[EMAIL PROTECTED]>
> Organization: Buro Petr van Blokland + Claudia Mens
> Reply-To: [EMAIL PROTECTED]
> Date: Thu, 02 Nov 2000 18:19:24 +0100
> To: zope list <[EMAIL PROTECTED]>
> Subject: [Zope] Upscaling of performance
> 
> Hi,
> does have anyone reference on or information about
> the upscaling of Zope for *very* large hit performance:
> 1.000.000 per day or so?
> 
> Petr van Blokland
> [EMAIL PROTECTED]
> 
> 
> ___
> Zope maillist  -  [EMAIL PROTECTED]
> http://lists.zope.org/mailman/listinfo/zope
> **   No cross posts or HTML encoding!  **
> (Related lists - 
> http://lists.zope.org/mailman/listinfo/zope-announce
> http://lists.zope.org/mailman/listinfo/zope-dev )
> 
> 


___
Zope maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope-dev )