Re: [Zope] Zope zserver-threads minimum is 5?

[Fred Drake]

On Mon, Nov 10, 2014 at 7:28 AM, Pablo Caro Revuelta
 wrote:
> My zope clients (Zope2-2.12.11) allways start with 5 theads although
> zserver-threads is 2 in my zope.conf file.
>
> I am using "ps -eLf" for theads counter.
>
> If for zserver-threads I use the values 1, 2 or 3 I get 5 theads.
> A higher value give me 2 threads more. I mean, for 4 I get 6, for 15, 17
> threads, etc.
>
> It's correct? There are allways 5 threads minumun and 2 extra?

The zserver-threads setting controls the number of "application"
threads; these are running handing the application (Plone in your
case) code for requests. The server itself uses a thread for handling
socket communication, reading & parsing the requests as they come in,
queuing them for an application thread, and managing the transmission
of response data.  ZEO will use an additional thread for communication
with the storage server(s).

Other components may start additional threads as well, depending on
Plone and your configuration.  For example, zc.monitor starts a thread
to handle monitoring interactions. Someone with Plone-specific
knowledge can probably help more.


  -Fred

-- 
Fred L. Drake, Jr.
"A storm broke loose in my mind."  --Albert Einstein
___
Zope maillist  -  Zope@zope.org
https://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists -
 https://mail.zope.org/mailman/listinfo/zope-announce
 https://mail.zope.org/mailman/listinfo/zope-dev )

[Zope] Zope zserver-threads minimum is 5?

[Pablo Caro Revuelta]

Hi all,

My zope clients (Zope2-2.12.11) allways start with 5 theads although
zserver-threads is 2 in my zope.conf file.

I am using "ps -eLf" for theads counter.

If for zserver-threads I use the values 1, 2 or 3 I get 5 theads.
A higher value give me 2 threads more. I mean, for 4 I get 6, for 15, 17
threads, etc.

It's correct? There are allways 5 threads minumun and 2 extra?

It's a plone site. I am using zeo with separated catalog. I have 16
instances in a 8 cores machines and I think the GIL is making a poor
performance.


Thanks
___
Zope maillist  -  Zope@zope.org
https://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists -
 https://mail.zope.org/mailman/listinfo/zope-announce
 https://mail.zope.org/mailman/listinfo/zope-dev )

Re: [Zope] ZServer uncaptured python exception

[Thomas Bennett]

I absolutely agree and I have preached to the WEB page editors here about this 
but most of them have no idea of the difference between a relative link, an 
absolute link, and trash like this.  Using Dreamweaver they just know "it 
works" at least for them.

;-)

Thomas

On Monday 07 April 2008 06:06, Chris Withers wrote:
> Thomas Bennett wrote:
> > I have had similar instances with GSA on my Zope server in that it would
> > try to index something like
> > /mydir/mydir/mydir/mydir/somefile.html
> >
> > Often I've found the case is an href that references
> > ../somethingelse.html
>
> Yes, that's bad coding on your part.
>
> cheers,
>
> Chris

-- 

Thomas McMillan Grant Bennett   Appalachian State University
Operations & Systems AnalystP O Box 32026
University Library  Boone, North Carolina 28608
(828) 262 6587

"... using OpenOffice.org, and save them back to disk automatically,
in MS Word format.  They surf the Web, check e-mail, do instant 
messsaging, view YouTube videos, visit their Facebook pages, learn 
touch-typing skills and lots more.  Our public library has been 
offering these Linux public stations for the past three years."
 - Phil Shapiro Linux Journal January 2008

Library Systems Help Desk: https://www.library.appstate.edu/help/

___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )

Re: [Zope] ZServer uncaptured python exception

[Chris Withers]

Thomas Bennett wrote:
I have had similar instances with GSA on my Zope server in that it would try 
to index something like

/mydir/mydir/mydir/mydir/somefile.html

Often I've found the case is an href that references ../somethingelse.html


Yes, that's bad coding on your part.

cheers,

Chris

--
Simplistix - Content Management, Zope & Python Consulting
   - http://www.simplistix.co.uk
___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
http://mail.zope.org/mailman/listinfo/zope-announce

http://mail.zope.org/mailman/listinfo/zope-dev )

Re: [Zope] ZServer uncaptured python exception

[Thomas Bennett]

I have had similar instances with GSA on my Zope server in that it would try 
to index something like
/mydir/mydir/mydir/mydir/somefile.html

Often I've found the case is an href that references ../somethingelse.html

I don't know if this might be related to your case but you might want to 
check.   I had to finally end up using the  iptables rule already suggested 
and this was our campus GSA.  After talking to the owner of the GSA he told 
me he found a plugin or fix for Plone  for the GSA and we are going to try 
that to see if it helps with Zope.  But this is local so you probably 
wouldn't be able to ask outside entities to use this.


Thomas


On Wednesday 02 April 2008 05:50, Chris Withers wrote:
> Jens Vagelpohl wrote:
> > Trusting that bots actually care about or respect robots.txt won't get
> > you very far. If all else fails I suggest you look at your logs to find
> > out what IPs or IP ranges those bots come from and block them at the
> > firewall level, using e.g. iptables if you're on Linux. This is a very
> > simplistic invocation:
> >
> > iptables -A INPUT -s  -j DROP
> >
> > At least that way you gain some breathing room to come up with a less
> > constrictive solution.
>
> Also very effective against errant Google Search Appliances in intranet
> situtations ;-)
>
> Chris

-- 

Thomas McMillan Grant Bennett   Appalachian State University
Operations & Systems AnalystP O Box 32026
University Library  Boone, North Carolina 28608
(828) 262 6587

"... using OpenOffice.org, and save them back to disk automatically,
in MS Word format.  They surf the Web, check e-mail, do instant 
messsaging, view YouTube videos, visit their Facebook pages, learn 
touch-typing skills and lots more.  Our public library has been 
offering these Linux public stations for the past three years."
 - Phil Shapiro Linux Journal January 2008

Library Systems Help Desk: https://www.library.appstate.edu/help/

___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )

Re: [Zope] ZServer uncaptured python exception

[Chris Withers]

Jens Vagelpohl wrote:


Trusting that bots actually care about or respect robots.txt won't get 
you very far. If all else fails I suggest you look at your logs to find 
out what IPs or IP ranges those bots come from and block them at the 
firewall level, using e.g. iptables if you're on Linux. This is a very 
simplistic invocation:


iptables -A INPUT -s  -j DROP

At least that way you gain some breathing room to come up with a less 
constrictive solution.


Also very effective against errant Google Search Appliances in intranet 
situtations ;-)


Chris

--
Simplistix - Content Management, Zope & Python Consulting
   - http://www.simplistix.co.uk
___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
http://mail.zope.org/mailman/listinfo/zope-announce

http://mail.zope.org/mailman/listinfo/zope-dev )

Re: [Zope] ZServer uncaptured python exception

[Chris Withers]

Allen Schmidt Sr. wrote:

Thanks Chris.
Seeing tons of squid messages about the new msnbotand it is not 
following our robots.txt directive. In fact, I have even disallowed it 
completely and it still goes where it wants. And the updated version was 
supposed to have been released end of last weekabout the time our 
zeo clients started pegging 99%.


Just block the damn thing by useragent in Squid or Apache :-S

Chris

--
Simplistix - Content Management, Zope & Python Consulting
   - http://www.simplistix.co.uk
___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
http://mail.zope.org/mailman/listinfo/zope-announce

http://mail.zope.org/mailman/listinfo/zope-dev )

Re: [Zope] ZServer uncaptured python exception

[Jens Vagelpohl]

On Apr 2, 2008, at 11:11 , Allen Schmidt Sr. wrote:

Thanks Chris.
Seeing tons of squid messages about the new msnbotand it is not  
following our robots.txt directive. In fact, I have even disallowed  
it completely and it still goes where it wants. And the updated  
version was supposed to have been released end of last weekabout  
the time our zeo clients started pegging 99%.


Trusting that bots actually care about or respect robots.txt won't get  
you very far. If all else fails I suggest you look at your logs to  
find out what IPs or IP ranges those bots come from and block them at  
the firewall level, using e.g. iptables if you're on Linux. This is a  
very simplistic invocation:


iptables -A INPUT -s  -j DROP

At least that way you gain some breathing room to come up with a less  
constrictive solution.


jens



___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
http://mail.zope.org/mailman/listinfo/zope-announce

http://mail.zope.org/mailman/listinfo/zope-dev )

Re: [Zope] ZServer uncaptured python exception

[Allen Schmidt Sr.]

Thanks Chris.
Seeing tons of squid messages about the new msnbotand it is not 
following our robots.txt directive. In fact, I have even disallowed it 
completely and it still goes where it wants. And the updated version was 
supposed to have been released end of last weekabout the time our 
zeo clients started pegging 99%.


Chris Withers wrote:


Allen Schmidt Sr. wrote:


Running logtail on a ZEO client, I am seeing lots of these.
And our two public clients are pegging the server at 99% almost 
continuously. Not sure why.


2008-04-01T09:54:09 ERROR(200) ZServer uncaptured python exception, 
closing channel 8.7.96.136:56350 at 0xb63d7a6c channel#: 800 requests:4> 
(socket.error:(104, 'Connection reset by peer') 



This exception is annoying in that it's pretty meaningless.
Clients disconnecting midway through may be quite a normal thing and 
it's annoying there's no way to catch this exception if you want to.


In your case, I'd guess that your load has recently gone way up (maybe a 
search engine spider, some other spider of people with M$ Office 
installed hammering your site for webdav requests) but I wouldn't worry 
about these...


cheers,

Chris


___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
http://mail.zope.org/mailman/listinfo/zope-announce

http://mail.zope.org/mailman/listinfo/zope-dev )

Re: [Zope] ZServer uncaptured python exception

[Chris Withers]

Allen Schmidt Sr. wrote:

Running logtail on a ZEO client, I am seeing lots of these.
And our two public clients are pegging the server at 99% almost 
continuously. Not sure why.


2008-04-01T09:54:09 ERROR(200) ZServer uncaptured python exception, 
closing channel 8.7.96.136:56350 at 0xb63d7a6c channel#: 800 requests:4> 
(socket.error:(104, 'Connection reset by peer') 


This exception is annoying in that it's pretty meaningless.
Clients disconnecting midway through may be quite a normal thing and 
it's annoying there's no way to catch this exception if you want to.


In your case, I'd guess that your load has recently gone way up (maybe a 
search engine spider, some other spider of people with M$ Office 
installed hammering your site for webdav requests) but I wouldn't worry 
about these...


cheers,

Chris

--
Simplistix - Content Management, Zope & Python Consulting
   - http://www.simplistix.co.uk
___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
http://mail.zope.org/mailman/listinfo/zope-announce

http://mail.zope.org/mailman/listinfo/zope-dev )

Re: [Zope] ZServer uncaptured python exception

[Allen Schmidt Sr.]

That makes sense...but I think they are still related, sort of.
The thread you offered says the error comes from clients 
disconnecting...hitting the stop button or loading a different 
page...effectively doing the same thing.


But they are hitting the stop button BECAUSE the site is slow and 
spinning.  I have Deadlockdebugger and that shows a variety of things. 
Mostly that all 4 threads are always full.


I will keep looking.

Allen


Jonathan wrote:



- Original Message - From: "Allen Schmidt Sr." 
<[EMAIL PROTECTED]>

To: "Zope Users" 
Sent: Tuesday, April 01, 2008 10:11 AM
Subject: [Zope] ZServer uncaptured python exception



Running logtail on a ZEO client, I am seeing lots of these.
And our two public clients are pegging the server at 99% almost 
continuously. Not sure why.




2008-04-01T09:54:09 ERROR(200) ZServer uncaptured python exception, 
closing channel 8.7.96.136:56350 at 0xb63d7a6c channel#: 800 requests:4> 
(socket.error:(104, 'Connection reset by peer') 
[/usr/local/lib/python2.3/asynchat.py|initiate_send|218] 
[/var/www/zope/zope275c2/lib/python/ZServer/medusa/http_server.py|send|417] 
[/usr/local/lib/python2.3/asyncore.py|send|337])

--
2008-04-01T09:54:17 ERROR(200) ZServer uncaptured python exception, 
closing channel 8.7.96.136:56590 at 0xb26898ac channel#: 890 requests:> 
(socket.error:(104, 'Connection reset by peer') 
[/usr/local/lib/python2.3/asynchat.py|initiate_send|218] 
[/var/www/zope/zope275c2/lib/python/ZServer/medusa/http_server.py|send|417] 
[/usr/local/lib/python2.3/asyncore.py|send|337])



I am not sure that the error messages you are seeing are related to your 
high cpu utilization.


There is a discussion thread on your error here: 
http://aspn.activestate.com/ASPN/Mail/Message/zope-list/3492748


If you google 'debug spinning zope'  you will find links on how to track 
down cpu consumption.


HTH

Jonathan
___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - http://mail.zope.org/mailman/listinfo/zope-announce
http://mail.zope.org/mailman/listinfo/zope-dev )



___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
http://mail.zope.org/mailman/listinfo/zope-announce

http://mail.zope.org/mailman/listinfo/zope-dev )

Re: [Zope] ZServer uncaptured python exception

[Jonathan]

- Original Message - 
From: "Allen Schmidt Sr." <[EMAIL PROTECTED]>

To: "Zope Users" 
Sent: Tuesday, April 01, 2008 10:11 AM
Subject: [Zope] ZServer uncaptured python exception



Running logtail on a ZEO client, I am seeing lots of these.
And our two public clients are pegging the server at 99% almost 
continuously. Not sure why.




2008-04-01T09:54:09 ERROR(200) ZServer uncaptured python exception, 
closing channel 8.7.96.136:56350 at 0xb63d7a6c channel#: 800 requests:4> 
(socket.error:(104, 'Connection reset by peer') 
[/usr/local/lib/python2.3/asynchat.py|initiate_send|218] 
[/var/www/zope/zope275c2/lib/python/ZServer/medusa/http_server.py|send|417] 
[/usr/local/lib/python2.3/asyncore.py|send|337])

--
2008-04-01T09:54:17 ERROR(200) ZServer uncaptured python exception, 
closing channel 8.7.96.136:56590 at 0xb26898ac channel#: 890 requests:> 
(socket.error:(104, 'Connection reset by peer') 
[/usr/local/lib/python2.3/asynchat.py|initiate_send|218] 
[/var/www/zope/zope275c2/lib/python/ZServer/medusa/http_server.py|send|417] 
[/usr/local/lib/python2.3/asyncore.py|send|337])


I am not sure that the error messages you are seeing are related to your 
high cpu utilization.


There is a discussion thread on your error here: 
http://aspn.activestate.com/ASPN/Mail/Message/zope-list/3492748


If you google 'debug spinning zope'  you will find links on how to track 
down cpu consumption.


HTH

Jonathan 


___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
http://mail.zope.org/mailman/listinfo/zope-announce

http://mail.zope.org/mailman/listinfo/zope-dev )

[Zope] ZServer uncaptured python exception

[Allen Schmidt Sr.]

Running logtail on a ZEO client, I am seeing lots of these.
And our two public clients are pegging the server at 99% almost 
continuously. Not sure why.




2008-04-01T09:54:09 ERROR(200) ZServer uncaptured python exception, 
closing channel 8.7.96.136:56350 at 0xb63d7a6c channel#: 800 requests:4> 
(socket.error:(104, 'Connection reset by peer') 
[/usr/local/lib/python2.3/asynchat.py|initiate_send|218] 
[/var/www/zope/zope275c2/lib/python/ZServer/medusa/http_server.py|send|417] 
[/usr/local/lib/python2.3/asyncore.py|send|337])

--
2008-04-01T09:54:17 ERROR(200) ZServer uncaptured python exception, 
closing channel 8.7.96.136:56590 at 0xb26898ac channel#: 890 requests:> 
(socket.error:(104, 'Connection reset by peer') 
[/usr/local/lib/python2.3/asynchat.py|initiate_send|218] 
[/var/www/zope/zope275c2/lib/python/ZServer/medusa/http_server.py|send|417] 
[/usr/local/lib/python2.3/asyncore.py|send|337])

--



Allen

___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
http://mail.zope.org/mailman/listinfo/zope-announce

http://mail.zope.org/mailman/listinfo/zope-dev )

Re: [Zope] ZServer error

[Mark Gibson]

Great, Thanks!

Mark

Pascal Peregrina wrote:

As far as I know, this means that the requester closed the connection (like
a browser timing out, etc...).
In general, I would say, nothing to worry about...

Pascal



De : Mark Gibson <[EMAIL PROTECTED]>
Date : Mon, 02 Oct 2006 11:58:31 -0600
À : 
Objet : [Zope] ZServer error

(Zope 2.8.7-final, python 2.4.3, linux2)

I see the following error in my event.log a couple of times a day:

2006-10-02T07:13:00 ERROR ZServer uncaptured python exception, closing
channel  (socket.error:(104, 'Connection
reset by peer') [/usr/lib/python2.4/asynchat.py|initiate_send|219]
[/usr/local/zope/Zope-2.8.7/lib/python/ZServer/medusa/http_server.py|send|417]
[/usr/lib/python2.4/asyncore.py|send|332])


Anyone familiar with this?

Thanks,

Mark
___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce

 http://mail.zope.org/mailman/listinfo/zope-dev )




**
This email and any files transmitted with it are confidential and
intended solely for the use of the individual or entity to whom they
are addressed. If you have received this email in error please notify
the system manager.

This footnote also confirms that this email message has been swept by
MIMEsweeper for the presence of computer viruses.

www.mimesweeper.com
**



___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
http://mail.zope.org/mailman/listinfo/zope-announce

http://mail.zope.org/mailman/listinfo/zope-dev )

Re: [Zope] ZServer error

[Pascal Peregrina]

As far as I know, this means that the requester closed the connection (like
a browser timing out, etc...).
In general, I would say, nothing to worry about...

Pascal


> De : Mark Gibson <[EMAIL PROTECTED]>
> Date : Mon, 02 Oct 2006 11:58:31 -0600
> À : 
> Objet : [Zope] ZServer error
> 
> (Zope 2.8.7-final, python 2.4.3, linux2)
> 
> I see the following error in my event.log a couple of times a day:
> 
> 2006-10-02T07:13:00 ERROR ZServer uncaptured python exception, closing
> channel  -0x68ce9834 channel#: 1517 requests:> (socket.error:(104, 'Connection
> reset by peer') [/usr/lib/python2.4/asynchat.py|initiate_send|219]
> [/usr/local/zope/Zope-2.8.7/lib/python/ZServer/medusa/http_server.py|send|417]
> [/usr/lib/python2.4/asyncore.py|send|332])
> 
> 
> Anyone familiar with this?
> 
> Thanks,
> 
> Mark
> ___
> Zope maillist  -  Zope@zope.org
> http://mail.zope.org/mailman/listinfo/zope
> **   No cross posts or HTML encoding!  **
> (Related lists - 
>  http://mail.zope.org/mailman/listinfo/zope-announce
>  http://mail.zope.org/mailman/listinfo/zope-dev )



**
This email and any files transmitted with it are confidential and
intended solely for the use of the individual or entity to whom they
are addressed. If you have received this email in error please notify
the system manager.

This footnote also confirms that this email message has been swept by
MIMEsweeper for the presence of computer viruses.

www.mimesweeper.com
**
___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists -
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )

Re: [Zope] ZServer error

[Maciej Wisniowski]

2006-10-02T07:13:00 ERROR ZServer uncaptured python exception, closing 
channel -0x68ce9834 channel#: 1517 requests:> (socket.error:(104, 'Connection 
reset by peer') [/usr/lib/python2.4/asynchat.py|initiate_send|219] 
[/usr/local/zope/Zope-2.8.7/lib/python/ZServer/medusa/http_server.py|send|417] 
[/usr/lib/python2.4/asyncore.py|send|332])



Anyone familiar with this?


This error means that browser has closed connection -
possibly somebody has pressed 'Stop' button in his browser.
It is nothing to worry about.

You may search the group archives for this.

--
Maciej Wisniowski
___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
http://mail.zope.org/mailman/listinfo/zope-announce

http://mail.zope.org/mailman/listinfo/zope-dev )

[Zope] ZServer error

[Mark Gibson]

(Zope 2.8.7-final, python 2.4.3, linux2)

I see the following error in my event.log a couple of times a day:

2006-10-02T07:13:00 ERROR ZServer uncaptured python exception, closing 
channel -0x68ce9834 channel#: 1517 requests:> (socket.error:(104, 'Connection 
reset by peer') [/usr/lib/python2.4/asynchat.py|initiate_send|219] 
[/usr/local/zope/Zope-2.8.7/lib/python/ZServer/medusa/http_server.py|send|417] 
[/usr/lib/python2.4/asyncore.py|send|332])



Anyone familiar with this?

Thanks,

Mark
___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
http://mail.zope.org/mailman/listinfo/zope-announce

http://mail.zope.org/mailman/listinfo/zope-dev )

Re: [Zope] ZServer SSL Howto

[Andreas Jung]

--On 2. Juni 2006 14:20:05 +0200 Baptiste Ancey 
<[EMAIL PROTECTED]> wrote:



Hi all,

I have my website on a zope instance with apache frontend.
I'd like to have a private zone on my website with HTTPS.

I've already read the ZServerSSL HowTo
(http://www.zope.org/Members/ngps/ZServerSSL-HOWTO)
 - Is it the best solution to have both http and https parts on my
website ?
 - Is there somewhere a package that install from scratch zope with
ZServerSSL ?



Why do you need ZServerSSL when you have Apache in front of Zope. Let
Apache do the SSL part and use it as reverse proxy for Zope...no need for 
ZServerSSL. No work, no problems...


-aj

--
ZOPYX Ltd. & Co. KG - Charlottenstr. 37/1 - 72070 Tübingen - Germany
Web: www.zopyx.com - Email: [EMAIL PROTECTED] - Phone +49 - 7071 - 793376
E-Publishing, Python, Zope & Plone development, Consulting


pgp0a8GYZhaPk.pgp
Description: PGP signature
___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )

[Zope] ZServer SSL Howto

[Baptiste Ancey]

Hi all,

I have my website on a zope instance with apache frontend.
I'd like to have a private zone on my website with HTTPS.

I've already read the ZServerSSL HowTo 
(http://www.zope.org/Members/ngps/ZServerSSL-HOWTO)

- Is it the best solution to have both http and https parts on my website ?
- Is there somewhere a package that install from scratch zope with 
ZServerSSL ?


Thanks for your help





___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
http://mail.zope.org/mailman/listinfo/zope-announce

http://mail.zope.org/mailman/listinfo/zope-dev )

Re: [Zope] zserver-threads

[Dieter Maurer]

Jake wrote at 2006-1-31 15:53 -0500:
>Am I gleaming from that that you are proposing a less-is-more approach to
>threads?

That's something proposed several times in the list.

In our installation, we used the default (4 threads) for a long
time -- until we met overload situations (all 4 threads in
use over long periods of time) when we switched to 6 threads.

However, in our situation not only Zope handles the application.
Beside that there are backend resources such as various databases
that can work concurrently with Zope. Therefore, our
application is not CPU bound (at least not on the host, Zope runs on)
and increasing the number of threads can increase throughput.

> ...
>This seems to eat up about half of the RAM on the server.
>
>Would one thread but double the cache size do better?

You have read my message to the end (and Florent's comment)?

  If you have a single thread, then a single long running
  request would exclude all other (maybe very short)
  requests until it finisches.

  I am convinced that you want some degree of concurrency
  to favour short running requests. 4 threads is not too a
  default.

-- 
Dieter
___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )

Re: [Zope] zserver-threads

[Floyd May]

On 1/31/06, Jake <[EMAIL PROTECTED]> wrote:
Am I gleaming from that that you are proposing a less-is-more approach tothreads?Here is what I have been using:- Zope 2.7.8 (Plone 2.1.2)- RH Linux- AMD Athlon 64 3200+ 2.0 GHz- 2GB DDR RAM
- 120,000 hits a day- 392,036 objects in database- 2 threads- 100,000 object cache sizeThis seems to eat up about half of the RAM on the server.Would one thread but double the cache size do better?
Jake___http://www.ZopeZone.comOn Tue, January 31, 2006 2:40 pm, Dieter Maurer said:> Jens Vagelpohl wrote at 2006-1-31 15:07 +:
>>On 31 Jan 2006, at 15:01, Jake wrote:> http://plone.org/documentation/how-to/threads-vs-cache-size>>
>>That article contains little information to back up the conclusions,>>and some of it is patently wrong. Another case of hearsay and half->>thruths being propagated by well-meaning but uninformed parties.
>> There is a convincing example (I think from Matt Kromer) what> happens to "mean response time" when the number of threads> is increased from 1 to 2:>>   Assume you have 2 units of work. If you have a single
>   thread, 1 unit is done, then the second. The>   mean response time is (1 + 2) / 2 = 1.5.>>   Now assume you have two threads (but a single processor).>   Both threads work (quasi) parallel but have only half of the
>   processor power. Both will take 2 time units to perform>   their unit of work. The mean response time is (2 + 2) / 2 = 2.>> You get the same ratios whenever you double the number of threads
> (but keep the number of processors and all your work is CPU bound).>>> Things become more difficult when you have a mix of very small> requests and very long requests. You then may want a higher
> level of concurrency to not let the small requests being> blocked by the long ones.>>> --> Dieter> ___> Zope maillist  -  
Zope@zope.org> http://mail.zope.org/mailman/listinfo/zope> **   No cross posts or HTML encoding!  **> (Related lists -
>  http://mail.zope.org/mailman/listinfo/zope-announce>  http://mail.zope.org/mailman/listinfo/zope-dev
 )>___Zope maillist  -  Zope@zope.orghttp://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **(Related lists - http://mail.zope.org/mailman/listinfo/zope-announce 
http://mail.zope.org/mailman/listinfo/zope-dev )I would recommend exploring ZEO and Squid if you're *this* worried about performance.  There's only so much that one machine can do.  If I understand the Zope framework, the idea is that read-to-write ratio for the ZODB is going to be much greater than one, meaning that there are going to be a lot more reads than writes.  In this case, having some load balancing and ZEO client caching will make overall performance faster.  However, if you're doing lots of writing to the ZODB, you'll probably need to explore ZEO even more in the area of mounting different ZODBs at different places in your ZEO clients' trees.
Like some of the other people said, you probably should just tune it as needed.  It's also a Bad Thing to be running your servers at or near capacity; you should leave plenty of headspace for usage spikes.  I've certainly run into situations where Zope stuff was processor-bound and slowing everything down, but the RAM wasn't even 25% full.  In cases like this, more zserver threads (or more ZEO clients) helps even things out.  YMMV.
-- Floyd MaySenior Systems AnalystCTLN - CareerTech Learning Network[EMAIL PROTECTED]
___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )

Re: [Zope] zserver-threads

[Jake]

Am I gleaming from that that you are proposing a less-is-more approach to
threads?

Here is what I have been using:
- Zope 2.7.8 (Plone 2.1.2)
- RH Linux
- AMD Athlon 64 3200+ 2.0 GHz
- 2GB DDR RAM
- 120,000 hits a day
- 392,036 objects in database
- 2 threads
- 100,000 object cache size

This seems to eat up about half of the RAM on the server.

Would one thread but double the cache size do better?

Jake
___
http://www.ZopeZone.com


On Tue, January 31, 2006 2:40 pm, Dieter Maurer said:
> Jens Vagelpohl wrote at 2006-1-31 15:07 +:
>>On 31 Jan 2006, at 15:01, Jake wrote:
>>
>>> http://plone.org/documentation/how-to/threads-vs-cache-size
>>
>>That article contains little information to back up the conclusions,
>>and some of it is patently wrong. Another case of hearsay and half-
>>thruths being propagated by well-meaning but uninformed parties.
>
> There is a convincing example (I think from Matt Kromer) what
> happens to "mean response time" when the number of threads
> is increased from 1 to 2:
>
>   Assume you have 2 units of work. If you have a single
>   thread, 1 unit is done, then the second. The
>   mean response time is (1 + 2) / 2 = 1.5.
>
>   Now assume you have two threads (but a single processor).
>   Both threads work (quasi) parallel but have only half of the
>   processor power. Both will take 2 time units to perform
>   their unit of work. The mean response time is (2 + 2) / 2 = 2.
>
> You get the same ratios whenever you double the number of threads
> (but keep the number of processors and all your work is CPU bound).
>
>
> Things become more difficult when you have a mix of very small
> requests and very long requests. You then may want a higher
> level of concurrency to not let the small requests being
> blocked by the long ones.
>
>
> --
> Dieter
> ___
> Zope maillist  -  Zope@zope.org
> http://mail.zope.org/mailman/listinfo/zope
> **   No cross posts or HTML encoding!  **
> (Related lists -
>  http://mail.zope.org/mailman/listinfo/zope-announce
>  http://mail.zope.org/mailman/listinfo/zope-dev )
>


___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )

Re: [Zope] zserver-threads

[Jake]

Well, I have been using Zope for over 6 years and I still don't think I
have mastered what is truly best other than get a good server, with a lot
of RAM and bump up your threads * cache to use up about 50% of it.

Jake
___
http://www.ZopeZone.com


On Tue, January 31, 2006 12:46 pm, Andreas Jung said:
>
>
> --On 31. Januar 2006 12:32:35 -0500 Jake <[EMAIL PROTECTED]> wrote:
>
>> It would be nice if someone post some guidelines for threads and cache
>> size, like a table.
>>
>> RAM / Hits / Threads / Cache Size
>> 2 GB / 20,000,000 / 3 / 50,000
>> 5 GB / 20,000,000 / 5 / 100,000
>
> Such a table is pretty much worthless. A ZEO cache of 50.000 objects tells
> you nothing about the RAM to be used. The cache could hold 50.000 small
> objects or 50.000 very large objects eating all your RAM. The relation
> between #threads and hits also depends very much on your application.
> To make it short: dealing with larger installation always requires some
> iterations of oberserving your system and tuning it.
>
> -aj
>


___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )

Re: [Zope] zserver-threads

[Dieter Maurer]

Jens Vagelpohl wrote at 2006-1-31 15:07 +:
>On 31 Jan 2006, at 15:01, Jake wrote:
>
>> http://plone.org/documentation/how-to/threads-vs-cache-size
>
>That article contains little information to back up the conclusions,  
>and some of it is patently wrong. Another case of hearsay and half- 
>thruths being propagated by well-meaning but uninformed parties.

There is a convincing example (I think from Matt Kromer) what
happens to "mean response time" when the number of threads
is increased from 1 to 2:

  Assume you have 2 units of work. If you have a single
  thread, 1 unit is done, then the second. The
  mean response time is (1 + 2) / 2 = 1.5.

  Now assume you have two threads (but a single processor).
  Both threads work (quasi) parallel but have only half of the
  processor power. Both will take 2 time units to perform
  their unit of work. The mean response time is (2 + 2) / 2 = 2.

You get the same ratios whenever you double the number of threads
(but keep the number of processors and all your work is CPU bound).


Things become more difficult when you have a mix of very small
requests and very long requests. You then may want a higher
level of concurrency to not let the small requests being
blocked by the long ones.


-- 
Dieter
___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )

Re: [Zope] zserver-threads

[Jake]

It would be nice if someone post some guidelines for threads and cache
size, like a table.

RAM / Hits / Threads / Cache Size
2 GB / 20,000,000 / 3 / 50,000
5 GB / 20,000,000 / 5 / 100,000

Jake
___
http://www.ZopeZone.com


On Tue, January 31, 2006 10:05 am, Jens Vagelpohl said:
>
> On 31 Jan 2006, at 14:59, Jake wrote:
>
>> I just spent a few minutes googling it and failed, but I thought I
>> read on
>> the Zope wiki that for higher trafic sites, it was better to have
>> bigger
>> caches (50,000+) and fewer threads (2).
>
> The term "high traffic site" doesn't mean a thing when it comes to
> threads or the cache (or in general). It's way too general.
> Determinations about cache sizes or thread numbers can only be made
> with specific requirements, (estimated) traffic data, hardware
> specifications and knowledge about the Zope application in hand, period.
>
> Less threads and bigger caches only make sense when you are under
> memory pressure and (hopefully) your pages render fast enough so that
> less threads can still satisfy the rendering load.
>
> jens
>
> ___
> Zope maillist  -  Zope@zope.org
> http://mail.zope.org/mailman/listinfo/zope
> **   No cross posts or HTML encoding!  **
> (Related lists -
>  http://mail.zope.org/mailman/listinfo/zope-announce
>  http://mail.zope.org/mailman/listinfo/zope-dev )
>


___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )

Re: [Zope] zserver-threads

[Andreas Jung]

--On 31. Januar 2006 12:32:35 -0500 Jake <[EMAIL PROTECTED]> wrote:


It would be nice if someone post some guidelines for threads and cache
size, like a table.

RAM / Hits / Threads / Cache Size
2 GB / 20,000,000 / 3 / 50,000
5 GB / 20,000,000 / 5 / 100,000


Such a table is pretty much worthless. A ZEO cache of 50.000 objects tells 
you nothing about the RAM to be used. The cache could hold 50.000 small 
objects or 50.000 very large objects eating all your RAM. The relation 
between #threads and hits also depends very much on your application.
To make it short: dealing with larger installation always requires some 
iterations of oberserving your system and tuning it.


-aj


pgpwUTXp3lKD6.pgp
Description: PGP signature
___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )

Re: [Zope] zserver-threads

[Jens Vagelpohl]

On 31 Jan 2006, at 15:01, Jake wrote:


http://plone.org/documentation/how-to/threads-vs-cache-size


That article contains little information to back up the conclusions,  
and some of it is patently wrong. Another case of hearsay and half- 
thruths being propagated by well-meaning but uninformed parties.


jens

___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
http://mail.zope.org/mailman/listinfo/zope-announce

http://mail.zope.org/mailman/listinfo/zope-dev )

Re: [Zope] zserver-threads

[Jens Vagelpohl]

On 31 Jan 2006, at 14:59, Jake wrote:

I just spent a few minutes googling it and failed, but I thought I  
read on
the Zope wiki that for higher trafic sites, it was better to have  
bigger

caches (50,000+) and fewer threads (2).


The term "high traffic site" doesn't mean a thing when it comes to  
threads or the cache (or in general). It's way too general.  
Determinations about cache sizes or thread numbers can only be made  
with specific requirements, (estimated) traffic data, hardware  
specifications and knowledge about the Zope application in hand, period.


Less threads and bigger caches only make sense when you are under  
memory pressure and (hopefully) your pages render fast enough so that  
less threads can still satisfy the rendering load.


jens

___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
http://mail.zope.org/mailman/listinfo/zope-announce

http://mail.zope.org/mailman/listinfo/zope-dev )

Re: [Zope] zserver-threads

[Jake]

http://plone.org/documentation/how-to/threads-vs-cache-size

There it was.

Jake
___
http://www.ZopeZone.com


On Tue, January 31, 2006 9:59 am, Jake said:
> I just spent a few minutes googling it and failed, but I thought I read on
> the Zope wiki that for higher trafic sites, it was better to have bigger
> caches (50,000+) and fewer threads (2).
>
> Jake
> ___
> http://www.ZopeZone.com
>
>
> On Mon, January 30, 2006 5:47 pm, Jens Vagelpohl said:
>>
>> On 30 Jan 2006, at 22:43, Einar Næss Jensen wrote:
>>
>>> how many do I need, and how will I know?
>>
>> You do not need to worry about it unless you have a really unusual
>> setup. The default is fine for 99.9% of all situations.
>>
>> jens
>>
>> ___
>> Zope maillist  -  Zope@zope.org
>> http://mail.zope.org/mailman/listinfo/zope
>> **   No cross posts or HTML encoding!  **
>> (Related lists -
>>  http://mail.zope.org/mailman/listinfo/zope-announce
>>  http://mail.zope.org/mailman/listinfo/zope-dev )
>>
>
>
> ___
> Zope maillist  -  Zope@zope.org
> http://mail.zope.org/mailman/listinfo/zope
> **   No cross posts or HTML encoding!  **
> (Related lists -
>  http://mail.zope.org/mailman/listinfo/zope-announce
>  http://mail.zope.org/mailman/listinfo/zope-dev )
>


___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )

Re: [Zope] zserver-threads

[Jake]

I just spent a few minutes googling it and failed, but I thought I read on
the Zope wiki that for higher trafic sites, it was better to have bigger
caches (50,000+) and fewer threads (2).

Jake
___
http://www.ZopeZone.com


On Mon, January 30, 2006 5:47 pm, Jens Vagelpohl said:
>
> On 30 Jan 2006, at 22:43, Einar Næss Jensen wrote:
>
>> how many do I need, and how will I know?
>
> You do not need to worry about it unless you have a really unusual
> setup. The default is fine for 99.9% of all situations.
>
> jens
>
> ___
> Zope maillist  -  Zope@zope.org
> http://mail.zope.org/mailman/listinfo/zope
> **   No cross posts or HTML encoding!  **
> (Related lists -
>  http://mail.zope.org/mailman/listinfo/zope-announce
>  http://mail.zope.org/mailman/listinfo/zope-dev )
>


___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )

Re: [Zope] zserver-threads

[Jens Vagelpohl]

On 30 Jan 2006, at 22:43, Einar Næss Jensen wrote:


how many do I need, and how will I know?


You do not need to worry about it unless you have a really unusual  
setup. The default is fine for 99.9% of all situations.


jens

___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists -
http://mail.zope.org/mailman/listinfo/zope-announce
http://mail.zope.org/mailman/listinfo/zope-dev )

[Zope] zserver-threads

[Einar Næss Jensen]

how many do I need, and how will I know?

--
--
Einar Næss Jensen
http://einar.nidelven-it.no/einarblog
http://www.homemade.no
tlf: +47 90990249
___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists -
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )

RE: [Zope] ZServer threads and pool-size question

[Pascal Peregrina]

Thanks, I will try that ;)

-Message d'origine-
De : Dieter Maurer [mailto:[EMAIL PROTECTED] 
Envoyé : mercredi 4 janvier 2006 19:52
À : Pascal Peregrina
Cc : Jens Vagelpohl; zope list user
Objet : RE: [Zope] ZServer threads and pool-size question

Pascal Peregrina wrote at 2006-1-4 13:34 -:
>I understand.
>
>So what is the typical value to use for pool-size given a certain threads 
>number: n+3 ?

It depends on how intensively you are using additional (application level)
threads:

  Each thread using persistent objects requires in general (at least) one
  ZODB connection.

As such threads are relatively rare, additional 3 connections
is not too bad for the general case.



-- 
Dieter


**
This email and any files transmitted with it are confidential and
intended solely for the use of the individual or entity to whom they
are addressed. If you have received this email in error please notify
the system manager.

This footnote also confirms that this email message has been swept by
MIMEsweeper for the presence of computer viruses.

www.mimesweeper.com
**

___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists -
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )

RE: [Zope] ZServer threads and pool-size question

[Dieter Maurer]

Pascal Peregrina wrote at 2006-1-4 13:34 -:
>I understand.
>
>So what is the typical value to use for pool-size given a certain threads 
>number: n+3 ?

It depends on how intensively you are using additional (application level)
threads:

  Each thread using persistent objects requires in general (at least) one
  ZODB connection.

As such threads are relatively rare, additional 3 connections
is not too bad for the general case.



-- 
Dieter
___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )

RE: [Zope] ZServer threads and pool-size question

[Pascal Peregrina]

Ok, much clearer now... 

I might focus on cache sizes then.

Thanks.

Pascal

-Message d'origine-
De : [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] De la part de Jens Vagelpohl
Envoyé : mercredi 4 janvier 2006 15:17
À : zope list user
Objet : Re: [Zope] ZServer threads and pool-size question


On 4 Jan 2006, at 14:11, Pascal Peregrina wrote:

> So, are you telling me that the ideal configuration is using all  
> default values (connection objects cache size, ZEO cache size,  
> threads and connection pool)?

The default values for thread number and connection pool covers all  
but the most exotic use cases. The cache sizes can benefit greatly  
from experimenting, but there is no standard recipe, it all depends  
on your specific software and hardware environment.

jens

___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )


**
This email and any files transmitted with it are confidential and
intended solely for the use of the individual or entity to whom they
are addressed. If you have received this email in error please notify
the system manager.

This footnote also confirms that this email message has been swept by
MIMEsweeper for the presence of computer viruses.

www.mimesweeper.com
**

___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists -
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )

Re: [Zope] ZServer threads and pool-size question

[Jens Vagelpohl]

On 4 Jan 2006, at 14:11, Pascal Peregrina wrote:

So, are you telling me that the ideal configuration is using all  
default values (connection objects cache size, ZEO cache size,  
threads and connection pool)?


The default values for thread number and connection pool covers all  
but the most exotic use cases. The cache sizes can benefit greatly  
from experimenting, but there is no standard recipe, it all depends  
on your specific software and hardware environment.


jens

___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
http://mail.zope.org/mailman/listinfo/zope-announce

http://mail.zope.org/mailman/listinfo/zope-dev )

RE: [Zope] ZServer threads and pool-size question

[Pascal Peregrina]

So, are you telling me that the ideal configuration is using all default values 
(connection objects cache size, ZEO cache size, threads and connection pool)?

Pascal

-Message d'origine-
De : [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] De la part de Jens Vagelpohl
Envoyé : mercredi 4 janvier 2006 15:02
À : zope list user
Objet : Re: [Zope] ZServer threads and pool-size question


On 4 Jan 2006, at 13:53, Pascal Peregrina wrote:

> Because I use ZEO, I got lots of often modified objects, and on  
> Zope servers I got lots of memory so I can give it a try ;)

Where do you see the gain? More threads and connection also means  
more caches that need to be updated/invalidated when you modify an  
object. You might slow your system down instead.

jens

___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )


**
This email and any files transmitted with it are confidential and
intended solely for the use of the individual or entity to whom they
are addressed. If you have received this email in error please notify
the system manager.

This footnote also confirms that this email message has been swept by
MIMEsweeper for the presence of computer viruses.

www.mimesweeper.com
**

___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists -
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )

Re: [Zope] ZServer threads and pool-size question

[Jens Vagelpohl]

On 4 Jan 2006, at 13:53, Pascal Peregrina wrote:

Because I use ZEO, I got lots of often modified objects, and on  
Zope servers I got lots of memory so I can give it a try ;)


Where do you see the gain? More threads and connection also means  
more caches that need to be updated/invalidated when you modify an  
object. You might slow your system down instead.


jens

___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
http://mail.zope.org/mailman/listinfo/zope-announce

http://mail.zope.org/mailman/listinfo/zope-dev )

RE: [Zope] ZServer threads and pool-size question

[Pascal Peregrina]

Because I use ZEO, I got lots of often modified objects, and on Zope servers I 
got lots of memory so I can give it a try ;)

Pascal

-Message d'origine-
De : [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] De la part de Jens Vagelpohl
Envoyé : mercredi 4 janvier 2006 14:45
À : zope list user
Objet : Re: [Zope] ZServer threads and pool-size question


On 4 Jan 2006, at 13:34, Pascal Peregrina wrote:

> I understand.
>
> So what is the typical value to use for pool-size given a certain  
> threads number: n+3 ?

There is no "typical value". Changing the thread number and pool size  
puts you *way* off-road, fiddling with it should be avoided.

You will have to experiment if you really think you need to change  
that setting. More connections -> more RAM usage.

Makes me wonder why you think that is necessary.

jens

___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )


**
This email and any files transmitted with it are confidential and
intended solely for the use of the individual or entity to whom they
are addressed. If you have received this email in error please notify
the system manager.

This footnote also confirms that this email message has been swept by
MIMEsweeper for the presence of computer viruses.

www.mimesweeper.com
**

___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists -
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )

Re: [Zope] ZServer threads and pool-size question

[Jens Vagelpohl]

On 4 Jan 2006, at 13:34, Pascal Peregrina wrote:


I understand.

So what is the typical value to use for pool-size given a certain  
threads number: n+3 ?


There is no "typical value". Changing the thread number and pool size  
puts you *way* off-road, fiddling with it should be avoided.


You will have to experiment if you really think you need to change  
that setting. More connections -> more RAM usage.


Makes me wonder why you think that is necessary.

jens

___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
http://mail.zope.org/mailman/listinfo/zope-announce

http://mail.zope.org/mailman/listinfo/zope-dev )

RE: [Zope] ZServer threads and pool-size question

[Pascal Peregrina]

I understand.

So what is the typical value to use for pool-size given a certain threads 
number: n+3 ?

Pascal

-Message d'origine-
De : [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] De la part de Jens Vagelpohl
Envoyé : mercredi 4 janvier 2006 14:31
À : zope list user
Objet : Re: [Zope] ZServer threads and pool-size question


On 4 Jan 2006, at 13:23, Pascal Peregrina wrote:

> Hi,
>
> Can anyone tell me why, by default in a zope instance config file,  
> the connection pool size is 7 while the number of zserver threads  
> is 4?
>
> Why not 4 and 4?

Because under some conditions you can actually have more than 4  
connections in use. Not having extra connections available has the  
potential to block the server.

jens

___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )


**
This email and any files transmitted with it are confidential and
intended solely for the use of the individual or entity to whom they
are addressed. If you have received this email in error please notify
the system manager.

This footnote also confirms that this email message has been swept by
MIMEsweeper for the presence of computer viruses.

www.mimesweeper.com
**

___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists -
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )

Re: [Zope] ZServer threads and pool-size question

[Jens Vagelpohl]

On 4 Jan 2006, at 13:23, Pascal Peregrina wrote:


Hi,

Can anyone tell me why, by default in a zope instance config file,  
the connection pool size is 7 while the number of zserver threads  
is 4?


Why not 4 and 4?


Because under some conditions you can actually have more than 4  
connections in use. Not having extra connections available has the  
potential to block the server.


jens

___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
http://mail.zope.org/mailman/listinfo/zope-announce

http://mail.zope.org/mailman/listinfo/zope-dev )

[Zope] ZServer threads and pool-size question

[Pascal Peregrina]

Hi,

 

Can anyone tell me why, by default in a zope instance
config file, the connection pool size is 7 while the number of zserver threads
is 4?

 

Why not 4 and 4?

 

Thanks.

 

Pascal





**
This email and any files transmitted with it are confidential and
intended solely for the use of the individual or entity to whom they
are addressed. If you have received this email in error please notify
the system manager.

This footnote also confirms that this email message has been swept by
MIMEsweeper for the presence of computer viruses.

www.mimesweeper.com
**




___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )

RE: [Zope] zserver blocking behavior with a slow request

[Dieter Maurer]

Jim Abramson wrote at 2005-8-3 14:57 -0400:
> ...
>Interesting.  Are you aware if your colleagues' was a python(/dcoracle2)
>app?

Yes -- on Windows (I think)


-- 
Dieter
___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )

RE: [Zope] zserver blocking behavior with a slow request

[Jim Abramson]

> >I have 8 zserver threads and a ZODB pool size of 10.  I'm fairly 
> >certain I'm not maxing these out.  So is this blocking effect just 
> >expected behavior for zope?
> 
> No, there should be no blocking.
> 
> 
> Although some colleagues reported similar behaviour with a 
> (non Zope/ZServer) multithreaded application connecting to Oracle.
> 
> They could not yet find the cause of their problem...
> 

Interesting.  Are you aware if your colleagues' was a python(/dcoracle2)
app?

thx
Jim


___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists -
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )

RE: [Zope] zserver blocking behavior with a slow request

[Jim Abramson]

 >  > I'm finding that once a user requests a page which runs a 
> particularly slow sql (say up to 5 minutes),  > any other 
> subsequent requests seem to take the hit as well, and return 
> very slowly.
> Take a look at DadlockDebugger product - you'll see what is 
> happening with your Zope threads.
> 

Thanks, this looks quite handy, I am going to give it a whirl (I assume
that threadframe module dependency hasn't yet hosed anyone's Linux
machine - funny how a disclaimer can inspire paranoia)

> Isn't it better idea to execute long running query outside of 
> zope - external method or sth, and only check for results 
> even with simple page reload? We did something like this with 
> pdf generation and this worked as expected, but of course you 
> need some additional work to create such thing.
> 

Yes I agree, in my case those SELECTs aren't *supposed* to be taking 5
minutes.  That's a separate problem.  However when such a problem bites
I don't want all of my users to suffer, just the unlucky one who
requested the doomed sql to be run.

>  > So is this blocking effect just expected behavior for zope?
> We are using Zope and Oracle too, and even 10 threads... and 
> I didn't noticed something like this. What is your processor 
> doing then? What is the CPU(s?) load.

The single CPU isn't loaded at all.  But if DeadlockDebugger doesn't
turn up any good clues I will do some investigating at the system level.

Thanks for advice,
Jim
___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists -
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )

Re: [Zope] zserver blocking behavior with a slow request

[Dieter Maurer]

Jim Abramson wrote at 2005-8-2 13:07 -0400:
> ...
>I have 8 zserver threads and a ZODB pool size of 10.  I'm fairly certain
>I'm not maxing these out.  So is this blocking effect just expected
>behavior for zope?

No, there should be no blocking.


Although some colleagues reported similar behaviour
with a (non Zope/ZServer) multithreaded application
connecting to Oracle.

They could not yet find the cause of their problem...


-- 
Dieter
___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )

Re: [Zope] zserver blocking behavior with a slow request

[Maciej Wisniowski]

> I'm finding that once a user requests a page which runs a 
particularly slow sql (say up to 5 minutes),
> any other subsequent requests seem to take the hit as well, and 
return very slowly.
Take a look at DadlockDebugger product - you'll see what is happening 
with your Zope threads.


Isn't it better idea to execute long running query outside of zope - 
external method or sth,
and only check for results even with simple page reload? We did 
something like this with pdf
generation and this worked as expected, but of course you need some 
additional work to

create such thing.

> So is this blocking effect just expected behavior for zope?
We are using Zope and Oracle too, and even 10 threads... and I didn't 
noticed something

like this. What is your processor doing then? What is the CPU(s?) load.

--
Maciej Wisniowski
___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
http://mail.zope.org/mailman/listinfo/zope-announce

http://mail.zope.org/mailman/listinfo/zope-dev )

Re: [Zope] zserver blocking behavior with a slow request

[Matt Hamilton]

Jim,
  What platform is this on? and is it a uni or multi-processor system. 
 I did a bit of studying a long time ago into performance of Solaris 
with python:


http://www.zope.org/Members/glpb/solaris

not sure how relevant it is now, but if you are running on an old 
solaris box there might be some hints there.


-Matt

Jim Abramson wrote:
On a production Zope (2.7.6) running behind apache and connected to an 
Oracle database,  I'm finding that once a user requests a page which 
runs a particularly slow sql (say up to 5 minutes), any other subsequent 
requests seem to take the hit as well, and return very slowly.


I have 8 zserver threads and a ZODB pool size of 10.  I'm fairly certain 
I'm not maxing these out.  So is this blocking effect just expected 
behavior for zope?  One point of note is that the requests passed from 
apache all bear the remote ip of 127.0.0.1.  Could zserver be throttling 
the incoming requests due to their identical REMOTE_IP (or some other 
apache configuration detail)?  Is there anything else I should investigate?



--
Matt Hamilton   [EMAIL PROTECTED]
Netsight Internet Solutions, Ltd.Business Vision on the Internet
http://www.netsight.co.uk +44 (0)117 9090901
Web Design | Zope/Plone Development & Consulting | Co-location | Hosting
___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
http://mail.zope.org/mailman/listinfo/zope-announce

http://mail.zope.org/mailman/listinfo/zope-dev )

[Zope] zserver blocking behavior with a slow request

[Jim Abramson]

Title: zserver blocking behavior with a slow request






On a production Zope (2.7.6) running behind apache and connected to an Oracle database,  I'm finding that once a user requests a page which runs a particularly slow sql (say up to 5 minutes), any other subsequent requests seem to take the hit as well, and return very slowly.

I have 8 zserver threads and a ZODB pool size of 10.  I'm fairly certain I'm not maxing these out.  So is this blocking effect just expected behavior for zope?  One point of note is that the requests passed from apache all bear the remote ip of 127.0.0.1.  Could zserver be throttling the incoming requests due to their identical REMOTE_IP (or some other apache configuration detail)?  Is there anything else I should investigate?

OH btw, I am using my own connection pool and managing db interface / transactions manually, so ZSQL should not be considered a culprit.  Furthermore I'm watching the connections/pool themselves and they are not maxed either.

Thanks for any help.


Jim



___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )

[Zope] ZServer or Zope.cgi

[Marcus Mendes]

Hello,

I have a newbie question

I'm using Zope on Linux and I have a file Zope.cgi (in my installation zope directory> 
with this contents:

#!/home/Zope-2.2.1-linux2-x86/pcgi/pcgi-wrapper
PCGI_NAME=Zope
PCGI_MODULE_PATH=/home/Zope-2.2.1-linux2-x86/lib/python/Zope
PCGI_PUBLISHER=/home/Zope-2.2.1-linux2-x86/pcgi/pcgi_publisher.py
PCGI_EXE=/home/Zope-2.2.1-linux2-x86/bin/python
PCGI_SOCKET_FILE=/home/Zope-2.2.1-linux2-x86/var/pcgi.soc
PCGI_PID_FILE=/home/Zope-2.2.1-linux2-x86/var/pcgi.pid
PCGI_ERROR_LOG=/home/Zope-2.2.1-linux2-x86/var/pcgi.log
PCGI_DISPLAY_ERRORS=1
BOBO_REALM=/home/Zope-2.2.1-linux2-x86/Zope.cgi
BOBO_DEBUG_MODE=1
INSTANCE_HOME=/home/Zope-2.2.1-linux2-x86


I don't kown if I'm using Zope.cgi or ZSever.
How can I know it? 

Thanks in advance

Marcus Mendes


___
Zope maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope-dev )

Re: [Zope] ZServer

[Dieter Maurer]

Tom Deprez writes:
 > Can anybody tell me what the following warning means, or where I can find
 > documentation on this warning?
 > 
 > ZServer warning : server accept() threw EWOULDBLOCK
You can tell a socket that you do not want to wait.
If you did, then the socket will return EWOULDBLOCK
when you do something that would let you wait.

Usually, you have a "listen" above the "accept".
When the "listen" returns, you know, there is a connection
to "accept". However, if the process that wanted to connect
dies, it might be (with low probability) that "listen" returns
but when "accept" is reached, the request went away.

Because probability is very low, I do not know whether
this is your problem. If it is, however, then you
could simply ignore the error and restart the "listen".


Dieter

___
Zope maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope-dev )

Re: [Zope] ZServer

[Curtis Maloney]

On Thursday 11 January 2001 21:13, Tom Deprez wrote:
> Hi,
>
> Can anybody tell me what the following warning means, or where I can find
> documentation on this warning?
>

Since nobody else has , yet...


> ZServer warning : server accept() threw EWOULDBLOCK
>

Odd... this is a Sockets level error, meaning that the operation (in this 
case accept() ) requested on a non-blocking socket would have caused it to 
block (stall).

> Thanks in advance
>
> Tom Deprez
>


As to what would cause this from the documentation I can find, accept() 
shouldn't produce this error.  And even if it can, it would be a poor program 
design indeed that called accept() when there were no connections pending.

All I can think of immediately is someone went to connect, but dropped the 
connection before the server could react.  Now, the timing we're talking 
about here is likely _very_ slim...  but possible.

Other than that, I'd actually have to look at the source.. (o8

Have a better one,
Curtis Maloney

___
Zope maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope-dev )

[Zope] ZServer

[Tom Deprez]

Hi,

Can anybody tell me what the following warning means, or where I can find
documentation on this warning?

ZServer warning : server accept() threw EWOULDBLOCK

Thanks in advance

Tom Deprez


___
Zope maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope-dev )

RE: [Zope] Using Analog and Zope Zserver

[sean . upton]

A thought for you.  We use analog, and I talked with the person here that
implements it, and he wasn't sure there was a solution.  However, you could
try this:

Set up analog so that all requests are seen as pages
Write a shell script to filter lines from your server log using grep to
search using regexes, piping the output through grep as many times as
possible to run each regex that you need; the final output should be only
pages.

A pain, but once it is automated, you should be ok.

Sean



-Original Message-
From: Scott [mailto:[EMAIL PROTECTED]]
Sent: Saturday, December 09, 2000 10:40 AM
To: [EMAIL PROTECTED]
Subject: [Zope] Using Analog and Zope Zserver


Hi All,

I'm using analog to analyze my server logs, however I can't figure out
how to tell analog to treat everything without an extension as a page. 
Or perhaps more accurately everything without a "." in it's name.  

I have read numerous posts to this list regarding index_html or *_html,
but much of my site is composed of Zwiki pages, which do not follow that
convention.  

I'm currently playing with the regular expression functions, but I'm not
exactly familiar with regex.  

Any ideas?  What is everyone else using when using Zserver, vs. Apache,
IIS, etc.

Thanks - Scott

___
Zope maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope-dev )

___
Zope maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope-dev )

[Zope] Using Analog and Zope Zserver

[Scott]

Hi All,

I'm using analog to analyze my server logs, however I can't figure out
how to tell analog to treat everything without an extension as a page. 
Or perhaps more accurately everything without a "." in it's name.  

I have read numerous posts to this list regarding index_html or *_html,
but much of my site is composed of Zwiki pages, which do not follow that
convention.  

I'm currently playing with the regular expression functions, but I'm not
exactly familiar with regex.  

Any ideas?  What is everyone else using when using Zserver, vs. Apache,
IIS, etc.

Thanks - Scott

___
Zope maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope-dev )

Re: [Zope] Reasons for Apache?? SSL?? (was "Running Mailman CGI under Zope ZServer")

[Cees de Groot]

Joachim Werner <[EMAIL PROTECTED]> said:
>Apache can then also be used to serve
>static parts of your web site, like large documents or images. Also, Apache
>can be used to cache Zope requests. 
>
I use Squid, not Apache as a reverse web proxy in front of Zope. I did a bit
of testing, and you can very well serve your static content from Zope in this
setup - I am planning to assign caching control properties to parts of the 
document structure and make Zope 'kick' Squid for a refresh when cached 
documents are edited. Initial experiments got me 500 requests per second
on cached documents - Zope wasn't touched at all. 

>Regarding your problem: Set up a simple packet filter firewall (most Linux
>distros have scripts for that, e.g. SuSE has "firewals") and don't allow
>access to port 8080.
>
Something like
% ipchains -A input -S 0/0 -d 0/0 8080 -p tcp -j REJECT
should totally block port 8080. If you work from 1.2.3.4, you can do:
% ipchains -I input -S 1.2.3.4/32 -d 0/0 8080 -p tcp -j ACCEPT
and your machine is the only one that can get to this port. If you want
to have this done automagically, create /etc/ipchains.conf:

% cat >/etc/ipchains.conf 
GnuPG 1024D/E0989E8B 0016 F679 F38D 5946 4ECD  1986 F303 937F E098 9E8B

___
Zope maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope-dev )

Re: [Zope] Reasons for Apache?? SSL?? (was "Running Mailman CGI under Zope ZServer")

[Joachim Werner]

> how to. This works well and Apache serves Zope pretty well and we can even
> use SSL (there are some issues to be resolved that I suspect are due to
> misconfiguration on our server). However, I can always access Zope
directly
> using port 8080 (or whatever port where ZServer is listening to) without
> SSL.
>
> This is aboviously not the intended behaviour. Is there a way to prevent
> this? I know there is ZServerSSL but isn't the whole point of using Apache
> that it is a better and more robust web-server than Zserver? (apart from
the
> fact that we need to serve a lot of static content as well).
>
> What are the main resons for serving Zope behind Apache?

A lot of Zope sites (including www.zope.org itself) actually use Apache only
as a proxy server, i.e. Apache doesn't SERVE the content, but just relays
requests to ZServer (you'd need the SiteAccess product on the Zope part for
this configuration option). So you can have different Zope servers serve
parts of the same web site, use Apache to set up virtual servers, or easily
set up SSL for parts of your site. Apache can then also be used to serve
static parts of your web site, like large documents or images. Also, Apache
can be used to cache Zope requests. ZServer (with or without Apache as a
proxy) is definitely faster than any other option (FastCGI, ...).

Regarding your problem: Set up a simple packet filter firewall (most Linux
distros have scripts for that, e.g. SuSE has "firewals") and don't allow
access to port 8080.

Cheers

Joachim.


___
Zope maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope-dev )

Re: [Zope] Running Mailman CGI under Zope ZServer

[Stephan Richter]

At 09:55 AM 11/17/00 -0500, you wrote:
> >Any chance I could take a look at your code?

1. Make a soft link from HOME/OF/MAILMAN/Mailman to HOME/OF/PYTHON/LIBS 
(usually /usr/lib/python1.5).
2. Now you are able to use all the Mailman Python modules in all of you 
Python programs including Zope.
3. The methods (External Methods) I used:

from Mailman import MailList

def addMember(email, passwd):
 mlist = MailList.MailList('members')
 mlist.ApprovedAddMember(email, passwd, 0)
 mlist.Unlock()

def delMember(email):
 mlist = MailList.MailList('members')
 mlist.DeleteMember(email)
 mlist.Unlock()

Note: If you go and read the Mailman source code, you can figure out many 
more functions, that are just the 2 I used to add/delete members.

4. As I mention before, you should run Mailman and Zope as the same user to 
not conflict with the DB permissions. I never fully tested that though.

Regards,
Stephan


--
Stephan Richter
CBU - Physics and Chemistry Student
Web2k - Web Design/Development & Technical Project Management


___
Zope maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope-dev )

Re: [Zope] Reasons for Apache?? SSL?? (was "Running Mailman CGIunder Zope ZServer")

[Aleksander Salwa]

On Fri, 17 Nov 2000, Dario Lopez-Kästen wrote:
> one of my colleagues configure Apache and Zope using the "Apache & ZServer"
> how to. This works well and Apache serves Zope pretty well and we can even
> use SSL (there are some issues to be resolved that I suspect are due to
> misconfiguration on our server). However, I can always access Zope directly
> using port 8080 (or whatever port where ZServer is listening to) without
> SSL.
> 
> This is aboviously not the intended behaviour. Is there a way to prevent
> this? I know there is ZServerSSL but isn't the whole point of using Apache

Look at z2.py options to set IP to listen on. If Zope and Apache are on
the same machine, you can set 127.0.0.1, so Zope won't be accesible from
other hosts. If they are on separate machines, then probably they are
in the same LAN - so you can use some other address not accessible from
outside your LAN.

[EMAIL PROTECTED]

/--\
| `long long long' is too long for GCC |
\--/


___
Zope maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope-dev )

Re: [Zope] Running Mailman CGI under Zope ZServer

[Stephan Richter]

>Second, is Mailman going to be integrated with Zope?  It seems like a
>natural fit.  It would be nice to move away from the pipermail archiving
>and use the Zope object database for archiving messages instead.

I wrote once my own Python Product for Zope that simply imported the 
important methods and wrote my own little scripts on top. It is really 
easy. The only difficulty is to keep the Mailman database permissions 
straight, since they adjust to the executing user after every access. So 
the best is to run Zope and Mailman from the same account.

Regards,
Stephan

--
Stephan Richter
CBU - Physics and Chemistry Student
Web2k - Web Design/Development & Technical Project Management


___
Zope maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope-dev )

[Zope] Reasons for Apache?? SSL?? (was "Running Mailman CGI under Zope ZServer")

[Dario Lopez-Kästen]

> From: "Fred Wilson Horch" <[EMAIL PROTECTED]>
> Sent: Friday, November 17, 2000 2:22 AM
> Subject: [Zope] Running Mailman CGI under Zope ZServer

<...snip...>

> First, am I really the first person to try running CGI scripts from
> ZServer?  I have found some hints here and there of people doing
> somewhat similar things, but I haven't yet found a product for easily
> adding legacy CGI scripts to a Zope site.  It seems most people run Zope
> behind Apache.  Is ZServer really slow or buggy or something?

<...other good stuff snipped...>

I have a similar question. I am planning and building  a site in which about
50% of the content needs to be accessed using SSL only (it's personal
information and we are using 128-bit SSL).

Since I am only the database&web-guy and not a sysadmin-guy (yet :), I had
one of my colleagues configure Apache and Zope using the "Apache & ZServer"
how to. This works well and Apache serves Zope pretty well and we can even
use SSL (there are some issues to be resolved that I suspect are due to
misconfiguration on our server). However, I can always access Zope directly
using port 8080 (or whatever port where ZServer is listening to) without
SSL.

This is aboviously not the intended behaviour. Is there a way to prevent
this? I know there is ZServerSSL but isn't the whole point of using Apache
that it is a better and more robust web-server than Zserver? (apart from the
fact that we need to serve a lot of static content as well).

What are the main resons for serving Zope behind Apache?

Thanks for any input,

Sincerley,

/dario

- 
Dario Lopez-Kästen Systems Developer  Chalmers Univ. of Technology
[EMAIL PROTECTED]  ICQ will yield no hitsIT Systems & Services


___
Zope maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope-dev )

[Zope] Running Mailman CGI under Zope ZServer

[Fred Wilson Horch]

Hello out there,

I'm looking for someone with some more Zope "Zen" to help me figure out
how to add support for legacy CGI scripts (specifically Mailman 1.1) to
Zope.

To recap, I know and understand how to get Apache to play nicely with
Zope.  What I'm trying to do is remove the need for Apache by allowing
ZServer to serve CGI scripts itself.  The motivation is to allow me to
run Mailman 1.1 on my Zope site without having to have Apache (or any
other web server) configured and running.

First, am I really the first person to try running CGI scripts from
ZServer?  I have found some hints here and there of people doing
somewhat similar things, but I haven't yet found a product for easily
adding legacy CGI scripts to a Zope site.  It seems most people run Zope
behind Apache.  Is ZServer really slow or buggy or something?

Second, is Mailman going to be integrated with Zope?  It seems like a
natural fit.  It would be nice to move away from the pipermail archiving
and use the Zope object database for archiving messages instead.

Third, thanks to code from Eric Walstad and Chris Withers (author of
PathHandler), I have hacked up an external method that sort of works. 
It attempts to add to Zope the functionality of ScriptAlias in Apache.

But I'm running into some problems with the HTTP header.  The attached
code simply ignores the HTTP header sent by the Mailman CGI script,
letting Zope do its thing.  But this becomes a problem when Mailman
wants to set cookies for authentication.

Can anyone help me figure out how to convince Zope to let the CGI script
send both the HTTP header and message body?

Thanks,
Fred

Here's my external method.  It is called by a Path Handler object.

Some notes:

1)  REQUEST['PATH_INFO'] seems to be brain dead
2)  the path_to_handle key is inserted by the PathHandler product
3)  this is written for Linux; I'm not sure how Windows handles os.popen
4)  I don't understand why sometimes this function gets called with one
argument and sometimes with two -- I always just ignore the second
argument

import os, os.path, string

def testing(self, second=None):

if self.REQUEST.has_key('path_to_handle'):
script = self.REQUEST['path_to_handle'][0]
if script:
script_path = '/home/mailman/cgi-bin/%s' % script
if os.path.isfile(script_path):
ENV = ''
if len(self.REQUEST['path_to_handle']) > 1:
ENV = ENV + 'PATH_INFO=/%s' %
string.join(self.REQUEST['path_to_handle'][1:],'/')
elif self.REQUEST['PATH_INFO'][-1] == '/':
ENV = ENV + 'PATH_INFO=/'
ENV = ENV + ' HTTP_HOST=%s' % self.REQUEST['HTTP_HOST']
ENV = ENV + ' SERVER_NAME=%s' %
self.REQUEST['SERVER_NAME']
f = os.popen("/usr/bin/env %s %s" % \
 (ENV,
  script_path))
header = 1
while header:
if (f.readline() == '\n'):
header = 0
output = f.read()  # grab the output of the CGI here
status = f.close()
else:
return '%s: CGI script not found.' % script
else:
return 'No CGI script specified.'
else:
return 'No path to handle.'

return output + '' + str(self.REQUEST.keys()) + '' +
str(self.REQUEST)

___
Zope maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope-dev )

Re: [Zope] ZServer serving CGI by itself

[Fred Wilson Horch]

Eric,

Thank you very much for the example code.  That basically does what I
want.

However, I have a couple of added complexities.

First, I have a lot of scripts, not just one.  I'd like to have the
equivalent of a ScriptAlias in Apache, where I can tell Zope to treat
everything in a certain directory as a CGI script.

Second, my scripts do funky things like set cookies for authentication. 
So I need to tell Zope to basically get out of the way after calling the
CGI script.  (Specifically, I don't want Zope sending the HTTP header.)

Third, some of my scripts are long running processes and I'd like to be
able to send results back to the client unbuffered.  With Apache 1.3.x,
I'm able to run Python scripts with the -u flag to the Python
interpreter to force unbuffered output (i.e. you see the progress
instead of having to wait for the script to finish).

I'm thinking of writing a CGIScript product to handle this.  My idea is
that I could add a CGIScript object to any Zope folder, setting
parameters as appropriate.  Parameters could include:

1) name of CGI script to execute on host machine or name of directory
containing CGI scripts
2) buffer output
3) script sends HTTP headers
4) environment variables
5) exception handling

Has a general CGI product in Zope already been done?  I've already
written a few external methods in testing Zope, which is easy enough,
but haven't yet tried to write a product.  How hard is it?  Anyone have
any advice (aside from go with the flow and run Zope behind Apache)?

Thanks,
Fred

P.S.  Is standard_error_message broken in Zope 2.2.2?  I couldn't figure
out how to use error_value without the code in
lib/python/ZPublisher/HTTPResponse.py throwing in extra  tags.  I
finally just edited that file and things seem to be working.  Running
with or without the -D flag didn't make any difference.

Eric Walstad wrote:
> 
> I have a C++ program I run from Zope and then return the results to Zope.
> Just like you described, I farm the work out to an external method which
> runs the CGI, grabs the results and hands them back to Zope.  Be sure to
> hard code the line that calls your CGI.  Otherwise, the External Method
> could be used to call any (potentially damaging) code on your Linux box.
[snip]

___
Zope maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope-dev )

RE: [Zope] ZServer serving CGI by itself

[Eric Walstad]

Oops, replace "gashtg" with "interestingValue" below.  Sorry I missed
t.  -E
... "ws.calc.results.gashtg">
should be
... "ws.calc.results.interestingValue">


___
Zope maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope-dev )

RE: [Zope] ZServer serving CGI by itself

[Eric Walstad]

Hi Fred,
// I haven't seen any documentation on how to add CGI capability to Zope.
//
// Before I spend my time writing a product or external method that allows
// me to call CGI programs from inside Zope, has anyone else already done
// this?
I have a C++ program I run from Zope and then return the results to Zope.
Just like you described, I farm the work out to an external method which
runs the CGI, grabs the results and hands them back to Zope.  Be sure to
hard code the line that calls your CGI.  Otherwise, the External Method
could be used to call any (potentially damaging) code on your Linux box.

The (simplified) DTML Method "displayResults":

  <- This creates and initializes an object with the
External Method
The initial gas heating usage: 
The simulation method is invoked: 
<- This invokes the Simulate method of the ws object, which is what calls
the CGI
The gas heating usage after the simulation:  <- this displays the results of the
CGI call




The (simplified) External Method "CWebCGI":
import sys, os, string

class CResults:
"Container for results"
def __init__(self):
self.interestingValue = 0.0

class CCalc:
"Container for calculation data"
def __init__(self):
self.results = CResults()
self.parameters = "enter your CGI's parameter(s) here (if any)"#
Note this file is on the Linux Hard Drive, not the ZODB


class CWebCGI:
"Container for the simulation"
def __init__(self):
self.calc = CCalc()
self.execPath = "/path/to/the/CGIprogram"# Note this file is on
the Linux Hard Drive, not the ZODB.

def simulate(self):
f = os.popen(self.execPath + " " + self.calc.parameters)
lines = f.readlines()  # grab the output of the CGI here
status = f.close()
self.calc.results.interestingValue = string.split(lines[0], "=")[1]

def wsFactory():# <- This is the "Function Name" of the 
External Method
return CWebCGI()


//
// Thanks for the bandwidth,
// Fred
Hope it helps,

Eric.


___
Zope maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope-dev )

[Zope] ZServer serving CGI by itself

[Fred Wilson Horch]

Hi folks,

I'm evaluating Zope.  We have existing CGI programs (such as mailman)
that we'd like to run, but we don't want to hassle with running two web
servers.

So, my question is, how do you run CGI programs from ZServer itself?

I know that I can run Apache (or a number of other web servers) to serve
CGI programs.  I don't want to do that.  I want to run just one web
server -- ZServer.

I haven't seen any documentation on how to add CGI capability to Zope.

Before I spend my time writing a product or external method that allows
me to call CGI programs from inside Zope, has anyone else already done
this?

Thanks for the bandwidth,
Fred

P.S.  If anyone has implementation ideas, I'd like to hear them.  I
assume I can just write a Python function to pass along standard in and
the environment variables to the CGI program, execute it in a shell and
collect standard out back.  BTW, this will be running exclusively under
Linux.

P.P.S.  What is the deal with mailman?  Why isn't mailman integrated
with Zope yet?

___
Zope maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope-dev )

Re: [Zope] ZServer log buffer?

[Toby Dickenson]

On Thu, 02 Nov 2000 21:16:07 WET, "Júlio Dinis Silva"
<[EMAIL PROTECTED]> wrote:

>Supose you are saving z2.log on a mounted disk, either nfs linux or a WinNT 
>cluster network name. If for some seconds that mounted disk became 
>unavailable, isnt supose ZServer log system to buffer a little until the 
>mounted resource became available again?
>I'm dealing with the problem that z2.log "write system" on NT are giving me 
>a IOError when the resource becames unavailable for some seconds.

Why not get Zope to log into local storage, and merge the logs
offline.


>If there isnt anything already to fix this, wouldnt be good if ZServer 
>buffer a "little" until the resource became available and in the case the 
>resource just completelly cease to be then ZServer just stop to write logs, 
>instead of killing the process raising the exception?

You can think of the local log as a buffer, if you prefer ;-)


Toby Dickenson
[EMAIL PROTECTED]

___
Zope maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope-dev )

[Zope] ZServer log buffer?

[Júlio Dinis Silva]

Hi all.

Supose you are saving z2.log on a mounted disk, either nfs linux or a WinNT 
cluster network name. If for some seconds that mounted disk became 
unavailable, isnt supose ZServer log system to buffer a little until the 
mounted resource became available again?
I'm dealing with the problem that z2.log "write system" on NT are giving me 
a IOError when the resource becames unavailable for some seconds.

If there isnt anything already to fix this, wouldnt be good if ZServer 
buffer a "little" until the resource became available and in the case the 
resource just completelly cease to be then ZServer just stop to write logs, 
instead of killing the process raising the exception?

I know what you are thinking: just dont permit the resource to became 
unavailable dude! But supose you have active-passive resources in case of 
fail down and you need some seconds to automatically or by hand(not the 
case) fix the resource, wouldnt be nice for ZSERVER to, for instance, stop 
logging.

Maybe this should not be addressed to Zope Log writes. Maybe
this is more a system administration issue but...

Thanx anyway for some comments.

Júlio Dinis Silva
_
Get Your Private, Free E-mail from MSN Hotmail at http://www.hotmail.com.

Share information about yourself, create your own public profile at 
http://profiles.msn.com.


___
Zope maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope-dev )

Re: [Zope] ZServer going down ??

[Dieter Maurer]

Marc Gehling writes:
 > my zserver is often going down. this is my nohup.out-log on linux red
 > hat. Any Idea ?
 > 
 > 
 > 2000-09-12T15:27:17 ERROR(200) ZServer uncaptured python exception,
 > closing chan
 > nel  request
 > s:1> (socket.error:(9, 'Bad file descriptor')
 > [/usr/local/dc/Zope-2.1.4-linux2-x
 > 86/ZServer/medusa/asynchat.py|initiate_send|211]
 > [/usr/local/dc/Zope-2.1.4-linux
 > 2-x86/ZServer/medusa/http_server.py|send|400]
 > [/usr/local/dc/Zope-2.1.4-linux2-x
 > 86/ZServer/medusa/asyncore.py|send|237])
I sometimes got this message, when a browser closed the connection
before it got a reply from Zope.
However, my ZServer recovered without any problem.
As your message indicates, it simply closed the channel
and continued to work.


Dieter

___
Zope maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope-dev )

[Zope] ZServer going down ??

[Marc Gehling]

Hello,

my zserver is often going down. this is my nohup.out-log on linux red
hat. Any Idea ?


2000-09-12T15:27:17 ERROR(200) ZServer uncaptured python exception,
closing chan
nel  (socket.error:(9, 'Bad file descriptor')
[/usr/local/dc/Zope-2.1.4-linux2-x
86/ZServer/medusa/asynchat.py|initiate_send|211]
[/usr/local/dc/Zope-2.1.4-linux
2-x86/ZServer/medusa/http_server.py|send|400]
[/usr/local/dc/Zope-2.1.4-linux2-x
86/ZServer/medusa/asyncore.py|send|237])


___
Zope maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope-dev )

Re: [Zope] ZServer Statistics

[J. Atwood]

I have Analog running on a bunch of Zope servers (some behind Apache some
not) here are the only lines that make a difference.

LOGFILE /usr/local/zope/var/Z2.log

DIRSUFFIX index_html

I know that seems simple but that is all the is custom in my analog.cfg that
I took from the examples/big.cfg and made those two changes to (and a lot of
others that are site specific).

The best thing to do is get down and dirty with the fairly-good
documentation.

J


> From: [EMAIL PROTECTED]
> Date: Mon, 11 Sep 2000 14:54:26 -0500
> To: [EMAIL PROTECTED]
> Subject: Re: [Zope] ZServer Statistics
> 
> 
>>>> Is there way to determine how many (and which)pages
>>>> ZServer serves? I am running ZServer as my primary
>>> 
>>> Have a look into
>>> 
>>> /path_to_your_zope/var/Z2.log
>> 
>> And run a log analyzer like Analog (http://www.analog.cx) on it.
> 
> Analog is a great tool and I have used it under other Web Servers.
> 
> I wonder if anyone has a working config file which can read the Zope
> logs and would be willing to share with everyone.
> 
> I'd be happy to write one, but being realistic since it has been on my
> to-do list for six months  ( I believe that it is item number 351 ;-$ ) I
> would
> be fooling myself to think that I could do it in a reasonable time for
> everyone.
> 
> 
> 
> 
> 
> ___
> Zope maillist  -  [EMAIL PROTECTED]
> http://lists.zope.org/mailman/listinfo/zope
> **   No cross posts or HTML encoding!  **
> (Related lists - 
> http://lists.zope.org/mailman/listinfo/zope-announce
> http://lists.zope.org/mailman/listinfo/zope-dev )
> 
> 


___
Zope maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope-dev )

Re: [Zope] ZServer Statistics

[rgines]

>>> Is there way to determine how many (and which)pages
>>> ZServer serves? I am running ZServer as my primary
>>
>> Have a look into
>>
>> /path_to_your_zope/var/Z2.log
>
>And run a log analyzer like Analog (http://www.analog.cx) on it.

Analog is a great tool and I have used it under other Web Servers.

I wonder if anyone has a working config file which can read the Zope
logs and would be willing to share with everyone.

I'd be happy to write one, but being realistic since it has been on my
to-do list for six months  ( I believe that it is item number 351 ;-$ ) I
would
be fooling myself to think that I could do it in a reasonable time for
everyone.





___
Zope maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope-dev )

Re: [Zope] ZServer Statistics

[J. Atwood]

>> Is there way to determine how many (and which)pages
>> ZServer serves? I am running ZServer as my primary
> 
> Have a look into
> 
> /path_to_your_zope/var/Z2.log

And run a log analyzer like Analog (http://www.analog.cx) on it.

J


___
Zope maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope-dev )

Re: [Zope] ZServer stepping on Content-Type and Content-Length?

[Dieter Maurer]

Jeff Hoffman writes:
 > 
 > In the index_html method, I have:
 > 
 >   RESPONSE.setHeader('Content-Type', 'video/foo')
 >   RESPONSE.setHeader('Content-Length', 1212)
 > 
 > However, when I telnet to my web port and do:
 > 
 >   HEAD /path/to/myfile.mpg HTTP/1.0
 > 
 > I get:
 > 
 >   Content-Type: video/mpeg
 >   Content-Length: 0

The problem is, that a HEAD request does not execute
"index_html".
Instead, the "HEAD" method from "webdav.Resource" is
called.
It uses a "content_type" and "get_size" attribute/method
to set the "Content-Type" and "Content-Length" HTTP header.
If there is no "content_type" attribute/method, the
content type is guessed (via "mimetypes.guess_type").
If there is no "get_size", the "Content-Length" is 0.


Dieter

___
Zope maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope-dev )

[Zope] ZServer stepping on Content-Type and Content-Length?

[Jeff Hoffman]

Hello,

I am playing around with the new ExtFile product released a few days ago,
in addition to a similar product I wrote myself. Both are exhibiting an
unusual behavior. In the index_html method, I have:

  RESPONSE.setHeader('Content-Type', 'video/foo')
  RESPONSE.setHeader('Content-Length', 1212)

Then, I return the file data. If I launch python and do:

  import Zope, ZPublisher
  ZPublisher.Zope('/path/to/myfile.mpg', d=1)

I can trace the execution of these lines. The headers are set correctly in
the response and, as far as I can tell, are returned correctly in the last
statement my trace executed ("return response").

However, when I telnet to my web port and do:

  HEAD /path/to/myfile.mpg HTTP/1.0

I get:

  Content-Type: video/mpeg
  Content-Length: 0

Remember, I set content-type to video/foo, and length to 1212. These have
been stepped on, I believe, by ZServer. I found this section in 
ZServer/medusa/default_handler.py:

  request['Last-Modified'] = http_date.build_http_date (mtime)
  request['Content-Length'] = file_length
  self.set_content_type (path, request)

While I don't know, for sure, that this is what's causing my problem, it
looks suspect to me.

The curious thing is, using Zope's File object (defined in
lib/python/OFS/Image.py), I get the correct Content-Length coming back. I
did not check to see if Content-Type was overwritten or not. As far as I
can tell, there is no difference in the way my code returns the file data
versus the way Zope's File object does.

Anyone know what's going on?

--Jeff

---
Jeff K. Hoffman   704.849.0731 x108
Chief Technology Officer  mailto:[EMAIL PROTECTED]
Going Virtual, L.L.C. http://www.goingv.com/


___
Zope maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope-dev )

[Zope] Zserver+Apache ProxyPass beats Apache + Zope CGI?

[Chris Withers]

Corey wrote:
> I keep seeming to notice that the docs are constantly referring
> to Zserver as the recomended choice for the http backend. Why
> is this?  Should I not attempt to integrate our Apache server
> with Zope, and simply use Zserver instead?

Well, ZServer seems to be the best way to go.

...that is opposed to doing it with PGCI or FastCGI

Apache still makes a good bulletproof front end, but use to to proxypass
through to ZServer ratehr than running Zope as CGI.

cheers,

Chris

___
Zope maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope-dev )

Re: [Zope] Zserver vs Apache

[J. Atwood]

(man this is coming up a lot today)

It is not ZServer vs Apache but ZServer alone or behind Apache. Either way
you are using ZServer.

ZServer will do all of your http requests and as a stand alone server it
will work just fine. It is faster than putting Apache in front of it and is
certainly easier to set up. It does not however offer SSL (think there is a
product for this) and if you are in a mixed environment (meaning you don't
control the webserver) it is easier to put behind Apache (many ways). I have
a couple different sites doing to both ways. I, PERSONALLY, like ZServer
alone. I find the logging situation better, the speed better and is less
things running on the server.

J

> From: Corey <[EMAIL PROTECTED]>
> Date: Thu, 17 Aug 2000 09:57:00 -0700
> To: [EMAIL PROTECTED]
> Subject: [Zope] Zserver vs Apache
> 
> I keep seeming to notice that the docs are constantly referring
> to Zserver as the recomended choice for the http backend. Why
> is this?  Should I not attempt to integrate our Apache server
> with Zope, and simply use Zserver instead?
> 
> 
> Thanks,
> 
> Corey
> 
> 
> ___
> Zope maillist  -  [EMAIL PROTECTED]
> http://lists.zope.org/mailman/listinfo/zope
> **   No cross posts or HTML encoding!  **
> (Related lists - 
> http://lists.zope.org/mailman/listinfo/zope-announce
> http://lists.zope.org/mailman/listinfo/zope-dev )
> 
> 


___
Zope maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope-dev )

[Zope] Zserver vs Apache

[Corey]

I keep seeming to notice that the docs are constantly referring
to Zserver as the recomended choice for the http backend. Why
is this?  Should I not attempt to integrate our Apache server
with Zope, and simply use Zserver instead?


Thanks,

Corey


___
Zope maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope-dev )

Re: [Zope] ZServer Statistics

[J. Atwood]

At 8:31 AM -0700 7/21/2000, Demos Economacos wrote:
>Is there way to determine how many (and which)pages
>ZServer serves? I am running ZServer as my primary
>server. What kind of statistics should I be looking
>for?

Zope writes to a log file called "Z2.log" which in log terms is a 
"combined log file" format. You should be able to run any log 
analysis package against it and get most of the information you want. 
If you want to pay for a GUI go for Webtrends, otherwise you can use 
very powerful and free Analog (http://www.analog.cx) which can be 
customized to do almost anything.

>For example should I be concerned about how long it
>takes to load pages, and how long users stay on a
>specific page etc?

For that kind of information you need to do some pretty tricky 
mathematics that are not always very accurate.

J

___
Zope maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope-dev )

Re: [Zope] ZServer Statistics

[Robert Wohlfahrt]

Hi,

> Is there way to determine how many (and which)pages
> ZServer serves? I am running ZServer as my primary

Have a look into

/path_to_your_zope/var/Z2.log 

Robert
-- 
Robert Wohlfahrt ([EMAIL PROTECTED])
Tel: 0179 / 2980074 Fax: 0351 / 2880145

___
Zope maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope-dev )

[Zope] ZServer Statistics

[Demos Economacos]

Is there way to determine how many (and which)pages
ZServer serves? I am running ZServer as my primary
server. What kind of statistics should I be looking
for? 

For example should I be concerned about how long it
takes to load pages, and how long users stay on a
specific page etc? 

I am new to website management and would appreciate
any and all suggestions.

Thanks in advance.

Demos

__
Do You Yahoo!?
Get Yahoo! Mail – Free email you can access from anywhere!
http://mail.yahoo.com/

___
Zope maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope-dev )

Re: [Zope] ZServer+SiteAccess+Apache+SSL

[T.J. Mannos]

Wayne,

I just wrote a HOWTO documenting how to do exactly that.  One thing that I
didn't mention (that I probably should have) is that communication between
Apache and ZServer is not necessarily secure, so you'll definitely want them
both on the same machine!

http://www.zope.com/Members/unfo/apche_zserver_ssl/index_html

Good luck,
T.J.

- Original Message -
From: Wayne Izatt <[EMAIL PROTECTED]>
To: <[EMAIL PROTECTED]>
Sent: Tuesday, June 20, 2000 1:11 AM
Subject: [Zope] ZServer+SiteAccess+Apache+SSL


> I've just managed to get ZServer running behind Apache with SiteAccess
> (thanks for the how-to, anser!)
>
> Now, has anyone managed to configure SSL into a mix like this? Seems to
> me I should be able to go through the standard SSL setup for Apache, and
> not worry too much more abou the ZServer component of the architecture.
>
> thanks
>
> Wayne
>
>
> ___
> Zope maillist  -  [EMAIL PROTECTED]
> http://lists.zope.org/mailman/listinfo/zope
> **   No cross posts or HTML encoding!  **
> (Related lists -
>  http://lists.zope.org/mailman/listinfo/zope-announce
>  http://lists.zope.org/mailman/listinfo/zope-dev )
>
>


___
Zope maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope-dev )

RE: [Zope] ZServer+SiteAccess+Apache+SSL

[Steve Drees]

> -Original Message-
> From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED]]On Behalf Of T.J.
> Mannos
> Sent: Wednesday, June 21, 2000 9:42 AM
> To: IPM Return requested Receipt notification requested
> Subject: RE: [Zope] ZServer+SiteAccess+Apache+SSL
>
>
> I got Apache+mod_ssl+OpenSSL working, and I just threw it into the mix.  I
> have two virtual hosts, one HTTP on port 80 and one SSL on port 443.  Both
> do nothing but ProxyPass to the same http:// address on port
> 9080.  I don't
> know if I like that solution, though.
>
> This solution "looks" secure, but I'm not so sure.  It's a secure
> connection
> between the client and the server, and, since Zope and Apache are on the
> same machine, there's no insecure communication over our LAN.
> However, if I
> happen to have a hacker running a packet sniffer on my server,
> I'm screwed.

If you have a hacker running a sniffer on your server you are screwed
regardless of your system configuration.


___
Zope maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope-dev )

RE: [Zope] ZServer+SiteAccess+Apache+SSL

[T.J. Mannos]

I got Apache+mod_ssl+OpenSSL working, and I just threw it into the mix.  I
have two virtual hosts, one HTTP on port 80 and one SSL on port 443.  Both
do nothing but ProxyPass to the same http:// address on port 9080.  I don't
know if I like that solution, though.

This solution "looks" secure, but I'm not so sure.  It's a secure connection
between the client and the server, and, since Zope and Apache are on the
same machine, there's no insecure communication over our LAN.  However, if I
happen to have a hacker running a packet sniffer on my server, I'm screwed.

Any comments on this?  I may just have to go the hard way and do
Apache+fastcgi...?

--- In [EMAIL PROTECTED], Wayne Izatt <[EMAIL PROTECTED]> wrote:
> I've just managed to get ZServer running behind Apache with SiteAccess
> (thanks for the how-to, anser!)
>
> Now, has anyone managed to configure SSL into a mix like this? Seems to
> me I should be able to go through the standard SSL setup for Apache, and
> not worry too much more abou the ZServer component of the architecture.
>
> thanks
>
> Wayne
>
>
> ___
> Zope maillist  -  [EMAIL PROTECTED]
> http://lists.zope.org/mailman/listinfo/zope
> **   No cross posts or HTML encoding!  **
> (Related lists -
>  http://lists.zope.org/mailman/listinfo/zope-announce
>  http://lists.zope.org/mailman/listinfo/zope-dev )


___
Zope maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope-dev )

[Zope] ZServer+SiteAccess+Apache+SSL

[Wayne Izatt]

I've just managed to get ZServer running behind Apache with SiteAccess
(thanks for the how-to, anser!)

Now, has anyone managed to configure SSL into a mix like this? Seems to
me I should be able to go through the standard SSL setup for Apache, and
not worry too much more abou the ZServer component of the architecture.

thanks

Wayne


___
Zope maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope-dev )

[Zope] ZServer (Zope 2.1.6) thread synchronization bug -- with workaround

[Dr. Dieter Maurer]

ZServer contains a thread synchronization bug
exposed when the HTTP streaming protocol
(i.e. RESPONSE.write) is used.

For large responses, the reponse is written
to a temporary file and the distribution
thread receives "file_part_producer" requests.
Writing to the tempfile uses "seek => write"
in the request thread; reading the tempfile
uses "seek => read" in the distribution thread.
The threads are not synchronized. This may
result in loss of response data: broken or buggy
images/files.


The following patch removes the use of
a tempfile. This, of cause, is only a
crude workaround.

Dieter
***
--- ZServer/:HTTPResponse.pyMon Jan 24 20:17:53 2000
+++ ZServer/HTTPResponse.py Thu Jun  8 09:01:31 2000
@@ -239,7 +239,9 @@
 try:
 if type(l) is type(''): l=string.atoi(l)
 if l > 128000:
-self._tempfile=tempfile.TemporaryFile()
+   # don't! exposes a thread synchronization problem
+# self._tempfile=tempfile.TemporaryFile()
+   pass
 except: pass
 
 stdout.write(str(self))


___
Zope maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope-dev )