Re: [Zope-dev] ZEO on SMP
Hi Dyon, --On Donnerstag, 24. Mai 2001 05:07 +1000 Dyon Balding [EMAIL PROTECTED] wrote: Tino, Thanks for your reply. When you say it works fine on a dual processor machine, are you saying that a single ZEO client fully utilises both processors? or that you are running two ZEO clients successfully? I'm running 2 clients at the same time (actually I'm running 3: 2 clients for HTTP requests and one client for FTP) Unfortunately I'm currently stuck with Windows due to both political reasons, and because we are interfacing to a large SQLServer database. political reasons... will they never lern... However, we are using strange databases with ZmxODBCDA/mxODBC and Merant (http://www.merant.com) middleware. This way we only have one NT Box to access the databases. Regards Tino -d On Wed, May 23, 2001 at 08:44:59PM +0200, Tino Wildenhain wrote: Hi Dyon, ZEO on a dual processor machine runs fine for me. I'm using redhat-linux for the server (ZEO and Clients on same machine) If you dont need strange things I would not recommend Win2k as server platform. Best regards Tino Wildenhain --On Mittwoch, 23. Mai 2001 11:35 -0700 Dyon Balding [EMAIL PROTECTED] wrote: Hi, We are setting up a cluster of ZEO clients on dual processor machines. From some experiments and from searching through the mailing lists, it appears that a single Zope process will not take full advantage of the two processors. The solution would appear to be to run two ZEO clients on each server. This, however, is causing problems. I can successfully run two Zope (non-ZEO) processes on a single machine, but two ZEO clients don't seem to coexist nicely on the Windows 2000 machine. The second client to start will accept connections, but never responds with anything. Zope: 2.3.2, ZEO: 1.0b3, Windows 2k for clients, Linux and Windows 2k for storage server. Is there a better solution? If not, has anyone come across this problem? Any pointers appreciated -d ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope ) -- Dyon Balding [EMAIL PROTECTED] ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] ZEO on SMP
Hi Dyon, ZEO on a dual processor machine runs fine for me. I'm using redhat-linux for the server (ZEO and Clients on same machine) If you dont need strange things I would not recommend Win2k as server platform. Best regards Tino Wildenhain --On Mittwoch, 23. Mai 2001 11:35 -0700 Dyon Balding [EMAIL PROTECTED] wrote: Hi, We are setting up a cluster of ZEO clients on dual processor machines. From some experiments and from searching through the mailing lists, it appears that a single Zope process will not take full advantage of the two processors. The solution would appear to be to run two ZEO clients on each server. This, however, is causing problems. I can successfully run two Zope (non-ZEO) processes on a single machine, but two ZEO clients don't seem to coexist nicely on the Windows 2000 machine. The second client to start will accept connections, but never responds with anything. Zope: 2.3.2, ZEO: 1.0b3, Windows 2k for clients, Linux and Windows 2k for storage server. Is there a better solution? If not, has anyone come across this problem? Any pointers appreciated -d ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope ) ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] ZEO on SMP
Tino, Thanks for your reply. When you say it works fine on a dual processor machine, are you saying that a single ZEO client fully utilises both processors? or that you are running two ZEO clients successfully? Unfortunately I'm currently stuck with Windows due to both political reasons, and because we are interfacing to a large SQLServer database. -d On Wed, May 23, 2001 at 08:44:59PM +0200, Tino Wildenhain wrote: Hi Dyon, ZEO on a dual processor machine runs fine for me. I'm using redhat-linux for the server (ZEO and Clients on same machine) If you dont need strange things I would not recommend Win2k as server platform. Best regards Tino Wildenhain --On Mittwoch, 23. Mai 2001 11:35 -0700 Dyon Balding [EMAIL PROTECTED] wrote: Hi, We are setting up a cluster of ZEO clients on dual processor machines. From some experiments and from searching through the mailing lists, it appears that a single Zope process will not take full advantage of the two processors. The solution would appear to be to run two ZEO clients on each server. This, however, is causing problems. I can successfully run two Zope (non-ZEO) processes on a single machine, but two ZEO clients don't seem to coexist nicely on the Windows 2000 machine. The second client to start will accept connections, but never responds with anything. Zope: 2.3.2, ZEO: 1.0b3, Windows 2k for clients, Linux and Windows 2k for storage server. Is there a better solution? If not, has anyone come across this problem? Any pointers appreciated -d ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope ) -- Dyon Balding [EMAIL PROTECTED] ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
RE: [Zope-dev] ZEO on SMP
If I understand your scenario, you are trying to run two instances of Zope on a single machine, talking to a ZEO server? That won't work :) Neither Unix nor Windows knows what to do with two processes trying to open the same port for listen. I'm surprised the second Zope instance even starts. If you want to try it, start each instance of Zope on different ports, then use some kind of ipforwarding/load balancer on the box to route connections to port 80 to either of your Zope servers (say 8081 and 8082). -Randy -Original Message- From: Dyon Balding [mailto:[EMAIL PROTECTED]] Sent: Wednesday, May 23, 2001 12:08 PM To: Tino Wildenhain Cc: [EMAIL PROTECTED] Subject: Re: [Zope-dev] ZEO on SMP Tino, Thanks for your reply. When you say it works fine on a dual processor machine, are you saying that a single ZEO client fully utilises both processors? or that you are running two ZEO clients successfully? Unfortunately I'm currently stuck with Windows due to both political reasons, and because we are interfacing to a large SQLServer database. -d On Wed, May 23, 2001 at 08:44:59PM +0200, Tino Wildenhain wrote: Hi Dyon, ZEO on a dual processor machine runs fine for me. I'm using redhat-linux for the server (ZEO and Clients on same machine) If you dont need strange things I would not recommend Win2k as server platform. Best regards Tino Wildenhain --On Mittwoch, 23. Mai 2001 11:35 -0700 Dyon Balding [EMAIL PROTECTED] wrote: Hi, We are setting up a cluster of ZEO clients on dual processor machines. From some experiments and from searching through the mailing lists, it appears that a single Zope process will not take full advantage of the two processors. The solution would appear to be to run two ZEO clients on each server. This, however, is causing problems. I can successfully run two Zope (non-ZEO) processes on a single machine, but two ZEO clients don't seem to coexist nicely on the Windows 2000 machine. The second client to start will accept connections, but never responds with anything. Zope: 2.3.2, ZEO: 1.0b3, Windows 2k for clients, Linux and Windows 2k for storage server. Is there a better solution? If not, has anyone come across this problem? Any pointers appreciated -d ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope ) -- Dyon Balding [EMAIL PROTECTED] ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope ) ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] ZEO on SMP
They are listening on different ports, (80 and 81) in my test case. And yes, there will be a load balancer in front of them (there will be 15 dual processor servers) to make the cluster appear like one machine. -dyon On Wed, May 23, 2001 at 12:38:25PM -0700, Randall F. Kern wrote: If I understand your scenario, you are trying to run two instances of Zope on a single machine, talking to a ZEO server? That won't work :) Neither Unix nor Windows knows what to do with two processes trying to open the same port for listen. I'm surprised the second Zope instance even starts. If you want to try it, start each instance of Zope on different ports, then use some kind of ipforwarding/load balancer on the box to route connections to port 80 to either of your Zope servers (say 8081 and 8082). -Randy -- Dyon Balding [EMAIL PROTECTED] ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] ZEO on SMP
Since a single Python process has a single global interpreter lock, you'll never fully utilize a 2-processor machine. The lock is released whenever a socket call (send, receive, listen, etc.) is made, so that provides some opportunity for using two CPUs, but not much. Jeremy ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] ZEO on SMP
At 08:26 PM 5/23/2001 -0400, Jeremy Hylton wrote: Since a single Python process has a single global interpreter lock, you'll never fully utilize a 2-processor machine. I may be merely demonstrating ignorance, but -- If you, say, launched two separate Zope processes, and one ZEO process, on the same machine, aren't you going to be running 3 different Python interpreters, each in it's own process? Couldn't you then be utilizing up to three processors on an SMP box? I agree that threads within a particular Python interpreter are not really going to gain anything because of the global interpreter lock, but isn't that a moot point with separate Python interpreter processes? Or does the TCP/IP stack cause problems? dave ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] ZEO on SMP
Well that's what I'm trying to do, but as mentioned in my original post, any Zope clients utilising ZEO started after the first one do not respond. The ZEO storage server is running on a separate machine, serving the 15 client machines. -d On Wed, May 23, 2001 at 05:51:57PM -0700, David Brown wrote: At 08:26 PM 5/23/2001 -0400, Jeremy Hylton wrote: Since a single Python process has a single global interpreter lock, you'll never fully utilize a 2-processor machine. I may be merely demonstrating ignorance, but -- If you, say, launched two separate Zope processes, and one ZEO process, on the same machine, aren't you going to be running 3 different Python interpreters, each in it's own process? Couldn't you then be utilizing up to three processors on an SMP box? I agree that threads within a particular Python interpreter are not really going to gain anything because of the global interpreter lock, but isn't that a moot point with separate Python interpreter processes? Or does the TCP/IP stack cause problems? dave -- Dyon Balding [EMAIL PROTECTED] ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] ZEO on SMP
On 24 May 2001 05:07:30 +1000, Dyon Balding wrote: Tino, Thanks for your reply. When you say it works fine on a dual processor machine, are you saying that a single ZEO client fully utilises both processors? or that you are running two ZEO clients successfully? I am running dozens of them on a single machine, works damned well. Pretty snappy too. Of course, this is under Linux, so YMMV. Each domain/server cluster runs approximately 3 ZCs apiece. Unfortunately I'm currently stuck with Windows due to both political reasons, and because we are interfacing to a large SQLServer database. Well, AIUI, the latter is easily solved. :) ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
