Re: [Zope-dev] ZEO on SMP

2001-05-24 Thread Tino Wildenhain

Hi Dyon,


--On Donnerstag, 24. Mai 2001 05:07 +1000 Dyon Balding 
[EMAIL PROTECTED] wrote:

 Tino,

 Thanks for your reply.

 When you say it works fine on a dual processor machine, are you saying
 that a single ZEO client fully utilises both processors? or that you
 are running two ZEO clients successfully?

I'm running 2 clients at the same time (actually I'm running 3: 2 clients 
for HTTP requests and one client for FTP)


 Unfortunately I'm currently stuck with Windows due to both political
 reasons, and because we are interfacing to a large SQLServer database.

political reasons... will they never lern...
However, we are using strange databases with ZmxODBCDA/mxODBC
and Merant (http://www.merant.com) middleware.
This way we only have one NT Box to access the databases.

Regards
Tino

 -d

 On Wed, May 23, 2001 at 08:44:59PM +0200, Tino Wildenhain wrote:
 Hi Dyon,

 ZEO on a dual processor machine runs fine for me.
 I'm using redhat-linux for the server (ZEO and Clients
 on same machine)
 If you dont need strange things I would not recommend
 Win2k as server platform.

 Best regards
 Tino Wildenhain

 --On Mittwoch, 23. Mai 2001 11:35 -0700 Dyon Balding
 [EMAIL PROTECTED]  wrote:

  Hi,
 
  We are setting up a cluster of ZEO clients on dual processor machines.
  From some experiments and from searching through the mailing lists, it
  appears that a single Zope process will not take full advantage of the
  two processors.
 
  The solution would appear to be to run two ZEO clients on each server.
  This, however, is causing problems.
 
  I can successfully run two Zope (non-ZEO) processes on a single
  machine, but two ZEO clients don't seem to coexist nicely on the
  Windows 2000 machine.  The second client to start will accept
  connections, but never responds with anything.
 
  Zope: 2.3.2, ZEO: 1.0b3, Windows 2k for clients, Linux and Windows 2k
  for storage server.
 
  Is there a better solution?  If not, has anyone come across this
  problem?
 
  Any pointers appreciated
  -d
 
  ___
  Zope-Dev maillist  -  [EMAIL PROTECTED]
  http://lists.zope.org/mailman/listinfo/zope-dev
  **  No cross posts or HTML encoding!  **
  (Related lists -
   http://lists.zope.org/mailman/listinfo/zope-announce
   http://lists.zope.org/mailman/listinfo/zope )




 --
 Dyon Balding [EMAIL PROTECTED]





___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



[Zope-dev] ZEO on SMP

2001-05-23 Thread Dyon Balding

Hi,

We are setting up a cluster of ZEO clients on dual processor machines. 
From some experiments and from searching through the mailing lists, it
appears that a single Zope process will not take full advantage of the
two processors.

The solution would appear to be to run two ZEO clients on each server. 
This, however, is causing problems.

I can successfully run two Zope (non-ZEO) processes on a single machine,
but two ZEO clients don't seem to coexist nicely on the Windows 2000
machine.  The second client to start will accept connections, but never
responds with anything.

Zope: 2.3.2, ZEO: 1.0b3, Windows 2k for clients, Linux and Windows 2k
for storage server.

Is there a better solution?  If not, has anyone come across this
problem?

Any pointers appreciated
-d

___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



Re: [Zope-dev] ZEO on SMP

2001-05-23 Thread Tino Wildenhain

Hi Dyon,

ZEO on a dual processor machine runs fine for me.
I'm using redhat-linux for the server (ZEO and Clients
on same machine)
If you dont need strange things I would not recommend
Win2k as server platform.

Best regards
Tino Wildenhain

--On Mittwoch, 23. Mai 2001 11:35 -0700 Dyon Balding [EMAIL PROTECTED] 
wrote:

 Hi,

 We are setting up a cluster of ZEO clients on dual processor machines.
 From some experiments and from searching through the mailing lists, it
 appears that a single Zope process will not take full advantage of the
 two processors.

 The solution would appear to be to run two ZEO clients on each server.
 This, however, is causing problems.

 I can successfully run two Zope (non-ZEO) processes on a single machine,
 but two ZEO clients don't seem to coexist nicely on the Windows 2000
 machine.  The second client to start will accept connections, but never
 responds with anything.

 Zope: 2.3.2, ZEO: 1.0b3, Windows 2k for clients, Linux and Windows 2k
 for storage server.

 Is there a better solution?  If not, has anyone come across this
 problem?

 Any pointers appreciated
 -d

 ___
 Zope-Dev maillist  -  [EMAIL PROTECTED]
 http://lists.zope.org/mailman/listinfo/zope-dev
 **  No cross posts or HTML encoding!  **
 (Related lists -
  http://lists.zope.org/mailman/listinfo/zope-announce
  http://lists.zope.org/mailman/listinfo/zope )





___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



Re: [Zope-dev] ZEO on SMP

2001-05-23 Thread Dyon Balding

Tino,

Thanks for your reply.

When you say it works fine on a dual processor machine, are you saying
that a single ZEO client fully utilises both processors? or that you
are running two ZEO clients successfully?

Unfortunately I'm currently stuck with Windows due to both political
reasons, and because we are interfacing to a large SQLServer database.

-d

On Wed, May 23, 2001 at 08:44:59PM +0200, Tino Wildenhain wrote:
 Hi Dyon,
 
 ZEO on a dual processor machine runs fine for me.
 I'm using redhat-linux for the server (ZEO and Clients
 on same machine)
 If you dont need strange things I would not recommend
 Win2k as server platform.
 
 Best regards
 Tino Wildenhain
 
 --On Mittwoch, 23. Mai 2001 11:35 -0700 Dyon Balding [EMAIL PROTECTED] 
 wrote:
 
  Hi,
 
  We are setting up a cluster of ZEO clients on dual processor machines.
  From some experiments and from searching through the mailing lists, it
  appears that a single Zope process will not take full advantage of the
  two processors.
 
  The solution would appear to be to run two ZEO clients on each server.
  This, however, is causing problems.
 
  I can successfully run two Zope (non-ZEO) processes on a single machine,
  but two ZEO clients don't seem to coexist nicely on the Windows 2000
  machine.  The second client to start will accept connections, but never
  responds with anything.
 
  Zope: 2.3.2, ZEO: 1.0b3, Windows 2k for clients, Linux and Windows 2k
  for storage server.
 
  Is there a better solution?  If not, has anyone come across this
  problem?
 
  Any pointers appreciated
  -d
 
  ___
  Zope-Dev maillist  -  [EMAIL PROTECTED]
  http://lists.zope.org/mailman/listinfo/zope-dev
  **  No cross posts or HTML encoding!  **
  (Related lists -
   http://lists.zope.org/mailman/listinfo/zope-announce
   http://lists.zope.org/mailman/listinfo/zope )
 
 
 

-- 
Dyon Balding [EMAIL PROTECTED]

___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



RE: [Zope-dev] ZEO on SMP

2001-05-23 Thread Randall F. Kern

If I understand your scenario, you are trying to run two instances of
Zope on a single machine, talking to a ZEO server?

That won't work :)

Neither Unix nor Windows knows what to do with two processes trying to
open the same port for listen.  I'm surprised the second Zope instance
even starts.

If you want to try it, start each instance of Zope on different ports,
then use some kind of ipforwarding/load balancer on the box to route
connections to port 80 to either of your Zope servers (say 8081 and
8082).

-Randy

 -Original Message-
 From: Dyon Balding [mailto:[EMAIL PROTECTED]]
 Sent: Wednesday, May 23, 2001 12:08 PM
 To: Tino Wildenhain
 Cc: [EMAIL PROTECTED]
 Subject: Re: [Zope-dev] ZEO on SMP
 
 
 Tino,
 
 Thanks for your reply.
 
 When you say it works fine on a dual processor machine, are you saying
 that a single ZEO client fully utilises both processors? or that you
 are running two ZEO clients successfully?
 
 Unfortunately I'm currently stuck with Windows due to both political
 reasons, and because we are interfacing to a large SQLServer database.
 
 -d
 
 On Wed, May 23, 2001 at 08:44:59PM +0200, Tino Wildenhain wrote:
  Hi Dyon,
  
  ZEO on a dual processor machine runs fine for me.
  I'm using redhat-linux for the server (ZEO and Clients
  on same machine)
  If you dont need strange things I would not recommend
  Win2k as server platform.
  
  Best regards
  Tino Wildenhain
  
  --On Mittwoch, 23. Mai 2001 11:35 -0700 Dyon Balding 
 [EMAIL PROTECTED] 
  wrote:
  
   Hi,
  
   We are setting up a cluster of ZEO clients on dual 
 processor machines.
   From some experiments and from searching through the 
 mailing lists, it
   appears that a single Zope process will not take full 
 advantage of the
   two processors.
  
   The solution would appear to be to run two ZEO clients on 
 each server.
   This, however, is causing problems.
  
   I can successfully run two Zope (non-ZEO) processes on a 
 single machine,
   but two ZEO clients don't seem to coexist nicely on the 
 Windows 2000
   machine.  The second client to start will accept 
 connections, but never
   responds with anything.
  
   Zope: 2.3.2, ZEO: 1.0b3, Windows 2k for clients, Linux 
 and Windows 2k
   for storage server.
  
   Is there a better solution?  If not, has anyone come across this
   problem?
  
   Any pointers appreciated
   -d
  
   ___
   Zope-Dev maillist  -  [EMAIL PROTECTED]
   http://lists.zope.org/mailman/listinfo/zope-dev
   **  No cross posts or HTML encoding!  **
   (Related lists -
http://lists.zope.org/mailman/listinfo/zope-announce
http://lists.zope.org/mailman/listinfo/zope )
  
  
  
 
 -- 
 Dyon Balding [EMAIL PROTECTED]
 
 ___
 Zope-Dev maillist  -  [EMAIL PROTECTED]
 http://lists.zope.org/mailman/listinfo/zope-dev
 **  No cross posts or HTML encoding!  **
 (Related lists - 
  http://lists.zope.org/mailman/listinfo/zope-announce
  http://lists.zope.org/mailman/listinfo/zope )
 

___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists -
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



Re: [Zope-dev] ZEO on SMP

2001-05-23 Thread Dyon Balding

They are listening on different ports, (80 and 81) in my test case.

And yes, there will be a load balancer in front of them (there will
be 15 dual processor servers) to make the cluster appear like one
machine.

-dyon

On Wed, May 23, 2001 at 12:38:25PM -0700, Randall F. Kern wrote:
 If I understand your scenario, you are trying to run two instances of
 Zope on a single machine, talking to a ZEO server?
 
 That won't work :)
 
 Neither Unix nor Windows knows what to do with two processes trying to
 open the same port for listen.  I'm surprised the second Zope instance
 even starts.
 
 If you want to try it, start each instance of Zope on different ports,
 then use some kind of ipforwarding/load balancer on the box to route
 connections to port 80 to either of your Zope servers (say 8081 and
 8082).
 
 -Randy

-- 
Dyon Balding [EMAIL PROTECTED]

___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



Re: [Zope-dev] ZEO on SMP

2001-05-23 Thread Jeremy Hylton

Since a single Python process has a single global interpreter lock,
you'll never fully utilize a 2-processor machine.  The lock is
released whenever a socket call (send, receive, listen, etc.) is made,
so that provides some opportunity for using two CPUs, but not much.

Jeremy


___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



Re: [Zope-dev] ZEO on SMP

2001-05-23 Thread David Brown

At 08:26 PM 5/23/2001 -0400, Jeremy Hylton wrote:
Since a single Python process has a single global interpreter lock,
you'll never fully utilize a 2-processor machine.


I may be merely demonstrating ignorance, but --

If you, say, launched two separate Zope processes, and one ZEO process, on 
the same machine, aren't you going to be running 3 different Python 
interpreters, each in it's own process?

Couldn't you then be utilizing up to three processors on an SMP box?

I agree that threads within a particular Python interpreter are not really 
going to gain anything because of the global interpreter lock, but isn't 
that a moot point with separate Python interpreter processes?

Or does the TCP/IP stack cause problems?

dave


___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



Re: [Zope-dev] ZEO on SMP

2001-05-23 Thread Jeremy Hylton

 DB == David Brown [EMAIL PROTECTED] writes:

  DB At 08:26 PM 5/23/2001 -0400, Jeremy Hylton wrote:
   Since a single Python process has a single global interpreter
   lock, you'll never fully utilize a 2-processor machine.

  DB If you, say, launched two separate Zope processes, and one ZEO
  DB process, on the same machine, aren't you going to be running 3
  DB different Python interpreters, each in it's own process?

  DB Couldn't you then be utilizing up to three processors on an SMP
  DB box?

Yes.  I may have misread the original question.  I thought the SMP
machine was running the ZEO server.  If Zope and ZEO clients are both
running on the same machine, I would assume they would run
concurrently on separate processors.

Jeremy


___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



Re: [Zope-dev] ZEO on SMP

2001-05-23 Thread Dyon Balding

Well that's what I'm trying to do, but as mentioned in my original
post, any Zope clients utilising ZEO started after the first one do
not respond.  The ZEO storage server is running on a separate machine,
serving the 15 client machines.

-d

On Wed, May 23, 2001 at 05:51:57PM -0700, David Brown wrote:
 At 08:26 PM 5/23/2001 -0400, Jeremy Hylton wrote:
 Since a single Python process has a single global interpreter lock,
 you'll never fully utilize a 2-processor machine.
 
 
 I may be merely demonstrating ignorance, but --
 
 If you, say, launched two separate Zope processes, and one ZEO process, on 
 the same machine, aren't you going to be running 3 different Python 
 interpreters, each in it's own process?
 
 Couldn't you then be utilizing up to three processors on an SMP box?
 
 I agree that threads within a particular Python interpreter are not really 
 going to gain anything because of the global interpreter lock, but isn't 
 that a moot point with separate Python interpreter processes?
 
 Or does the TCP/IP stack cause problems?
 
 dave

-- 
Dyon Balding [EMAIL PROTECTED]

___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



Re: [Zope-dev] ZEO on SMP

2001-05-23 Thread Bill Anderson

On 24 May 2001 05:07:30 +1000, Dyon Balding wrote:
 Tino,
 
 Thanks for your reply.
 
 When you say it works fine on a dual processor machine, are you saying
 that a single ZEO client fully utilises both processors? or that you
 are running two ZEO clients successfully?

I am running dozens of them on a single machine, works damned well.
Pretty snappy too. Of course, this is under Linux, so YMMV.

Each domain/server cluster runs approximately 3 ZCs apiece.

 Unfortunately I'm currently stuck with Windows due to both political
 reasons, and because we are interfacing to a large SQLServer database.

Well, AIUI, the latter is easily solved. :)





___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )