Re: [ZODB-Dev] ZeoServer, multiple storages and open file handles

2012-10-24 Thread Jim Fulton
On Wed, Oct 24, 2012 at 12:33 AM, Tim Godfrey t...@obsidian.com.au wrote: Hi Jim Do you have any idea as to why people recommend against many storages under a single Zeo? Seriously? Go back and read the thread. Also can increasing the invalidation-queue-size help this if there is memory

Re: [ZODB-Dev] ZeoServer, multiple storages and open file handles

2012-10-24 Thread Tim Godfrey
On 25 October 2012 00:13, Jim Fulton j...@zope.com wrote: On Wed, Oct 24, 2012 at 12:33 AM, Tim Godfrey t...@obsidian.com.au wrote: Hi Jim Do you have any idea as to why people recommend against many storages under a single Zeo? Seriously? Go back and read the thread. Seriously

Re: [ZODB-Dev] ZeoServer, multiple storages and open file handles

2012-10-24 Thread Alex Clark
On 2012-10-25 00:11:40 +, Tim Godfrey said: On 25 October 2012 00:13, Jim Fulton j...@zope.com wrote: On Wed, Oct 24, 2012 at 12:33 AM, Tim Godfrey t...@obsidian.com.au wrote: Hi Jim Do you have any idea as to why people recommend against many storages under a single Zeo? Seriously?

Re: [ZODB-Dev] ZeoServer, multiple storages and open file handles

2012-10-24 Thread Tim Godfrey
Patience goes both ways. Thanks for your help Tim On 25 October 2012 12:33, Alex Clark acl...@aclark.net wrote: ** On 2012-10-25 00:11:40 +, Tim Godfrey said: On 25 October 2012 00:13, Jim Fulton j...@zope.com wrote: On Wed, Oct 24, 2012 at 12:33 AM, Tim Godfrey

Re: [ZODB-Dev] ZeoServer, multiple storages and open file handles

2012-10-24 Thread Darryl Dixon - Winterhouse Consulting
On Wed, Oct 24, 2012 at 12:33 AM, Tim Godfrey t...@obsidian.com.au wrote: Hi Jim Do you have any idea as to why people recommend against many storages under a single Zeo? Seriously? Go back and read the thread. Seriously mate. The why is very vague.  There is nothing vague

Re: [ZODB-Dev] ZeoServer, multiple storages and open file handles

2012-10-23 Thread Tim Godfrey
Hi Jim Do you have any idea as to why people recommend against many storages under a single Zeo? Also can increasing the invalidation-queue-size help this if there is memory to spare on the machine? Tim On 23 October 2012 00:53, Jim Fulton j...@zope.com wrote: On Sun, Oct 21, 2012 at 8:48 PM,

Re: [ZODB-Dev] ZeoServer, multiple storages and open file handles

2012-10-22 Thread Jim Fulton
On Sun, Oct 21, 2012 at 8:48 PM, Tim Godfrey t...@obsidian.com.au wrote: Hi Jon Thanks for your response. Is that something that has been done in a later version of Zeoserver than mine (ZODB3-3.10.3)? No. Every time I've tried to switch to poll in a asyncore, I've had problems. It this

Re: [ZODB-Dev] ZeoServer, multiple storages and open file handles

2012-10-21 Thread Tim Godfrey
Hi Jon Thanks for your response. Is that something that has been done in a later version of Zeoserver than mine (ZODB3-3.10.3)? It this your recommended action for the issue I'm having or are there still some configuration changes I can make? Tim On 20 October 2012 19:52, Jon Dyte

Re: [ZODB-Dev] ZeoServer, multiple storages and open file handles

2012-10-20 Thread Jon Dyte
On 18/10/12 03:29, Tim Godfrey wrote: Hi all We have a customer on Plone 4.1 and recently we started to see a great increase in the number of open file descriptors the Zeoserver process uses. We have a pretty big system distributed over many servers as the Plone system gets a lot of

Re: [ZODB-Dev] ZeoServer, multiple storages and open file handles

2012-10-18 Thread Leonardo Rochael Almeida
Having a single ZEO server handling more than one or two storages is not usually a good idea. ZEO does not handle each storage in a separate thread, so you're underusing multiple CPUs if you have them. Multiple ZEO servers would also spread the open sockets among them. There could still be a

Re: [ZODB-Dev] ZeoServer, multiple storages and open file handles

2012-10-18 Thread Jim Fulton
On Thu, Oct 18, 2012 at 3:09 PM, Leonardo Rochael Almeida leoroch...@gmail.com wrote: Thanks for pitching in with an answer! Having a single ZEO server handling more than one or two storages is not usually a good idea. ZEO does not handle each storage in a separate thread, so you're

Re: [ZODB-Dev] ZeoServer, multiple storages and open file handles

2012-10-18 Thread Tim Godfrey
Hi Thanks for your responses thus far. For the most part the zeoserver is performing quite well. Very low memory and CPU usage. I really think my problem lies in the fact that the Zope clients are reporting these sort of messages quite regularly when communicating to ZEO: 2012-10-19T10:15:02