Re: [Zope] Zope 2.8.4 strange behavior

2005-11-29 Thread Dennis Allison
Resolved. Thanks to all that responded. The symptoms were due to an external method which runs a program (htmldoc) that converts html to pdf. The external method uses the "old" subprocess interface to fire off the process and then wait() for it to complete. To fix another problem, we had upgr

Re: [Zope] Zope 2.8.4 strange behavior

2005-11-29 Thread Dieter Maurer
Paul Winkler wrote at 2005-11-28 15:37 -0500: > ... >> We had to implement a keep alive mechanism to prevent our firewall >> from behaving in this nasty way. > >OK. Can you give a high-level summary of what you did? I thought of >using heartbeat to detect loss of connection, but I'm not sure what

Re: [Zope] Zope 2.8.4 strange behavior

2005-11-29 Thread Tim Peters
[Chris McDonough] >> The symptom you're describing has happened to me in the past. Zope >> stops serving requests and my CPU is not pegged (it's not hitting the >> CPU hard via an infinept loop I've made). I usually end up tracking it >> down to the fact that my instance is somehow leaking datab

Re: [Zope] Zope 2.8.4 strange behavior

2005-11-29 Thread Chris Withers
Chris McDonough wrote: The symptom you're describing has happened to me in the past. Zope stops serving requests and my CPU is not pegged (it's not hitting the CPU hard via an infinept loop I've made). I usually end up tracking it down to the fact that my instance is somehow leaking data

Re: [Zope] Zope 2.8.4 strange behavior

2005-11-28 Thread Paul Winkler
On Mon, Nov 28, 2005 at 08:19:23PM +0100, Dieter Maurer wrote: > Paul Winkler wrote at 2005-11-27 21:17 -0500: > > ... > >I've seen the same symptoms a number of times recently with zope 2.7.x. > >In our case, it seems to be related to ZEO. Zope seems to have lost > >its connection to ZEO but doesn

Re: [Zope] Zope 2.8.4 strange behavior

2005-11-28 Thread Dieter Maurer
Paul Winkler wrote at 2005-11-27 21:17 -0500: > ... >I've seen the same symptoms a number of times recently with zope 2.7.x. >In our case, it seems to be related to ZEO. Zope seems to have lost >its connection to ZEO but doesn't realize it somehow. My theory is >that the symptom starts when all wo

Re: [Zope] Zope 2.8.4 strange behavior

2005-11-27 Thread Dennis Allison
We do see occasional instances where things slow down, a backlog builds, and then it clears. But no disconnects. On Sun, 27 Nov 2005, Paul Winkler wrote: > On Sun, Nov 27, 2005 at 08:08:20PM -0800, Dennis Allison wrote: > > Thanks Paul. > > > > I checked and did not find any "Client disconne

Re: [Zope] Zope 2.8.4 strange behavior

2005-11-27 Thread Dennis Allison
We had been plagued with a threading error which manifests itself as an exception reporting "release unreleased lock". At Andy's suggestion I added code to catch the exception in the appropriate place in ZMySQLDA -- Here's the code from db.py --- The code probably should be specific to the

Re: [Zope] Zope 2.8.4 strange behavior

2005-11-27 Thread Paul Winkler
On Sun, Nov 27, 2005 at 08:08:20PM -0800, Dennis Allison wrote: > Thanks Paul. > > I checked and did not find any "Client disconnected" entries in the > event log so this may not be the cause of what I am seeing. OK. If you were having my problem you'd see them for sure when the problem stops

Re: [Zope] Zope 2.8.4 strange behavior

2005-11-27 Thread Dennis Allison
Thanks Paul. I checked and did not find any "Client disconnected" entries in the event log so this may not be the cause of what I am seeing. I will bump the log level to ALL (which I think includes BLATHER) when I restart things tonight. We use a remote ZEO but at the moment Zope and ZEO shar

Re: [Zope] Zope 2.8.4 strange behavior

2005-11-27 Thread Chris McDonough
Chris, A helpful suggestion. The commit errors I've been seeing have to do with the intereaction of the ZODB, MySQL, session variables, and conflicts. So the patch that Andy sent over is a fix that prevents the mysql adapter from raising an error when a conflict exception occurs? Do you

Re: [Zope] Zope 2.8.4 strange behavior

2005-11-27 Thread Paul Winkler
On Sun, Nov 27, 2005 at 05:13:21PM -0800, Dennis Allison wrote: > Examination of the raw trace log shows that Zope is continuing to accept > requests, but nothing getting done. The raw log date-stamps four internal > states for each transaction. The states are Begin (B), Input (I), > action (A),

Re: [Zope] Zope 2.8.4 strange behavior

2005-11-27 Thread Dennis Allison
Chris, A helpful suggestion. The commit errors I've been seeing have to do with the intereaction of the ZODB, MySQL, session variables, and conflicts. These particular problems do not appear to be related to the ZODB/session variable/conflict issues, but I cannot completely exclude them s

Re: [Zope] Zope 2.8.4 strange behavior

2005-11-27 Thread Chris McDonough
On Nov 27, 2005, at 8:13 PM, Dennis Allison wrote: here to begin to track this one down. The failure is spontaneous and apparently not triggered by any readily distinguishable inputs or pattern of inputs. The behavior smells a bit of resource limits or process synchronization problems, bu

[Zope] Zope 2.8.4 strange behavior

2005-11-27 Thread Dennis Allison
Python2.4.2 Zope 2.8.4 ZODB/Zeo 2.3.4 Mysql 4.0 Dual Athalon processors Linux RH7.3 We have two recent instances in our production sites where Zope suddenly stops responding. It is not a new problem, but we've now been confronted with two clean examples and nothing to blame them on. The problem