Re: [Zope-dev] Memory Leaks

2002-07-23 Thread Stefan H. Holek

I do also see the ZPT expression stuff leaking. In my case in this order:

Products.PageTemplates.Expressions.SubPathExpr
Products.PageTemplates.Expressions.PathExpr
Products.PageTemplates.ZRPythonExpr.PythonExpr

This one does *not* go away when setting ZOPE_SECURITY_POLICY=PYTHON. I am 
also leaking refs to persistent User objects; may be a side effect though - 
like your DateTimes.

The site in question serves large ZSQL result sets via ZPT to authenticated 
users. No CMF/Plone involved.

Stefan


--On Montag, 22. Juli 2002 13:45 -0700 Andy McKay [EMAIL PROTECTED] wrote:

 Hey all,

 A client of mine seems to be plagued with memory leaks. I have a CMF /
 Plone site on We fixed some security issues that caused a major leak this
 is the same I believe as http://collector.zope.org/Zope/421, by jiggling
 settings this no longer an issue. Anyway we are still getting some minor
 leaks that severly limit the amount of the traffic the box is going to be
 able take. Lots of different objects are being leaked, including good old
 DateTime, however I dont believe its this, DateTime just happens to be
 there.

 Possible culprits are (trimmed down debug page) ZPT:
 Products.PageTemplates.Expressions.PathExpr,
 Products.PageTemplates.Expressions.SubPathExpr,
 Products.PageTemplates.TALES.TALESError etc...
 or AccessControl AccessControl.unauthorized.Unauthorized,
 AccessControl.SecurityManager.SecurityManager etc...

 A quick rummage through LeakFinder hasn't helped too much so Im not sure
 what too recommend. Good old install ZEO and restart Zope every few hours?
 Is anyone else having issues?

 Configuration:

 Plone 0.99 Almost There
 CMF Beta 1.3 beta 1
 Zope 2.5.1
 Python 2.1.3
 RedHat Linux 7.1
 Using Apache and pcgi to serve...
 --
   Andy McKay




 ___
 Zope-Dev maillist  -  [EMAIL PROTECTED]
 http://lists.zope.org/mailman/listinfo/zope-dev
 **  No cross posts or HTML encoding!  **
 (Related lists -
  http://lists.zope.org/mailman/listinfo/zope-announce
  http://lists.zope.org/mailman/listinfo/zope )

--
Those who write software only for pay should go hurt some other field.
/Erik Naggum/


___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



Re: [Zope-dev] Memory Leaks

2002-07-23 Thread Andy McKay

Hmm of course it doesnt mean ZPT expressions are causing the leak, but are a
side effect. Of course my DTML ZopeZen is watertight and isnt leaking at all
:)

- Original Message -
From: Stefan H. Holek [EMAIL PROTECTED]
To: Andy McKay [EMAIL PROTECTED]
Cc: [EMAIL PROTECTED]
Sent: Tuesday, July 23, 2002 3:37 AM
Subject: Re: [Zope-dev] Memory Leaks


 I do also see the ZPT expression stuff leaking. In my case in this order:

 Products.PageTemplates.Expressions.SubPathExpr
 Products.PageTemplates.Expressions.PathExpr
 Products.PageTemplates.ZRPythonExpr.PythonExpr

 This one does *not* go away when setting ZOPE_SECURITY_POLICY=PYTHON. I am
 also leaking refs to persistent User objects; may be a side effect
though -
 like your DateTimes.

 The site in question serves large ZSQL result sets via ZPT to
authenticated
 users. No CMF/Plone involved.

 Stefan


 --On Montag, 22. Juli 2002 13:45 -0700 Andy McKay [EMAIL PROTECTED] wrote:

  Hey all,
 
  A client of mine seems to be plagued with memory leaks. I have a CMF /
  Plone site on We fixed some security issues that caused a major leak
this
  is the same I believe as http://collector.zope.org/Zope/421, by jiggling
  settings this no longer an issue. Anyway we are still getting some minor
  leaks that severly limit the amount of the traffic the box is going to
be
  able take. Lots of different objects are being leaked, including good
old
  DateTime, however I dont believe its this, DateTime just happens to be
  there.
 
  Possible culprits are (trimmed down debug page) ZPT:
  Products.PageTemplates.Expressions.PathExpr,
  Products.PageTemplates.Expressions.SubPathExpr,
  Products.PageTemplates.TALES.TALESError etc...
  or AccessControl AccessControl.unauthorized.Unauthorized,
  AccessControl.SecurityManager.SecurityManager etc...
 
  A quick rummage through LeakFinder hasn't helped too much so Im not sure
  what too recommend. Good old install ZEO and restart Zope every few
hours?
  Is anyone else having issues?
 
  Configuration:
 
  Plone 0.99 Almost There
  CMF Beta 1.3 beta 1
  Zope 2.5.1
  Python 2.1.3
  RedHat Linux 7.1
  Using Apache and pcgi to serve...
  --
Andy McKay
 
 
 
 
  ___
  Zope-Dev maillist  -  [EMAIL PROTECTED]
  http://lists.zope.org/mailman/listinfo/zope-dev
  **  No cross posts or HTML encoding!  **
  (Related lists -
   http://lists.zope.org/mailman/listinfo/zope-announce
   http://lists.zope.org/mailman/listinfo/zope )

 --
 Those who write software only for pay should go hurt some other field.
 /Erik Naggum/




___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



Re: [Zope-dev] Memory Leaks

2002-07-23 Thread Andre Schubert

On Tue, 23 Jul 2002 12:37:39 +0200
Stefan H. Holek [EMAIL PROTECTED] wrote:


 I do also see the ZPT expression stuff leaking. In my case in this order:
 
 Products.PageTemplates.Expressions.SubPathExpr
 Products.PageTemplates.Expressions.PathExpr
 Products.PageTemplates.ZRPythonExpr.PythonExpr
 
 This one does *not* go away when setting ZOPE_SECURITY_POLICY=PYTHON. I am 
 also leaking refs to persistent User objects; may be a side effect though - 
 like your DateTimes.
 
 The site in question serves large ZSQL result sets via ZPT to authenticated 
 users. No CMF/Plone involved.

I also have a leaking Zope, i'am also using large ZSQL result sets but no ZPT.
I work with a result set of about 500 rows.
I do a lot of stuff for each row of the result set, e.g. setup new objects in zope.
All my work is done in a own product, if i work the first times with it, i could see
my zope grows up about 500MB
After that a found out, to do a get_transaction.commit(1) after i have done all my work
for each row and the zope was not growing up with such big steps.

I posted this problem some times ago, but no one could give a answer to this problem.
All zope sites a have where we use ZSQL are growing up...

Hope anyone could solve this.

Regards

andre

 
 Stefan
 
 
 --On Montag, 22. Juli 2002 13:45 -0700 Andy McKay [EMAIL PROTECTED] wrote:
 
  Hey all,
 
  A client of mine seems to be plagued with memory leaks. I have a CMF /
  Plone site on We fixed some security issues that caused a major leak this
  is the same I believe as http://collector.zope.org/Zope/421, by jiggling
  settings this no longer an issue. Anyway we are still getting some minor
  leaks that severly limit the amount of the traffic the box is going to be
  able take. Lots of different objects are being leaked, including good old
  DateTime, however I dont believe its this, DateTime just happens to be
  there.
 
  Possible culprits are (trimmed down debug page) ZPT:
  Products.PageTemplates.Expressions.PathExpr,
  Products.PageTemplates.Expressions.SubPathExpr,
  Products.PageTemplates.TALES.TALESError etc...
  or AccessControl AccessControl.unauthorized.Unauthorized,
  AccessControl.SecurityManager.SecurityManager etc...
 
  A quick rummage through LeakFinder hasn't helped too much so Im not sure
  what too recommend. Good old install ZEO and restart Zope every few hours?
  Is anyone else having issues?
 
  Configuration:
 
  Plone 0.99 Almost There
  CMF Beta 1.3 beta 1
  Zope 2.5.1
  Python 2.1.3
  RedHat Linux 7.1
  Using Apache and pcgi to serve...
  --
Andy McKay
 
 
 
 
  ___
  Zope-Dev maillist  -  [EMAIL PROTECTED]
  http://lists.zope.org/mailman/listinfo/zope-dev
  **  No cross posts or HTML encoding!  **
  (Related lists -
   http://lists.zope.org/mailman/listinfo/zope-announce
   http://lists.zope.org/mailman/listinfo/zope )
 
 --
 Those who write software only for pay should go hurt some other field.
 /Erik Naggum/
 
 
 ___
 Zope-Dev maillist  -  [EMAIL PROTECTED]
 http://lists.zope.org/mailman/listinfo/zope-dev
 **  No cross posts or HTML encoding!  **
 (Related lists - 
  http://lists.zope.org/mailman/listinfo/zope-announce
  http://lists.zope.org/mailman/listinfo/zope )

___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



Re: [Zope-dev] Memory Leaks

2002-07-23 Thread Andre Schubert

On Tue, 23 Jul 2002 12:37:39 +0200
Stefan H. Holek [EMAIL PROTECTED] wrote:

 I do also see the ZPT expression stuff leaking. In my case in this order:
 
 Products.PageTemplates.Expressions.SubPathExpr
 Products.PageTemplates.Expressions.PathExpr
 Products.PageTemplates.ZRPythonExpr.PythonExpr
 
 This one does *not* go away when setting ZOPE_SECURITY_POLICY=PYTHON. I am 
 also leaking refs to persistent User objects; may be a side effect though - 
 like your DateTimes.
 
 The site in question serves large ZSQL result sets via ZPT to authenticated 
 users. No CMF/Plone involved.
 
 Stefan
 
 
 --On Montag, 22. Juli 2002 13:45 -0700 Andy McKay [EMAIL PROTECTED] wrote:
 
  Hey all,
 
  A client of mine seems to be plagued with memory leaks. I have a CMF /
  Plone site on We fixed some security issues that caused a major leak this
  is the same I believe as http://collector.zope.org/Zope/421, by jiggling
  settings this no longer an issue. Anyway we are still getting some minor
  leaks that severly limit the amount of the traffic the box is going to be
  able take. Lots of different objects are being leaked, including good old
  DateTime, however I dont believe its this, DateTime just happens to be
  there.
 
  Possible culprits are (trimmed down debug page) ZPT:
  Products.PageTemplates.Expressions.PathExpr,
  Products.PageTemplates.Expressions.SubPathExpr,
  Products.PageTemplates.TALES.TALESError etc...
  or AccessControl AccessControl.unauthorized.Unauthorized,
  AccessControl.SecurityManager.SecurityManager etc...
 
  A quick rummage through LeakFinder hasn't helped too much so Im not sure
  what too recommend. Good old install ZEO and restart Zope every few hours?
  Is anyone else having issues?
 
  Configuration:
 
  Plone 0.99 Almost There
  CMF Beta 1.3 beta 1
  Zope 2.5.1
  Python 2.1.3
  RedHat Linux 7.1
  Using Apache and pcgi to serve...
  --
Andy McKay
 
 
 
 
  ___
  Zope-Dev maillist  -  [EMAIL PROTECTED]
  http://lists.zope.org/mailman/listinfo/zope-dev
  **  No cross posts or HTML encoding!  **
  (Related lists -
   http://lists.zope.org/mailman/listinfo/zope-announce
   http://lists.zope.org/mailman/listinfo/zope )
 
 --
 Those who write software only for pay should go hurt some other field.
 /Erik Naggum/
 
 
 ___
 Zope-Dev maillist  -  [EMAIL PROTECTED]
 http://lists.zope.org/mailman/listinfo/zope-dev
 **  No cross posts or HTML encoding!  **
 (Related lists - 
  http://lists.zope.org/mailman/listinfo/zope-announce
  http://lists.zope.org/mailman/listinfo/zope )

___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



[Zope-dev] Memory Leaks

2002-07-22 Thread Andy McKay

Hey all,

A client of mine seems to be plagued with memory leaks. I have a CMF / Plone
site on We fixed some security issues that caused a major leak this is the
same I believe as http://collector.zope.org/Zope/421, by jiggling settings
this no longer an issue. Anyway we are still getting some minor leaks that
severly limit the amount of the traffic the box is going to be able take.
Lots of different objects are being leaked, including good old DateTime,
however I dont believe its this, DateTime just happens to be there.

Possible culprits are (trimmed down debug page) ZPT:
Products.PageTemplates.Expressions.PathExpr,
Products.PageTemplates.Expressions.SubPathExpr,
Products.PageTemplates.TALES.TALESError etc...
or AccessControl AccessControl.unauthorized.Unauthorized,
AccessControl.SecurityManager.SecurityManager etc...

A quick rummage through LeakFinder hasn't helped too much so Im not sure
what too recommend. Good old install ZEO and restart Zope every few hours?
Is anyone else having issues?

Configuration:

Plone 0.99 Almost There
CMF Beta 1.3 beta 1
Zope 2.5.1
Python 2.1.3
RedHat Linux 7.1
Using Apache and pcgi to serve...
--
  Andy McKay




___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )