Re: [Zope] MemoryError: out of memory

2011-01-27 Thread Peter Bengtsson
This little something form 2008 might work
http://www.peterbe.com/plog/zope-memory-readings


On 27 January 2011 05:15, Andreas Jung li...@zopyx.com wrote:
 -BEGIN PGP SIGNED MESSAGE-
 Hash: SHA1

 You should monitoring memory usage over time. Obviously something
 in your application is leaking memory.

 - -aj

 Jonathan Salazar Santos schrieb:
 Hi Comunity,

 I have been in troubles with Zope2.10.5-final since 4 moths ago,
 related to the MemoryError: out of memory (in the event.log), every
 three or fourth days (more or less) the Zope starts to say in our web:
 value error: Memory, and stops to serve some pages (not all), usually
 the pages that serve file contents (to download, convert to pdf or
 view online). I solve the problem (when appears) by rebooting the zope
 server, but its not a solutions, because I dont know when the error
 its coming ¿Can you help me to giving me some light to solve the
 problem? I have 2gb of RAM, and the server (FreeBSD) it says
 no-overloaded, just have 2 services, web(zope) and database(mysql). I
 think its something related to the cache memory or kind of (I changed
 some values in config file but not success). See some of my event.log


 Traceback (innermost last):
   Module ZPublisher.Publish, line 119, in publish
   Module ZPublisher.mapply, line 88, in mapply
   Module ZPublisher.Publish, line 42, in call_object
   Module OFS.DTMLMethod, line 144, in __call__
    - DTMLMethod at //index_html used for 
 //suscribete/adminNewsletter
    - URL: http:///index_html/manage_main
    - Physical Path: //index_html
   Module DocumentTemplate.DT_String, line 476, in __call__
   Module OFS.DTMLMethod, line 137, in __call__
    - DTMLMethod at //suscribete/adminNewsletter/third_header
    - URL: http:///suscribete/adminNewsletter/third_header/manage_main
    - Physical Path: //suscribete/adminNewsletter/third_header
   Module DocumentTemplate.DT_String, line 476, in __call__
   Module DocumentTemplate.DT_In, line 703, in renderwob
   Module Products.MailHost.SendMailTag, line 114, in render
   Module Products.MIMETools.MIMETag, line 198, in render
   Module MimeWriter, line 177, in lastpart
 MemoryError: out of memory




 - --
 ZOPYX Limited           | zopyx group
 Charlottenstr. 37/1     | The full-service network for Zope  Plone
 D-72070 Tübingen        | Produce  Publish
 www.zopyx.com           | www.produce-and-publish.com
 - 
 E-Publishing, Python, Zope  Plone development, Consulting


 -BEGIN PGP SIGNATURE-
 Version: GnuPG v1.4.11 (Darwin)
 Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

 iQGUBAEBAgAGBQJNQP9kAAoJEADcfz7u4AZjARQLv25A9rr7JyaaBg8SZDl1G1EN
 t19RNt1nXOg4tw+6r82IhH8I55FH+RbP+dHI73DuNTVJuSPYg2s9xuRtfOMdyhE1
 AqRTew6MK0paLaoRH9QtjWvPnhr4dnKSBn2FK4kRxzc0mKh9tTHefbwN+CUmGQmv
 lO+t0ZVdK+SqUwcfG9BekjVr/VYXUukhkm6WzxLTBkOo67sT+fTk2i8fZ7QH3dDw
 7q6f+dgOV0E1MWlQ1OeydEm+SAGo7EwqB1iaArCxwpJDN6YPLWQZk3DbA0kM9nNQ
 U6YAKsBI5urwuOoLiFJYHSGwy91Wgm9uLkNicx7sQ0zyJnGdReFfMNcf0BQWlz8X
 k0FGnaQ1oHo8qXGisgJPn1vZZxFlNtnnH7QLKk53lt4+9B6tBW3WI5RJXO9g+w2s
 Us/vpTLEHamyjb9bZNVvFI6qqQ0TiV1CmmsMSiOsEBTD56i7oS6SA594RyM65d0R
 BNUWKcU6pN/7W21MxhzGf3kLJirEgw4=
 =WPMi
 -END PGP SIGNATURE-

 ___
 Zope maillist  -  Zope@zope.org
 https://mail.zope.org/mailman/listinfo/zope
 **   No cross posts or HTML encoding!  **
 (Related lists -
  https://mail.zope.org/mailman/listinfo/zope-announce
  https://mail.zope.org/mailman/listinfo/zope-dev )





-- 
Peter Bengtsson,
work www.fry-it.com
home www.peterbe.com
hobby donecal.com
___
Zope maillist  -  Zope@zope.org
https://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 https://mail.zope.org/mailman/listinfo/zope-announce
 https://mail.zope.org/mailman/listinfo/zope-dev )


Re: [Zope] MemoryError: out of memory

2011-01-27 Thread Tres Seaver
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On 01/26/2011 03:19 PM, Jonathan Salazar Santos wrote:
 Hi Comunity,
 
 I have been in troubles with Zope2.10.5-final since 4 moths ago,
 related to the MemoryError: out of memory (in the event.log), every
 three or fourth days (more or less) the Zope starts to say in our web:
 value error: Memory, and stops to serve some pages (not all), usually
 the pages that serve file contents (to download, convert to pdf or
 view online). I solve the problem (when appears) by rebooting the zope
 server, but its not a solutions, because I dont know when the error
 its coming ¿Can you help me to giving me some light to solve the
 problem? I have 2gb of RAM, and the server (FreeBSD) it says
 no-overloaded, just have 2 services, web(zope) and database(mysql). I
 think its something related to the cache memory or kind of (I changed
 some values in config file but not success). See some of my event.log
 
 
 Traceback (innermost last):
   Module ZPublisher.Publish, line 119, in publish
   Module ZPublisher.mapply, line 88, in mapply
   Module ZPublisher.Publish, line 42, in call_object
   Module OFS.DTMLMethod, line 144, in __call__
- DTMLMethod at //index_html used for 
 //suscribete/adminNewsletter
- URL: http:///index_html/manage_main
- Physical Path: //index_html
   Module DocumentTemplate.DT_String, line 476, in __call__
   Module OFS.DTMLMethod, line 137, in __call__
- DTMLMethod at //suscribete/adminNewsletter/third_header
- URL: http:///suscribete/adminNewsletter/third_header/manage_main
- Physical Path: //suscribete/adminNewsletter/third_header
   Module DocumentTemplate.DT_String, line 476, in __call__
   Module DocumentTemplate.DT_In, line 703, in renderwob
   Module Products.MailHost.SendMailTag, line 114, in render
   Module Products.MIMETools.MIMETag, line 198, in render
   Module MimeWriter, line 177, in lastpart
 MemoryError: out of memory

The aliases feature of the stock Shared.DC.ZRDB.Results.Results class
has a leak, due to an uncollectable cycle created between the alias
objects and the record class generated *for each query*.  If your app
makes heavy use of stock ZSQL methods, you are probably going to have to
plan to monitor the server's RAM usage and reboot as it gets close to
the limit.

If you are confident either that your application does not need the
alias feature (your SQL queries all spell the column names using the
canonical spelling for your SQL server), or that you can modify them
to do so, you might try applying the attached patch, which removes the
aliase feature.


Tres.
- -- 
===
Tres Seaver  +1 540-429-0999  tsea...@palladion.com
Palladion Software   Excellence by Designhttp://palladion.com
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.10 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEARECAAYFAk1BmW4ACgkQ+gerLs4ltQ41VgCfeqvB4gRnQAd2xY+EHjkbTwiP
7xcAnA7GGngAry7jqXbCWDBq8ugafIw8
=cPGc
-END PGP SIGNATURE-
=== modified file 'lib/python/Shared/DC/ZRDB/Results.py'
--- lib/python/Shared/DC/ZRDB/Results.py	2005-11-18 14:39:19 +
+++ lib/python/Shared/DC/ZRDB/Results.py	2011-01-27 16:09:13 +
@@ -38,7 +38,6 @@
 self._names=names=[]
 self._schema=schema={}
 self._data_dictionary=dd={}
-aliases=[]
 if zbrains is None: zbrains=NoBrains
 i=0
 for item in items:
@@ -49,10 +48,6 @@
 if schema.has_key(name):
 raise ValueError, 'Duplicate column name, %s' % name
 schema[name]=i
-n=name.lower()
-if n != name: aliases.append((n, SQLAlias(name)))
-n=name.upper()
-if n != name: aliases.append((n, SQLAlias(name)))
 dd[name]=item
 names.append(name)
 i=i+1
@@ -70,11 +65,6 @@
 if k[:2]=='__':
 setattr(r,k,getattr(Record,k))
 
-# Add SQL Aliases
-for k, v in aliases:
-if not hasattr(r, k):
-setattr(r, k, v)
-
 if hasattr(brains, '__init__'):
 binit=brains.__init__
 if hasattr(binit,'im_func'): binit=binit.im_func

___
Zope maillist  -  Zope@zope.org
https://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 https://mail.zope.org/mailman/listinfo/zope-announce
 https://mail.zope.org/mailman/listinfo/zope-dev )


Re: [Zope] MemoryError: out of memory

2011-01-27 Thread Tres Seaver
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On 01/27/2011 11:12 AM, Tres Seaver wrote:

 The aliases feature of the stock Shared.DC.ZRDB.Results.Results class
 has a leak, due to an uncollectable cycle created between the alias
 objects and the record class generated *for each query*.  If your app
 makes heavy use of stock ZSQL methods, you are probably going to have to
 plan to monitor the server's RAM usage and reboot as it gets close to
 the limit.
 
 If you are confident either that your application does not need the
 alias feature (your SQL queries all spell the column names using the
 canonical spelling for your SQL server), or that you can modify them
 to do so, you might try applying the attached patch, which removes the
 aliase feature.

I should note that I never use the stock results class (or SQL methods)
any longer:  instead, I use the 'sqladapters' product we wrote when we
first discovered the leak:


http://agendaless.com/Members/tseaver/software/sqladapters/sqladapters-1.0/


Tres.
- -- 
===
Tres Seaver  +1 540-429-0999  tsea...@palladion.com
Palladion Software   Excellence by Designhttp://palladion.com
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.10 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEARECAAYFAk1BmyoACgkQ+gerLs4ltQ7JpQCgw76+ltS33nnUoDJQepGAWW2c
hkMAoNn0PsLtLY1Fp91NxZjbvnv6kbCW
=DWNc
-END PGP SIGNATURE-

___
Zope maillist  -  Zope@zope.org
https://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 https://mail.zope.org/mailman/listinfo/zope-announce
 https://mail.zope.org/mailman/listinfo/zope-dev )


[Zope] MemoryError: out of memory

2011-01-26 Thread Jonathan Salazar Santos
Hi Comunity,

I have been in troubles with Zope2.10.5-final since 4 moths ago,
related to the MemoryError: out of memory (in the event.log), every
three or fourth days (more or less) the Zope starts to say in our web:
value error: Memory, and stops to serve some pages (not all), usually
the pages that serve file contents (to download, convert to pdf or
view online). I solve the problem (when appears) by rebooting the zope
server, but its not a solutions, because I dont know when the error
its coming ¿Can you help me to giving me some light to solve the
problem? I have 2gb of RAM, and the server (FreeBSD) it says
no-overloaded, just have 2 services, web(zope) and database(mysql). I
think its something related to the cache memory or kind of (I changed
some values in config file but not success). See some of my event.log


Traceback (innermost last):
  Module ZPublisher.Publish, line 119, in publish
  Module ZPublisher.mapply, line 88, in mapply
  Module ZPublisher.Publish, line 42, in call_object
  Module OFS.DTMLMethod, line 144, in __call__
   - DTMLMethod at //index_html used for //suscribete/adminNewsletter
   - URL: http:///index_html/manage_main
   - Physical Path: //index_html
  Module DocumentTemplate.DT_String, line 476, in __call__
  Module OFS.DTMLMethod, line 137, in __call__
   - DTMLMethod at //suscribete/adminNewsletter/third_header
   - URL: http:///suscribete/adminNewsletter/third_header/manage_main
   - Physical Path: //suscribete/adminNewsletter/third_header
  Module DocumentTemplate.DT_String, line 476, in __call__
  Module DocumentTemplate.DT_In, line 703, in renderwob
  Module Products.MailHost.SendMailTag, line 114, in render
  Module Products.MIMETools.MIMETag, line 198, in render
  Module MimeWriter, line 177, in lastpart
MemoryError: out of memory


-- 
Lic. Jonathan Salazar
Saludos,
___
Zope maillist  -  Zope@zope.org
https://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 https://mail.zope.org/mailman/listinfo/zope-announce
 https://mail.zope.org/mailman/listinfo/zope-dev )


Re: [Zope] MemoryError: out of memory

2011-01-26 Thread Andreas Jung
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

You should monitoring memory usage over time. Obviously something
in your application is leaking memory.

- -aj

Jonathan Salazar Santos schrieb:
 Hi Comunity,
 
 I have been in troubles with Zope2.10.5-final since 4 moths ago,
 related to the MemoryError: out of memory (in the event.log), every
 three or fourth days (more or less) the Zope starts to say in our web:
 value error: Memory, and stops to serve some pages (not all), usually
 the pages that serve file contents (to download, convert to pdf or
 view online). I solve the problem (when appears) by rebooting the zope
 server, but its not a solutions, because I dont know when the error
 its coming ¿Can you help me to giving me some light to solve the
 problem? I have 2gb of RAM, and the server (FreeBSD) it says
 no-overloaded, just have 2 services, web(zope) and database(mysql). I
 think its something related to the cache memory or kind of (I changed
 some values in config file but not success). See some of my event.log
 
 
 Traceback (innermost last):
   Module ZPublisher.Publish, line 119, in publish
   Module ZPublisher.mapply, line 88, in mapply
   Module ZPublisher.Publish, line 42, in call_object
   Module OFS.DTMLMethod, line 144, in __call__
- DTMLMethod at //index_html used for 
 //suscribete/adminNewsletter
- URL: http:///index_html/manage_main
- Physical Path: //index_html
   Module DocumentTemplate.DT_String, line 476, in __call__
   Module OFS.DTMLMethod, line 137, in __call__
- DTMLMethod at //suscribete/adminNewsletter/third_header
- URL: http:///suscribete/adminNewsletter/third_header/manage_main
- Physical Path: //suscribete/adminNewsletter/third_header
   Module DocumentTemplate.DT_String, line 476, in __call__
   Module DocumentTemplate.DT_In, line 703, in renderwob
   Module Products.MailHost.SendMailTag, line 114, in render
   Module Products.MIMETools.MIMETag, line 198, in render
   Module MimeWriter, line 177, in lastpart
 MemoryError: out of memory
 
 


- -- 
ZOPYX Limited   | zopyx group
Charlottenstr. 37/1 | The full-service network for Zope  Plone
D-72070 Tübingen| Produce  Publish
www.zopyx.com   | www.produce-and-publish.com
- 
E-Publishing, Python, Zope  Plone development, Consulting


-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.11 (Darwin)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iQGUBAEBAgAGBQJNQP9kAAoJEADcfz7u4AZjARQLv25A9rr7JyaaBg8SZDl1G1EN
t19RNt1nXOg4tw+6r82IhH8I55FH+RbP+dHI73DuNTVJuSPYg2s9xuRtfOMdyhE1
AqRTew6MK0paLaoRH9QtjWvPnhr4dnKSBn2FK4kRxzc0mKh9tTHefbwN+CUmGQmv
lO+t0ZVdK+SqUwcfG9BekjVr/VYXUukhkm6WzxLTBkOo67sT+fTk2i8fZ7QH3dDw
7q6f+dgOV0E1MWlQ1OeydEm+SAGo7EwqB1iaArCxwpJDN6YPLWQZk3DbA0kM9nNQ
U6YAKsBI5urwuOoLiFJYHSGwy91Wgm9uLkNicx7sQ0zyJnGdReFfMNcf0BQWlz8X
k0FGnaQ1oHo8qXGisgJPn1vZZxFlNtnnH7QLKk53lt4+9B6tBW3WI5RJXO9g+w2s
Us/vpTLEHamyjb9bZNVvFI6qqQ0TiV1CmmsMSiOsEBTD56i7oS6SA594RyM65d0R
BNUWKcU6pN/7W21MxhzGf3kLJirEgw4=
=WPMi
-END PGP SIGNATURE-
attachment: lists.vcf___
Zope maillist  -  Zope@zope.org
https://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 https://mail.zope.org/mailman/listinfo/zope-announce
 https://mail.zope.org/mailman/listinfo/zope-dev )