[Zope-Coders] Zope tests: 8 OK
Summary of messages to the zope-tests list. Period Mon Sep 12 11:01:02 2005 UTC to Tue Sep 13 11:01:02 2005 UTC. There were 8 messages: 8 from Zope Unit Tests. Tests passed OK --- Subject: OK : Zope-2_6-branch Python-2.1.3 : Linux From: Zope Unit Tests Date: Mon Sep 12 22:21:16 EDT 2005 URL: http://mail.zope.org/pipermail/zope-tests/2005-September/003071.html Subject: OK : Zope-2_6-branch Python-2.3.5 : Linux From: Zope Unit Tests Date: Mon Sep 12 22:22:46 EDT 2005 URL: http://mail.zope.org/pipermail/zope-tests/2005-September/003072.html Subject: OK : Zope-2_7-branch Python-2.3.5 : Linux From: Zope Unit Tests Date: Mon Sep 12 22:24:16 EDT 2005 URL: http://mail.zope.org/pipermail/zope-tests/2005-September/003073.html Subject: OK : Zope-2_7-branch Python-2.4.1 : Linux From: Zope Unit Tests Date: Mon Sep 12 22:25:46 EDT 2005 URL: http://mail.zope.org/pipermail/zope-tests/2005-September/003074.html Subject: OK : Zope-2_8-branch Python-2.3.5 : Linux From: Zope Unit Tests Date: Mon Sep 12 22:27:17 EDT 2005 URL: http://mail.zope.org/pipermail/zope-tests/2005-September/003075.html Subject: OK : Zope-2_8-branch Python-2.4.1 : Linux From: Zope Unit Tests Date: Mon Sep 12 22:28:47 EDT 2005 URL: http://mail.zope.org/pipermail/zope-tests/2005-September/003076.html Subject: OK : Zope-trunk Python-2.3.5 : Linux From: Zope Unit Tests Date: Mon Sep 12 22:30:17 EDT 2005 URL: http://mail.zope.org/pipermail/zope-tests/2005-September/003077.html Subject: OK : Zope-trunk Python-2.4.1 : Linux From: Zope Unit Tests Date: Mon Sep 12 22:31:47 EDT 2005 URL: http://mail.zope.org/pipermail/zope-tests/2005-September/003078.html ___ Zope-Coders mailing list Zope-Coders@zope.org http://mail.zope.org/mailman/listinfo/zope-coders
Re: [Zope-dev] Re: Speed win in Python's urllib.quote
(zope3-dev trimmed) Hi Tres, Tres Seaver wrote: On further consideration (and after some more profiling), I would actually prefer inlining the speedup code directly into OFS.Traversable.Traversable, to remove the extra function call as well as to avoid the gnarliness of monkey-patching Python. Fair enough :-) An alternative would be to call 'quote' only once (for the completed string), rather than repeatedly (for each path element). Wouldn't that then encode all the /'es? cheers, Chris -- Simplistix - Content Management, Zope Python Consulting - http://www.simplistix.co.uk ___ Zope-Dev maillist - Zope-Dev@zope.org http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Re: [Zope3-dev] Re: Speed win in Python's urllib.quote
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Actually, this is public : http://public.dev.nuxeo.com/~ben/funkload/ :) J. Martijn Pieters wrote: Martijn Pieters wrote: Is this site ment to be public? The name doesn't resolve for me. Is the head from http://svn.nuxeo.org/trac/pub/browser/funkload/ sufficient? Reply to self: in the zope3 list the answer to the above question has been found; it was Yes. Martijn Pieters ___ Zope-Dev maillist - Zope-Dev@zope.org http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope ) - -- Julien Anguenot | Nuxeo RD (Paris, France) CPS Platform : http://www.cps-project.org Zope3 / ECM : http://www.z3lab.org mail: anguenot at nuxeo.com; tel: +33 (0) 6 72 57 57 66 -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.1 (GNU/Linux) Comment: Using GnuPG with Fedora - http://enigmail.mozdev.org iD8DBQFDJqEDGhoG8MxZ/pIRAgCfAJ9yNblBWJ9s9iTYHWGqsObcXZHP1gCfR2Xh /nLeoaYhJazqtKi2ELStO04= =Wod1 -END PGP SIGNATURE- ___ Zope-Dev maillist - Zope-Dev@zope.org http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Re: Speed win in Python's urllib.quote
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1
Chris Withers wrote:
Tres Seaver wrote:
On further consideration (and after some more profiling), I would
actually prefer inlining the speedup code directly into
OFS.Traversable.Traversable, to remove the extra function call as well
as to avoid the gnarliness of monkey-patching Python.
Fair enough :-)
An alternative
would be to call 'quote' only once (for the completed string), rather
than repeatedly (for each path element).
Wouldn't that then encode all the /'es?
No -- urllib.quote takes a 'safe' argument, which defaults to '/', as an
extension to the 'always_safe' set::
$ python2.3
Python 2.3.5 (#2, Aug 30 2005, 13:43:24)
[GCC 3.3.5 (Debian 1:3.3.5-8ubuntu2)] on linux2
Type help, copyright, credits or license for more information.
from urllib import quote
quote('/abc/def/ghi')
'/abc/def/ghi'
Tres.
- --
===
Tres Seaver +1 202-558-7113 [EMAIL PROTECTED]
Palladion Software Excellence by Designhttp://palladion.com
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.2.5 (GNU/Linux)
Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org
iD8DBQFDJqPx+gerLs4ltQ4RAqI4AKDEP6eiq/IzrYISuYM1AbJYAWQvWwCfXCYE
7AXqhMubzcfedZwO0Gr77x8=
=o9gI
-END PGP SIGNATURE-
___
Zope-Dev maillist - Zope-Dev@zope.org
http://mail.zope.org/mailman/listinfo/zope-dev
** No cross posts or HTML encoding! **
(Related lists -
http://mail.zope.org/mailman/listinfo/zope-announce
http://mail.zope.org/mailman/listinfo/zope )
Re: [Zope] Problem with Photo Folder
On 12 Sep 2005, at 18:45, Peter Bengtsson wrote:Just checking... sure you've got sufficient hardrive space? Yes, unless 3 Gigs (on a SCSI RAID) is not enough for these kind of things.Cheers___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
[Zope] MemoryError that brings my zope to its knees
In the last month I have started to get these errors using Zope 2.7.7 in a ZEO configuration with one client and one storage server: -- 2005-09-12T23:46:07 ERROR(200) ZODB Couldn't load state for 0x055ba7 Traceback (most recent call last): File /usr/local/Zope/lib/python/ZODB/Connection.py, line 600, in setstate self._set_ghost_state(obj, p) File /usr/local/Zope/lib/python/ZODB/Connection.py, line 639, in _set_ghost_state state = unpickler.load() MemoryError -- 2005-09-12T23:46:07 ERROR(200) SiteError Error while logging Traceback (most recent call last): File /usr/local/Zope/lib/python/Products/SiteErrorLog/SiteErrorLog.py, line 142, in raising tb_text = ''.join( MemoryError Sometimes I see this too: -- 2005-09-06T15:23:30 ERROR(200) ZServer uncaptured python exception, closing channel select-trigger (pipe) at bd9104c (exceptions.MemoryError: [/usr/local/lib/python2.3/asyncore.py|read|69] [/usr/local/lib/python2.3/asyncore.py|handle_read_event|390] [/usr/local/Zope/lib/python/ZServer/medusa/thread/select_trigger.py|handle_read|77] [/usr/local/lib/python2.3/asyncore.py|recv|342] [/usr/local/lib/python2.3/asyncore.py|recv|523]) And this one also brings the show down: -- 2005-09-06T05:35:51 ERROR(200) zrpc:30832 can't decode message: (M2'K\x00U\x06.reply(TW\x00\x01\x00((U\tOFS.Imageq\x01U... -- 2005-09-06T05:35:51 ERROR(200) zrpc-conn(C):localhost:6100 Error caught in asyncore Traceback (most recent call last): File /usr/local/lib/python2.3/asyncore.py, line 69, in read obj.handle_read_event() File /usr/local/lib/python2.3/asyncore.py, line 390, in handle_read_event self.handle_read() File /usr/local/Zope/lib/python/ZEO/zrpc/smac.py, line 217, in handle_read self.message_input(msg) File /usr/local/Zope/lib/python/ZEO/zrpc/connection.py, line 339, in message_input msgid, flags, name, args = self.marshal.decode(message) File /usr/local/Zope/lib/python/ZEO/zrpc/marshal.py, line 39, in decode return unpickler.load() # msgid, flags, name, args MemoryError It completely locks up the zope until I restart. I added more RAM to the box and also bumped up the zeo cache-size to 100MB and 1 objects in the zope.conf. I also changed over from binding to an external ethernet interface and bound the zeo stuff to the localhost interface. Any ideas on other things I could try? Thanks, Calvin -- S i x F e e t U p | Nowhere to go but open-source Silicon Valley: +1 (650) 401-8579 | Midwest: +1 (317) 861-5948 Toll-Free: 1-866-SIX-FEET mailto:[EMAIL PROTECTED] http://www.sixfeetup.com | Zope Hosting from $19.95/month ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
RE: [Zope] MemoryError that brings my zope to its knees
What's the amount of RAM you have ? Have you changed the default pool-size in the zodb section ? Pascal -Message d'origine- De : [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] la part de Calvin Hendryx-Parker Envoyé : mardi 13 septembre 2005 11:44 À : zope@zope.org Objet : [Zope] MemoryError that brings my zope to its knees In the last month I have started to get these errors using Zope 2.7.7 in a ZEO configuration with one client and one storage server: -- 2005-09-12T23:46:07 ERROR(200) ZODB Couldn't load state for 0x055ba7 Traceback (most recent call last): File /usr/local/Zope/lib/python/ZODB/Connection.py, line 600, in setstate self._set_ghost_state(obj, p) File /usr/local/Zope/lib/python/ZODB/Connection.py, line 639, in _set_ghost_state state = unpickler.load() MemoryError -- 2005-09-12T23:46:07 ERROR(200) SiteError Error while logging Traceback (most recent call last): File /usr/local/Zope/lib/python/Products/SiteErrorLog/SiteErrorLog.py, line 142, in raising tb_text = ''.join( MemoryError Sometimes I see this too: -- 2005-09-06T15:23:30 ERROR(200) ZServer uncaptured python exception, closing channel select-trigger (pipe) at bd9104c (exceptions.MemoryError: [/usr/local/lib/python2.3/asyncore.py|read|69] [/usr/local/lib/python2.3/asyncore.py|handle_read_event|390] [/usr/local/Zope/lib/python/ZServer/medusa/thread/select_trigger.py|handle_r ead|77] [/usr/local/lib/python2.3/asyncore.py|recv|342] [/usr/local/lib/python2.3/asyncore.py|recv|523]) And this one also brings the show down: -- 2005-09-06T05:35:51 ERROR(200) zrpc:30832 can't decode message: (M2'K\x00U\x06.reply(TW\x00\x01\x00((U\tOFS.Imageq\x01U... -- 2005-09-06T05:35:51 ERROR(200) zrpc-conn(C):localhost:6100 Error caught in asyncore Traceback (most recent call last): File /usr/local/lib/python2.3/asyncore.py, line 69, in read obj.handle_read_event() File /usr/local/lib/python2.3/asyncore.py, line 390, in handle_read_event self.handle_read() File /usr/local/Zope/lib/python/ZEO/zrpc/smac.py, line 217, in handle_read self.message_input(msg) File /usr/local/Zope/lib/python/ZEO/zrpc/connection.py, line 339, in message_input msgid, flags, name, args = self.marshal.decode(message) File /usr/local/Zope/lib/python/ZEO/zrpc/marshal.py, line 39, in decode return unpickler.load() # msgid, flags, name, args MemoryError It completely locks up the zope until I restart. I added more RAM to the box and also bumped up the zeo cache-size to 100MB and 1 objects in the zope.conf. I also changed over from binding to an external ethernet interface and bound the zeo stuff to the localhost interface. Any ideas on other things I could try? Thanks, Calvin -- S i x F e e t U p | Nowhere to go but open-source Silicon Valley: +1 (650) 401-8579 | Midwest: +1 (317) 861-5948 Toll-Free: 1-866-SIX-FEET mailto:[EMAIL PROTECTED] http://www.sixfeetup.com | Zope Hosting from $19.95/month ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev ) ** This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the system manager. This footnote also confirms that this email message has been swept by MIMEsweeper for the presence of computer viruses. www.mimesweeper.com ** ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
[Zope] Re: MemoryError that brings my zope to its knees
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Calvin Hendryx-Parker wrote: In the last month I have started to get these errors using Zope 2.7.7 in a ZEO configuration with one client and one storage server: -- 2005-09-12T23:46:07 ERROR(200) ZODB Couldn't load state for 0x055ba7 Traceback (most recent call last): File /usr/local/Zope/lib/python/ZODB/Connection.py, line 600, in setstate self._set_ghost_state(obj, p) File /usr/local/Zope/lib/python/ZODB/Connection.py, line 639, in _set_ghost_state state = unpickler.load() MemoryError -- 2005-09-12T23:46:07 ERROR(200) SiteError Error while logging Traceback (most recent call last): File /usr/local/Zope/lib/python/Products/SiteErrorLog/SiteErrorLog.py, line 142, in raising tb_text = ''.join( MemoryError Sometimes I see this too: -- 2005-09-06T15:23:30 ERROR(200) ZServer uncaptured python exception, closing channel select-trigger (pipe) at bd9104c (exceptions.MemoryError: [/usr/local/lib/python2.3/asyncore.py|read|69] [/usr/local/lib/python2.3/asyncore.py|handle_read_event|390] [/usr/local/Zope/lib/python/ZServer/medusa/thread/select_trigger.py|handle_read|77] [/usr/local/lib/python2.3/asyncore.py|recv|342] [/usr/local/lib/python2.3/asyncore.py|recv|523]) That is not a problem -- some client disconnected before Zope finished processing the request. And this one also brings the show down: -- 2005-09-06T05:35:51 ERROR(200) zrpc:30832 can't decode message: (M2'K\x00U\x06.reply(TW\x00\x01\x00((U\tOFS.Imageq\x01U... -- 2005-09-06T05:35:51 ERROR(200) zrpc-conn(C):localhost:6100 Error caught in asyncore Traceback (most recent call last): File /usr/local/lib/python2.3/asyncore.py, line 69, in read obj.handle_read_event() File /usr/local/lib/python2.3/asyncore.py, line 390, in handle_read_event self.handle_read() File /usr/local/Zope/lib/python/ZEO/zrpc/smac.py, line 217, in handle_read self.message_input(msg) File /usr/local/Zope/lib/python/ZEO/zrpc/connection.py, line 339, in message_input msgid, flags, name, args = self.marshal.decode(message) File /usr/local/Zope/lib/python/ZEO/zrpc/marshal.py, line 39, in decode return unpickler.load() # msgid, flags, name, args MemoryError It completely locks up the zope until I restart. I added more RAM to the box and also bumped up the zeo cache-size to 100MB and 1 objects in the zope.conf. I also changed over from binding to an external ethernet interface and bound the zeo stuff to the localhost interface. Any ideas on other things I could try? - Try 'memtest' or an equivalent on the box to verify that you don't have a flaky RAM chip. - If you are RAM constrained, *reduce* the number of objects in the connection cache; more objects in that cache requires more RAM. Leaving the on-disk cache size high shouldn't be a problem. - Add swap space, if possible (swapping will be painful, but better than a lockup). Tres. - -- === Tres Seaver +1 202-558-7113 [EMAIL PROTECTED] Palladion Software Excellence by Designhttp://palladion.com -BEGIN PGP SIGNATURE- Version: GnuPG v1.2.5 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org iD8DBQFDJqbB+gerLs4ltQ4RAj4HAJ4vCNeuoqIH8kDXbVzp6YTbjDn2LgCgqnzo bNaH6hDz9QBA5gCg+xcCyCs= =osoi -END PGP SIGNATURE- ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] Problem with Photo Folder
Then I don't know. Try the comp.lang.python group On 9/13/05, David [EMAIL PROTECTED] wrote: On 12 Sep 2005, at 18:45, Peter Bengtsson wrote: Just checking... sure you've got sufficient hardrive space? Yes, unless 3 Gigs (on a SCSI RAID) is not enough for these kind of things. Cheers -- Peter Bengtsson, work www.fry-it.com home www.peterbe.com hobby www.issuetrackerproduct.com ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
[Zope] Zope iso-8859-1 to utf-8
Hi, I have been running a Zope installation for 2 years, so there are now lots of objects, properties, etc... I would like to know what are the possible issues I may have to face if I change the default encoding for iso-8859-1 to utf-8 in ZMI. Thanks. Pascal ** This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the system manager. This footnote also confirms that this email message has been swept by MIMEsweeper for the presence of computer viruses. www.mimesweeper.com ** ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
RE: [Zope] MemoryError that brings my zope to its knees
That looks wierd... Has the instance been running for a while when you copied the content of the Cache Parameters tab ? I would have expected many more connections (instead of just 2). Can you give us your zserver-threads value (zope.conf) ? Thanks. Pascal -Message d'origine- De : Calvin Hendryx-Parker [mailto:[EMAIL PROTECTED] Envoyé : mardi 13 septembre 2005 13:51 À : Pascal Peregrina Cc : zope@zope.org Objet : Re: [Zope] MemoryError that brings my zope to its knees On Sep 13, 2005, at 12:00 PM, Pascal Peregrina wrote: What's the amount of RAM you have ? When we started having this problem the box only had 1GB of RAM so we replaced that RAM completely and put in a fresh 4GB of RAM to hopefully get rid of the problem. This box is also running 3 other Zope instances, but the other don't exhibit this problem. This instance has 15 plone site instances in it. The others only have a couple plone sites each. This problem will happen and there will still be 1GB of free RAM and it hasn't touched the swap at all. We are running FreeBSD 4.10 on this box. Have you changed the default pool-size in the zodb section ? I'm assuming it isn't changed since it isn't in our zope.conf. Must be a newer config that we didn't have from an old zope that this one was upgraded from. Here are the details from the Cache Parameters tab in the ZMI on this ZEO instance: Total number of objects in the database 282934 Total number of objects in memory from all caches6512 Target number of objects in memory per cache1 Total number of objects in each cache: Cache Name Number of active objectsTotal active and non-active objects Connection at 09e5684c604818746 Connection at 0e92902c464 1249 Total 6512 Thanks, Calvin -- S i x F e e t U p | Nowhere to go but open source Silicon Valley: +1 (650) 401-8579 x602 Midwest: +1 (317) 861-5948 x602 Toll-Free: 1-866-SIX-FEET mailto:[EMAIL PROTECTED] http://www.sixfeetup.com | Zope Hosting from $19.95/month ** This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the system manager. This footnote also confirms that this email message has been swept by MIMEsweeper for the presence of computer viruses. www.mimesweeper.com ** ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
[Zope] Re: MemoryError that brings my zope to its knees
On Sep 13, 2005, at 12:00 PM, Pascal Peregrina wrote: What's the amount of RAM you have ? When we started having this problem the box only had 1GB of RAM so we replaced that RAM completely and put in a fresh 4GB of RAM to hopefully get rid of the problem. This box is also running 3 other Zope instances, but the other don't exhibit this problem. This instance has 15 plone site instances in it. The others only have a couple plone sites each. This problem will happen and there will still be 1GB of free RAM and it hasn't touched the swap at all. We are running FreeBSD 4.10 on this box. Have you changed the default pool-size in the zodb section ? I'm assuming it isn't changed since it isn't in our zope.conf. Must be a newer config that we didn't have from an old zope that this one was upgraded from. Here are the details from the Cache Parameters tab in the ZMI on this ZEO instance: Total number of objects in the database 282934 Total number of objects in memory from all caches6512 Target number of objects in memory per cache1 Total number of objects in each cache: Cache Name Number of active objectsTotal active and non-active objects Connection at 09e5684c604818746 Connection at 0e92902c464 1249 Total 6512 Thanks, Calvin -- S i x F e e t U p | Nowhere to go but open-source Silicon Valley: +1 (650) 401-8579 | Midwest: +1 (317) 861-5948 Toll-Free: 1-866-SIX-FEET mailto:[EMAIL PROTECTED] http://www.sixfeetup.com | Zope Hosting from $19.95/month ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
[Zope] Monkey patching Z2.log
Hi, Can somebody tell me what I should monkey patch if I need to alter Z2.log logging in order to append a particular request environment value ? I triedbut I got lost trying to find PublisherHTTPServer and ZPublisher relationship... Thanks a lot. Pascal ** This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the system manager. This footnote also confirms that this email message has been swept by MIMEsweeper for the presence of computer viruses. www.mimesweeper.com ** ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
[Zope] Re: MemoryError that brings my zope to its knees
Pascal Peregrina wrote: That looks wierd... Has the instance been running for a while when you copied the content of the Cache Parameters tab ? I would have expected many more connections (instead of just 2). Can you give us your zserver-threads value (zope.conf) ? It is not set so I assume it should be the default, but the default is supposed to be 4. Would you suggest raising this number? Thanks, Calvin -- S i x F e e t U p | Nowhere to go but open-source Silicon Valley: +1 (650) 401-8579 | Midwest: +1 (317) 861-5948 Toll-Free: 1-866-SIX-FEET mailto:[EMAIL PROTECTED] http://www.sixfeetup.com | Zope Hosting from $19.95/month ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
[Zope] Re: Zope iso-8859-1 to utf-8
Pascal Peregrina wrote: Hi, I have been running a Zope installation for 2 years, so there are now lots of objects, properties, etc... I would like to know what are the possible issues I may have to face if I change the default encoding for iso-8859-1 to utf-8 in ZMI. You must write a script that converts any property on any object in your site that is latin-1 to utf-8. So first find all objects you use. See what types they are. Find all text and string attributes on those opjects. Write a function that converts from latin to utf and run that on every object. The hard part will be finding all the attributes, but perhaps you can write a method that can help find those properties for you using introspection. -- hilsen/regards Max M, Denmark http://www.mxm.dk/ IT's Mad Science ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
[Zope] FCGIServer broken pipe on Zope 2.8.1?
Any suggestions as to what is causing this kind of problem? I've never seen this in our environment on Zope 2.7.x - it just started after a fresh install of 2.8.1. i386 Linux, Py 2.3.5, Zope 2.8.1, plone 2.1 --- ERROR ZServer uncaptured python exception, closing channel ZServer.FCGIServer.FCGIChannel connected '' at 0xb3d34f2c (socket.error:(32, 'Broken pipe') [/home/.../zope/python/2.3.5/lib/python2.3/asynchat.py|initiate_send|218] [/home/.../zope/python/2.3.5/lib/python2.3/asyncore.py|send|337]) --- Thanks, Petri ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
RE: [Zope] Re: Zope iso-8859-1 to utf-8
I see... And what python function would you use for conversion ? I made some tests and was surprised of the results... I switched ZMI to UTF-8 (management_page_charset) and edited some of my documents / properties and all went fine. The generated documents are still sent to browsers as iso-8859-1, and are not broken. So my question would be : which valid UTF-8 characters (for typical Western languages like English, French, Spanish, ...) would be invalid in iso-8859-1 ? Last thing, if ZMI is switched to UTF-8, then what is the difference between ustring/string, etc properties ? Thanks. Pascal -Message d'origine- De : [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] la part de Max M Envoyé : mardi 13 septembre 2005 14:51 À : zope@zope.org Objet : [Zope] Re: Zope iso-8859-1 to utf-8 Pascal Peregrina wrote: Hi, I have been running a Zope installation for 2 years, so there are now lots of objects, properties, etc... I would like to know what are the possible issues I may have to face if I change the default encoding for iso-8859-1 to utf-8 in ZMI. You must write a script that converts any property on any object in your site that is latin-1 to utf-8. So first find all objects you use. See what types they are. Find all text and string attributes on those opjects. Write a function that converts from latin to utf and run that on every object. The hard part will be finding all the attributes, but perhaps you can write a method that can help find those properties for you using introspection. -- hilsen/regards Max M, Denmark http://www.mxm.dk/ IT's Mad Science ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev ) ** This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the system manager. This footnote also confirms that this email message has been swept by MIMEsweeper for the presence of computer viruses. www.mimesweeper.com ** ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
[Zope] Re: MemoryError that brings my zope to its knees
This problem will happen and there will still be 1GB of free RAM and it hasn't touched the swap at all. We are running FreeBSD 4.10 on this box. the kernel limits the amount of ram a process can bind by default. try the following put this in /boot/loader.conf kern.maxdsiz=1610612736 kern.dfldsiz=1610612736 kerm.maxssiz=1610612736 put the following into your kernel conf file, rebuild your kernel and reboot: options MAXDSIZ=(768*1024*1024) options MAXSSIZ=(256*1024*1024) options DFLDSIZ=(768*1024*1024) the values are examples only, you will need to play with them to find the right ones. keep in mind that the wrong ones, e if you put them too close to the amount of physical ram in the box could cause the box not to boot. hth ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] Problem with Photo Folder
On 9/13/05, David [EMAIL PROTECTED] wrote: On 12 Sep 2005, at 18:45, Peter Bengtsson wrote: Just checking... sure you've got sufficient hardrive space? Yes, unless 3 Gigs (on a SCSI RAID) is not enough for these kind of things. check /tmp, /var/tmp. is there enogh space there? the traceback points to insufficient space. probably partition is full? Cheers ___Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope** No cross posts or HTML encoding! **(Related lists - http://mail.zope.org/mailman/listinfo/zope-announcehttp://mail.zope.org/mailman/listinfo/zope-dev )-- http://myzope.kedai.com.my - my-zope org ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] Zope 2.8.1 won't make
The problem was that I had a : in the path of the install directory. Once I fixed it, everything worked great. Thanks to all who responded!! SG --- Sophia Grimm [EMAIL PROTECTED] wrote: Just downloaded Zope 2.8.1 and I'm trying to install it on MOSX 10.4, which has XCode 2.1 installed. I'm following installation instructions on this page: http://www.plope.com/Books/2_7Edition/InstallingZope.stx#2-6 ./configure runs, but when I try to make, I get this error: makefile:54: *** target pattern contains no `%'. Stop. This happens regardless of the python or prefix I use as arguments when I configure. I've used Python 2.3.5 which comes with MOXS 10.4, and I've used Python 2.3.5 as installed by Fink. I don't understand what this error means. Any ideas, anyone? Thanks in advance. SG __ Do You Yahoo!? Tired of spam? Yahoo! Mail has the best spam protection around http://mail.yahoo.com ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev ) __ Yahoo! Mail - PC Magazine Editors' Choice 2005 http://mail.yahoo.com ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
[Zope] mysql-python build error
I installed Plone 2.1 from the binary installer at plone.org and MySQL 4.1 from the binary at mysql.com. When attempting to build MySQL-python-1.2.0 on MOSX 10.4.2 client, I get this error: sh: line 1: mysql_config: command not found sh: line 1: mysql_config: command not found running build running build_py running build_ext building '_mysql' extension gcc -bundle -undefined dynamic_lookup build/temp.darwin-8.2.0-Power_Macintosh-2.3/_mysql.o -L/usr/local/mysql/include -lz -lmysqld -o build/lib.darwin-8.2.0-Power_Macintosh-2.3/_mysql.so /usr/bin/ld: can't locate file for: -lmysqld collect2: ld returned 1 exit status error: command 'gcc' failed with exit status 1 Obviously, it's looking for -lmysqld. I don't know where to change setup.py (or what to change it to) so this will work. Any tips are appreciated!! SG __ Yahoo! Mail - PC Magazine Editors' Choice 2005 http://mail.yahoo.com ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] RFC: Requiring Python 2.4 in Zope 2.9
--On 8. September 2005 08:48:18 +0100 Chris Withers [EMAIL PROTECTED] wrote: Jim Fulton wrote: At: http://www.zope.org/Wikis/DevSite/Proposals/RequirePython24 Is a proposal to require Python 2.4 for Zope 2.9 (to be released this December). Comments are welcome. :) Well, it'd be nice if Python 2.4 was at least acceptable for 2.8.x first, so the 3rd part products have some chance of finding 2.4 bugs... I agree with Jens that system requirements should not be a moving target within a major release. If you want to use Python 2.4 now with Zope 2.8 than use it at your own risk. 2.8 is now in maintenance mode and in general frozen for such core issues. -aj pgpBAW4d5AUYf.pgp Description: PGP signature ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] FCGIServer broken pipe on Zope 2.8.1?
--On 13. September 2005 13:56:03 +0100 Petri Savolainen [EMAIL PROTECTED] wrote: Any suggestions as to what is causing this kind of problem? I've never seen this in our environment on Zope 2.7.x - it just started after a fresh install of 2.8.1. i386 Linux, Py 2.3.5, Zope 2.8.1, plone 2.1 --- ERROR ZServer uncaptured python exception, closing channel ZServer.FCGIServer.FCGIChannel connected '' at 0xb3d34f2c (socket.error:(32, 'Broken pipe') [/home/.../zope/python/2.3.5/lib/python2.3/asynchat.py|initiate_send|218] [/home/.../zope/python/2.3.5/lib/python2.3/asyncore.py|send|337]) --- No idea about this error but FCGI in Zope is in general considered to be obsolete, deprecated and unsupported. -aj pgpNqOpU1iaRX.pgp Description: PGP signature ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
[Zope] Re: mysql-python build error
On Tue, 13 Sep 2005 18:51:24 +0200, Sophia Grimm [EMAIL PROTECTED] wrote: I installed Plone 2.1 from the binary installer at plone.org and MySQL 4.1 from the binary at mysql.com. When attempting to build MySQL-python-1.2.0 on MOSX 10.4.2 client, I get this error: error: command 'gcc' failed with exit status 1 Obviously, it's looking for -lmysqld. I don't know where to change setup.py (or what to change it to) so this will work. Any tips are appreciated!! If you are doing any serious work with UNIX tools on Mac OS X, I recommend DarwinPorts: http://www.darwinports.org I'm not sure if they have your particular package, but since Python and MySQL is so common, I would assume they do. -- _ Alexander Limi · Chief Architect · Plone Solutions · Norway Consulting · Training · Development · http://www.plonesolutions.com _ Plone Co-Founder · http://plone.org · Connecting Content Plone Foundation · http://plone.org/foundation · Protecting Plone ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] Problem with Photo Folder
On Mon September 12 2005 12:52 pm, David wrote: We are using the ZODB for storage and ImageMagick as the engine. Module Products.Photo.Photo, line 363, in _resize Module popen2, line 147, in popen2 Module popen2, line 42, in __init__ OSError: [Errno 12] Not enough space ImageMagick is running out of disk space when trying to generate a display. Check the file systems of /tmp, /var/tmp, or wherever ImageMagick is using for temp space. -- Ron ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] need help moving zope instance home data to new one w/ new python version
[EMAIL PROTECTED] wrote at 2005-9-12 21:52 -0700: To move old zope instance home to new one can i just 1. make new zope instance home 2. copy over Data.fs? zope plone barfed on python2.4... must i downgrade to 2.3? No. Zope runs happily on Python 2.4. However, there is no garantee that there are no security holes (a security audit has not yet been performed). If that is not a problem for you (it is not for me, e.g.), then you can use Zope with Python 2.4. -- Dieter ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] About High Level Query Languages
Enrique Arizón wrote at 2005-9-12 18:19 +0200: I was browsing different solutions/products to query the Catalog with a high level language similar to SQL and it looks to be more than one solution: http://www.zope.org/search?SearchableText=Query+Language The question is whether an standard query language exists or not yet for Zope/Plone. There is no standard query language similar to SQL for Zope/Plone. One reason: Zope/Plone is not a relational system. -- Dieter ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] FCGIServer broken pipe on Zope 2.8.1?
Petri Savolainen wrote at 2005-9-13 13:56 +0100: Any suggestions as to what is causing this kind of problem? I've never seen this in our environment on Zope 2.7.x - it just started after a fresh install of 2.8.1. i386 Linux, Py 2.3.5, Zope 2.8.1, plone 2.1 --- ERROR ZServer uncaptured python exception, closing channel ZServer.FCGIServer.FCGIChannel connected '' at 0xb3d34f2c (socket.error:(32, 'Broken pipe') [/home/.../zope/python/2.3.5/lib/python2.3/asynchat.py|initiate_send|218] [/home/.../zope/python/2.3.5/lib/python2.3/asyncore.py|send|337]) The FCGI client (probably Apache) closed the connection (maybe it died). -- Dieter ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] need help moving zope instance home data to new one w/ new python version
Tino Wildenhain wrote at 2005-9-13 07:40 +0200: ... must i downgrade to 2.3? Yes. See doc/INSTALL.txt :-) One of the points is you compiled your extensions for python 2.3, and therefore you need 2.3 to run it. This is often true, but not for Python 2.3 versus Python 2.4: Python 2.4 did not change the C API. Extensions generated for Python 2.3 can be used for Python 2.4 as well. -- Dieter ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
RE: [Zope] Re: Zope iso-8859-1 to utf-8
Pascal Peregrina wrote at 2005-9-13 14:21 +0100:
I see... And what python function would you use for conversion ?
unicode(iso_string, 'iso-8859-1').encode('utf-8')
I made some tests and was surprised of the results...
I switched ZMI to UTF-8 (management_page_charset) and edited some of my
documents / properties and all went fine.
Strange. I had expected that non-ASCII characters were displayed
in a wrong way.
The generated documents are still sent to browsers as iso-8859-1, and are
not broken.
If you switched to utf-8, then *you* should ensure that
they are sent as utf-8.
So my question would be : which valid UTF-8 characters (for typical Western
languages like English, French, Spanish, ...) would be invalid in iso-8859-1
This is a strange question...
The problem does not lie with the characters but with their codes.
The code agrees between UTF-8 and iso-8859-1 for precisely the
ASCII characters (unicode chars 0-127). Unicode characters
128-255 use 2 bytes in UTF-8 but 1 in iso-8859-1. Unicode characters
256 and up can be represented encoded in UTF-8 but not iso-8859-1.
...
Last thing, if ZMI is switched to UTF-8, then what is the difference between
ustring/string, etc properties ?
ustring is a unicode string: stored inside Zope as unicode,
sent to the browser UTF-8 encoded and expected to come back
UTF-8 encoded.
string is a plain (non unicode) string. It should use
the encoding of your page (UTF-8, once you switched to UTF-8).
--
Dieter
___
Zope maillist - Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
** No cross posts or HTML encoding! **
(Related lists -
http://mail.zope.org/mailman/listinfo/zope-announce
http://mail.zope.org/mailman/listinfo/zope-dev )
[Zope] How to create an ansynchronous method
Hi. I have a workflow that is triggered by a file upload and the processing of the file can be minutes of processing depending upon the size of the file uploaded. I am concerned about number of threads available to serve zope so I believe this is a good candidate for an asynchronous process. I am looking for some type of outline to do this. Currently a tool does the work that is triggered by workflow script. My hope is to have this process run and send the user an email to advise when the process has completed instead of the user waiting for a response or potentially timing out waiting for one. What steps could I take to make this an ansynchronous process? Also wanted to confirm whether an asynchronous process would free the thread and how one can determine whether a thread has been released. Many thanks. Regards, David ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] Re: Zope iso-8859-1 to utf-8
Thanks Dieter, you are right, I was a little confused.
I think that if my pages did not break so far it's because we use html
entities for non standard characters...
I will have to convert everything in a rush now to avoid issues :(
--
(sent from my BlackBerry)
-Original Message-
From: Dieter Maurer [EMAIL PROTECTED]
To: Pascal Peregrina [EMAIL PROTECTED]
CC: 'Max M' [EMAIL PROTECTED]; zope@zope.org zope@zope.org
Sent: Tue Sep 13 19:10:08 2005
Subject: RE: [Zope] Re: Zope iso-8859-1 to utf-8
Pascal Peregrina wrote at 2005-9-13 14:21 +0100:
I see... And what python function would you use for conversion ?
unicode(iso_string, 'iso-8859-1').encode('utf-8')
I made some tests and was surprised of the results...
I switched ZMI to UTF-8 (management_page_charset) and edited some of my
documents / properties and all went fine.
Strange. I had expected that non-ASCII characters were displayed
in a wrong way.
The generated documents are still sent to browsers as iso-8859-1, and are
not broken.
If you switched to utf-8, then *you* should ensure that
they are sent as utf-8.
So my question would be : which valid UTF-8 characters (for typical Western
languages like English, French, Spanish, ...) would be invalid in
iso-8859-1
This is a strange question...
The problem does not lie with the characters but with their codes.
The code agrees between UTF-8 and iso-8859-1 for precisely the
ASCII characters (unicode chars 0-127). Unicode characters
128-255 use 2 bytes in UTF-8 but 1 in iso-8859-1. Unicode characters
256 and up can be represented encoded in UTF-8 but not iso-8859-1.
...
Last thing, if ZMI is switched to UTF-8, then what is the difference
between
ustring/string, etc properties ?
ustring is a unicode string: stored inside Zope as unicode,
sent to the browser UTF-8 encoded and expected to come back
UTF-8 encoded.
string is a plain (non unicode) string. It should use
the encoding of your page (UTF-8, once you switched to UTF-8).
--
Dieter
**
This email and any files transmitted with it are confidential and
intended solely for the use of the individual or entity to whom they
are addressed. If you have received this email in error please notify
the system manager.
This footnote also confirms that this email message has been swept by
MIMEsweeper for the presence of computer viruses.
www.mimesweeper.com
**
___
Zope maillist - Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
** No cross posts or HTML encoding! **
(Related lists -
http://mail.zope.org/mailman/listinfo/zope-announce
http://mail.zope.org/mailman/listinfo/zope-dev )
[Zope] Captcha
Is anybody aware of a ready to goZope product for using creating/usingCaptcha? ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
[Zope] how dump Zope database content into a file system directory tree?
Possible to dump content in Zope database into a file system tree? Chris -- ___ Christian Seberino, Ph.D. SPAWAR Systems Center San Diego Code 2872 49258 Mills Street, Room 158 San Diego, CA 92152-5385 U.S.A. Phone: (619) 553-9973 Fax : (619) 553-6521 Email: [EMAIL PROTECTED] ___ ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] how dump Zope database content into a file system directory tree?
[EMAIL PROTECTED] wrote: Possible to dump content in Zope database into a file system tree? Yes. http://www.zope.org/Members/tseaver/FSDump --Jim Washington ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] How to create an ansynchronous method
On Tue September 13 2005 02:52 pm, David Pratt wrote: Hi. I have a workflow that is triggered by a file upload and the processing of the file can be minutes of processing depending upon the size of the file uploaded. I am concerned about number of threads available to serve zope so I believe this is a good candidate for an asynchronous process. I am looking for some type of outline to do this. Currently a tool does the work that is triggered by workflow script. My hope is to have this process run and send the user an email to advise when the process has completed instead of the user waiting for a response or potentially timing out waiting for one. What steps could I take to make this an ansynchronous process? I had to do something like this when processing a lot of data to create PDF documents to send via email. The time to do so was too long for them to sit and wait, so I created a separate process to do the job. I don't know if this is the best way, but it wasn't very difficult and it has been working without problems for many months. When a user requests the document, I add a record of needed information to a MySQL table (the queue), send a signal to the long-running process (described next) and immediately return a thank you page. A separate-from-Zope long-running Python process waits for a signal, reads the queue table, does what it needs to do, empties the processed items from the queue, and goes idle. It can handle things like getting a signal while it's processing a queue and catching up occassionally if it missed a signal (for whatever reason). Hope this helps. -- Ron ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] How to create an ansynchronous method
Hi Ron. Many thanks for your reply. This is also a long running document processing challenge, there can be 100's (or even thousands) of records which is why the time problem. The code it uses in my tool in the CMF. How is it that you send a signal to the long running process? Is the long running process cronned to look for a record in the database or is this starting another server of some type. What I need is something like what you are suggesting - wakes up when there is work in the hopper and chugs along until it is done and then goes to sleep (sort of the way a printing queue works). At the same time it would be great if it was something that had a small RAM footprint or ran without consuming any more than X mbs. The other problem I have with this is that it needs to do work in Zope itself since the final docs end up as objects. I have just found Chris Wither's product called Stepper. I am not sure it this is for this type of situation or more for cronned maintenance. I want to be able to initiate the process right away but asynchronously from the main zope threads. Regards, David On Tuesday, September 13, 2005, at 06:05 PM, Ron Bickers wrote: On Tue September 13 2005 02:52 pm, David Pratt wrote: Hi. I have a workflow that is triggered by a file upload and the processing of the file can be minutes of processing depending upon the size of the file uploaded. I am concerned about number of threads available to serve zope so I believe this is a good candidate for an asynchronous process. I am looking for some type of outline to do this. Currently a tool does the work that is triggered by workflow script. My hope is to have this process run and send the user an email to advise when the process has completed instead of the user waiting for a response or potentially timing out waiting for one. What steps could I take to make this an ansynchronous process? I had to do something like this when processing a lot of data to create PDF documents to send via email. The time to do so was too long for them to sit and wait, so I created a separate process to do the job. I don't know if this is the best way, but it wasn't very difficult and it has been working without problems for many months. When a user requests the document, I add a record of needed information to a MySQL table (the queue), send a signal to the long-running process (described next) and immediately return a thank you page. A separate-from-Zope long-running Python process waits for a signal, reads the queue table, does what it needs to do, empties the processed items from the queue, and goes idle. It can handle things like getting a signal while it's processing a queue and catching up occassionally if it missed a signal (for whatever reason). Hope this helps. -- Ron ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] How to create an ansynchronous method
On Tue September 13 2005 08:16 pm, David Pratt wrote: How is it that you send a signal to the long running process? The long-running process writes a pid file and waits for a SIGUSR1 signal (using Python's signal module). A small External Method, called when the user submits the form, reads the pid file and sends the signal to the process. Is the long running process cronned to look for a record in the database or is this starting another server of some type. It waits for a SIGUSR1 signal from the website, otherwise it's idle. That way it can begin processing immediately but doesn't have to do any periodic checking. I do, however, have a cron job that starts it every 15 minutes in case it dies. The process knows if it's already running, so it's safe to just start it regularly. What I need is something like what you are suggesting - wakes up when there is work in the hopper and chugs along until it is done and then goes to sleep (sort of the way a printing queue works). At the same time it would be great if it was something that had a small RAM footprint or ran without consuming any more than X mbs. The part that waits for the signal is very small, but it loads the Reportlab modules and reads a bunch of data to do the work, so it can get large at times. If it were to just call an external program that dies after doing its work, you could easily keep memory usage low. The other problem I have with this is that it needs to do work in Zope itself since the final docs end up as objects. I have just found Chris Wither's product called Stepper. I am not sure it this is for this type of situation or more for cronned maintenance. I have no idea. Maybe it'll do what you want, but I don't understand what it really does just from the description. The work I needed to do was external to Zope anyway (reading data from a MySQL database, building PDFs with Reportlab, sending email), so it's actually better that I'm outside of it. When I have to run things in Zope from outside, I run curl with a URL of a Python Script that does the work. It's a hack, but I've never had a problem with it. I'm not sure how else you would work in Zope from a process outside of Zope. -- Ron ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
[Zope] Output only the first or a particular record using TAL
Hi all, I wanted to create something of a header using TAL and a Z SQL Method. I have the following code where getCustomerLicenses is my Z SQL Method and it prints out the customer's full name with details: tr tal:repeat=licenses container/getCustomerLicences tdspan tal:replace=licenses/full_namefull_name/span/td tdspan tal:replace=licenses/serial_numberserial_number/span/td !-- code continues with more details -- /tr In it's simplest form, how do I retrieve just the full_name of the first record using TAL. I think I use tal:replace but I'm not sure. I was along the lines of something like this: tr tal:define=x container/getCustomerLicences td tal:replace=x/full_name[0]/td /tr But then I just get a TypeError. I guess if I get this working, I can start playing around with conditions but I'm stuck! Thanks, Julian Yap ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] How to create an ansynchronous method
Hi Ron. I found the following trying to follow up a bit on what you have suggested. I believe it is similar to what you are doing from your explanation. It may be out of date. I have not attempted to daemonize a process to date so it would be great if you could look at this and comment since I need something to work with. http://mail.python.org/pipermail/python-list/2001-February/030814.html As far as interacting with Zope, I have done something similar to build a site remotely from another server but setup https and sent credentials in the urls. I wonder if there is a way to inject them into Zope another way since the daemon is on the machine. I think the ClockServer injects requests into Zope. I believe it is something similar since credentials still need to be in url to execute something but requests are not exposed to the web doing this. Regards, David On Wednesday, September 14, 2005, at 12:11 AM, Ron Bickers wrote: On Tue September 13 2005 08:16 pm, David Pratt wrote: How is it that you send a signal to the long running process? The long-running process writes a pid file and waits for a SIGUSR1 signal (using Python's signal module). A small External Method, called when the user submits the form, reads the pid file and sends the signal to the process. Is the long running process cronned to look for a record in the database or is this starting another server of some type. It waits for a SIGUSR1 signal from the website, otherwise it's idle. That way it can begin processing immediately but doesn't have to do any periodic checking. I do, however, have a cron job that starts it every 15 minutes in case it dies. The process knows if it's already running, so it's safe to just start it regularly. What I need is something like what you are suggesting - wakes up when there is work in the hopper and chugs along until it is done and then goes to sleep (sort of the way a printing queue works). At the same time it would be great if it was something that had a small RAM footprint or ran without consuming any more than X mbs. The part that waits for the signal is very small, but it loads the Reportlab modules and reads a bunch of data to do the work, so it can get large at times. If it were to just call an external program that dies after doing its work, you could easily keep memory usage low. The other problem I have with this is that it needs to do work in Zope itself since the final docs end up as objects. I have just found Chris Wither's product called Stepper. I am not sure it this is for this type of situation or more for cronned maintenance. I have no idea. Maybe it'll do what you want, but I don't understand what it really does just from the description. The work I needed to do was external to Zope anyway (reading data from a MySQL database, building PDFs with Reportlab, sending email), so it's actually better that I'm outside of it. When I have to run things in Zope from outside, I run curl with a URL of a Python Script that does the work. It's a hack, but I've never had a problem with it. I'm not sure how else you would work in Zope from a process outside of Zope. -- Ron ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
