[Zope] cache for python calls
I'm doing a hard task, trying to improve maximum of possible performance to Zope/Plone server, I already installed CacheFu that improved so much performance, I saw on a blog about cache for Python calls but wasn't explained about your configuration or installation. there are any related product for zope to do it or something like that? The main question is improve a better performance to this server. Any tip/solution is welcome. Thanks in advance. Regards, - - iarly selbir | ski0s :wq! ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] cache for python calls
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Before starting with any kind of performance optimization: figure out your bottlenecks first by profiling your code: ZopeProfiler is your friend. - -aj On 17.04.2009 15:10 Uhr, iarly selbir | ski0s wrote: I'm doing a hard task, trying to improve maximum of possible performance to Zope/Plone server, I already installed CacheFu that improved so much performance, I saw on a blog about cache for Python calls but wasn't explained about your configuration or installation. there are any related product for zope to do it or something like that? The main question is improve a better performance to this server. Any tip/solution is welcome. Thanks in advance. Regards, - - iarly selbir | ski0s :wq! ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev ) - -- ZOPYX Ltd. Co. KG - Charlottenstr. 37/1 - 72070 Tübingen - Germany Web: www.zopyx.com - Email: i...@zopyx.com - Phone +49 - 7071 - 793376 Registergericht: Amtsgericht Stuttgart, Handelsregister A 381535 Geschäftsführer/Gesellschafter: ZOPYX Limited, Birmingham, UK - E-Publishing, Python, Zope Plone development, Consulting -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.9 (Darwin) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAknogKoACgkQCJIWIbr9KYxycgCg2WmTMZwhYQjx5Gc9ulAys8Lb ILYAnAgyB5Oyq5ed77blQY3rpHBa/tUC =1wfI -END PGP SIGNATURE- begin:vcard fn:Andreas Jung n:Jung;Andreas org:ZOPYX Ltd. Co. KG adr;quoted-printable:;;Charlottenstr. 37/1;T=C3=BCbingen;;72070;Germany email;internet:i...@zopyx.com title:CEO tel;work:+49-7071-793376 tel;fax:+49-7071-7936840 tel;home:+49-7071-793257 x-mozilla-html:FALSE url:www.zopyx.com version:2.1 end:vcard ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] cache for python calls
This code isn't my, the server is hosting sites of many govern departments, so my task isn't develop the code but is keep all system working fine without down times. I'm not allowed to change the code, so I'm looking for all other reachable performance features. Regards, - - iarly selbir | ski0s :wq! On Fri, Apr 17, 2009 at 10:14 AM, Andreas Jung li...@zopyx.com wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Before starting with any kind of performance optimization: figure out your bottlenecks first by profiling your code: ZopeProfiler is your friend. - -aj On 17.04.2009 15:10 Uhr, iarly selbir | ski0s wrote: I'm doing a hard task, trying to improve maximum of possible performance to Zope/Plone server, I already installed CacheFu that improved so much performance, I saw on a blog about cache for Python calls but wasn't explained about your configuration or installation. there are any related product for zope to do it or something like that? The main question is improve a better performance to this server. Any tip/solution is welcome. Thanks in advance. Regards, - - iarly selbir | ski0s :wq! ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev ) - -- ZOPYX Ltd. Co. KG - Charlottenstr. 37/1 - 72070 Tübingen - Germany Web: www.zopyx.com - Email: i...@zopyx.com - Phone +49 - 7071 - 793376 Registergericht: Amtsgericht Stuttgart, Handelsregister A 381535 Geschäftsführer/Gesellschafter: ZOPYX Limited, Birmingham, UK - E-Publishing, Python, Zope Plone development, Consulting -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.9 (Darwin) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAknogKoACgkQCJIWIbr9KYxycgCg2WmTMZwhYQjx5Gc9ulAys8Lb ILYAnAgyB5Oyq5ed77blQY3rpHBa/tUC =1wfI -END PGP SIGNATURE- ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] cache for python calls
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Various knobs affect Zope performance...depending on each individual site and their programming and needs..serious further hints require a closer analysis. - -aj On 17.04.2009 15:27 Uhr, iarly selbir | ski0s wrote: This code isn't my, the server is hosting sites of many govern departments, so my task isn't develop the code but is keep all system working fine without down times. I'm not allowed to change the code, so I'm looking for all other reachable performance features. Regards, - - iarly selbir | ski0s :wq! On Fri, Apr 17, 2009 at 10:14 AM, Andreas Jung li...@zopyx.com mailto:li...@zopyx.com wrote: Before starting with any kind of performance optimization: figure out your bottlenecks first by profiling your code: ZopeProfiler is your friend. -aj On 17.04.2009 15:10 Uhr, iarly selbir | ski0s wrote: I'm doing a hard task, trying to improve maximum of possible performance to Zope/Plone server, I already installed CacheFu that improved so much performance, I saw on a blog about cache for Python calls but wasn't explained about your configuration or installation. there are any related product for zope to do it or something like that? The main question is improve a better performance to this server. Any tip/solution is welcome. Thanks in advance. Regards, - - iarly selbir | ski0s :wq! ___ Zope maillist - Zope@zope.org mailto:Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev ) ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev ) - -- ZOPYX Ltd. Co. KG - Charlottenstr. 37/1 - 72070 Tübingen - Germany Web: www.zopyx.com - Email: i...@zopyx.com - Phone +49 - 7071 - 793376 Registergericht: Amtsgericht Stuttgart, Handelsregister A 381535 Geschäftsführer/Gesellschafter: ZOPYX Limited, Birmingham, UK - E-Publishing, Python, Zope Plone development, Consulting -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.9 (Darwin) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAknohNQACgkQCJIWIbr9KYwQVACgsrIG4QXzt+f7Eg8LBBnz7zMO KyYAn2kQA+9OowFe7C6r08fJ8zk3xuqb =qVaQ -END PGP SIGNATURE- begin:vcard fn:Andreas Jung n:Jung;Andreas org:ZOPYX Ltd. Co. KG adr;quoted-printable:;;Charlottenstr. 37/1;T=C3=BCbingen;;72070;Germany email;internet:i...@zopyx.com title:CEO tel;work:+49-7071-793376 tel;fax:+49-7071-7936840 tel;home:+49-7071-793257 x-mozilla-html:FALSE url:www.zopyx.com version:2.1 end:vcard ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] cache for python calls
No problem guy all test that I doing is on test environment xD, errors are acceptable, all problems solution are stored in my personal knowledge base heh Btw I'm reading about memoize installation I don't saw anything related to code changes Look: plone.memoize Installation === * Create a file called ``plone.memoize-configure.zcml`` in the ``/path/to/instance/etc/package-includes`` directory. The file should only contain this:: include package=plone.memoize / Regards, - - iarly selbir | ski0s :wq! On Fri, Apr 17, 2009 at 10:50 AM, Andreas Jung li...@zopyx.com wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Your questions and writings indicate that you have zero background in Zope. Consider getting a consultant. Performance optimizing requires some solid background. - -aj On 17.04.2009 15:49 Uhr, iarly selbir | ski0s wrote: I don't read yet, just read a topic that spoke about and saved your link, because it I asked if you did know Regards, - - iarly selbir | ski0s :wq! On Fri, Apr 17, 2009 at 10:40 AM, Andreas Jung li...@zopyx.com mailto:li...@zopyx.com wrote: Do you know what you are talking about? plone.memoize requires changes to the software and you said you can't change the code?! -aj On 17.04.2009 15:38 Uhr, iarly selbir | ski0s wrote: Do you know the memoize? http://pypi.python.org/pypi/plone.memoize Regards, - - iarly selbir | ski0s :wq! On Fri, Apr 17, 2009 at 10:32 AM, Andreas Jung li...@zopyx.com mailto:li...@zopyx.com mailto:li...@zopyx.com mailto:li...@zopyx.com wrote: Various knobs affect Zope performance...depending on each individual site and their programming and needs..serious further hints require a closer analysis. -aj On 17.04.2009 15:27 Uhr, iarly selbir | ski0s wrote: This code isn't my, the server is hosting sites of many govern departments, so my task isn't develop the code but is keep all system working fine without down times. I'm not allowed to change the code, so I'm looking for all other reachable performance features. Regards, - - iarly selbir | ski0s :wq! On Fri, Apr 17, 2009 at 10:14 AM, Andreas Jung li...@zopyx.com mailto:li...@zopyx.com mailto:li...@zopyx.com mailto:li...@zopyx.com mailto:li...@zopyx.com mailto:li...@zopyx.com mailto:li...@zopyx.com mailto:li...@zopyx.com wrote: Before starting with any kind of performance optimization: figure out your bottlenecks first by profiling your code: ZopeProfiler is your friend. -aj On 17.04.2009 15:10 Uhr, iarly selbir | ski0s wrote: I'm doing a hard task, trying to improve maximum of possible performance to Zope/Plone server, I already installed CacheFu that improved so much performance, I saw on a blog about cache for Python calls but wasn't explained about your configuration or installation. there are any related product for zope to do it or something like that? The main question is improve a better performance to this server. Any tip/solution is welcome. Thanks in advance. Regards, - - iarly selbir | ski0s :wq! ___ Zope maillist - Zope@zope.org mailto:Zope@zope.org mailto:Zope@zope.org mailto:Zope@zope.org mailto:Zope@zope.org mailto:Zope@zope.org mailto:Zope@zope.org mailto:Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev ) ___ Zope maillist - Zope@zope.org mailto:Zope@zope.org mailto:Zope@zope.org mailto:Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev ) - -- ZOPYX Ltd. Co. KG - Charlottenstr. 37/1 - 72070 Tübingen - Germany Web: www.zopyx.com - Email: i...@zopyx.com - Phone +49 - 7071 - 793376 Registergericht: Amtsgericht Stuttgart, Handelsregister A 381535 Geschäftsführer/Gesellschafter: ZOPYX Limited, Birmingham, UK - E-Publishing, Python, Zope Plone development, Consulting -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.9 (Darwin) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAknoiScACgkQCJIWIbr9KYwqngCgr/iEpjRRnBkRP9SaLR/IEjzZ 9hgAn1+21YBHYUNgYpW3RFPCUE3Oqr3j =JDL/ -END PGP SIGNATURE- ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope **
Re: [Zope] cache for python calls
iarly selbir | ski0s schrieb: I'm doing a hard task, trying to improve maximum of possible performance to Zope/Plone server, I already installed CacheFu that improved so much performance, I saw on a blog about cache for Python calls but wasn't explained about your configuration or installation. there are any related product for zope to do it or something like that? There are some packages that cache the results of python functions calls. In Plone, plone.memoize is used often. There are others like bda.cache and gocept.cache. For these caches to work you have to decorate the functions you want to call. The main question is improve a better performance to this server. Any tip/solution is welcome. Like Andreas said find out where your bottlenecks are before you change things. You can take a look at the Zope configuration. To small zodb connection caches decrease performance due to unnecessary unpickeling of objects, to big settings or to many threads can make the operating system swap. ..Carsten ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] Cache
On Mon, Jun 23, 2008 at 6:55 PM, Andreas Jung [EMAIL PROTECTED] wrote: No idea what you're talking about. The standard Zope setup has nothing like a FS cache. There ZODB caches configured for each ZODB storage. And there is nothing like 'fs' under Control Panel - fs. If you have some 3rd party instaleld, tell us - we can't guess what's installed on _your_ system. Andreas Yes you're right, the default installation doesn't have it, sorry about that...( I'm not the one who set it up ). I guess it has something to do with the Zeo disk cache. Anyway, the default installation has 'main' and 'temporary', and you can flush the cache for these. I'd like to do it in command line, but I can't figure out if there is a way to do it. I'm also looking for something to choose the objects to cache a bit more precisely (like a list of objects not to cache or so). Regards, -- Kereoz http://www.kereoz.org ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] Cache
--On 25. Juni 2008 13:01:32 +0100 Kereoz [EMAIL PROTECTED] wrote: On Mon, Jun 23, 2008 at 6:55 PM, Andreas Jung [EMAIL PROTECTED] wrote: No idea what you're talking about. The standard Zope setup has nothing like a FS cache. There ZODB caches configured for each ZODB storage. And there is nothing like 'fs' under Control Panel - fs. If you have some 3rd party instaleld, tell us - we can't guess what's installed on _your_ system. Andreas Yes you're right, the default installation doesn't have it, sorry about that...( I'm not the one who set it up ). I guess it has something to do with the Zeo disk cache. Anyway, the default installation has 'main' and 'temporary', and you can flush the cache for these. I'd like to do it in command line, but I can't figure out if there is a way to do it. I'm also looking for something to choose the objects to cache a bit more precisely (like a list of objects not to cache or so). As you can see from the HTML code: something like app.Control_Panel.Database.name of storage.manage_minimize() should work. -aj pgpSzftJNLCOW.pgp Description: PGP signature ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] Cache
On Wed, Jun 25, 2008 at 1:13 PM, Andreas Jung [EMAIL PROTECTED] wrote: As you can see from the HTML code: something like app.Control_Panel.Database.name of storage.manage_minimize() should work. I was thinking about the zope command line tools such as zopectl or so. But in fact yes, seems to work, so I'll do it that way :) Thanks -- Kereoz http://www.kereoz.org ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] Cache
--On 25. Juni 2008 13:21:54 +0100 Kereoz [EMAIL PROTECTED] wrote: On Wed, Jun 25, 2008 at 1:13 PM, Andreas Jung [EMAIL PROTECTED] wrote: As you can see from the HTML code: something like app.Control_Panel.Database.name of storage.manage_minimize() should work. I was thinking about the zope command line tools such as zopectl or so. But in fact yes, seems to work, so I'll do it that way :) Not worth a followup :-) but you can put this one-liner into a script and call it using zopecl run -aj pgpjN4o0Bn8ZH.pgp Description: PGP signature ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
[Zope] Cache
Hi, I use Zope 2.8 and I edit files via ssh. I would like to disable the FS cache for some folders only (where I edit the files) so I don't have it to flush it after each modification. Alternatively, would it be possible to flush the FS cache in command line (rather than via ZMI) and only for a given folder ? Cheers -- Kereoz ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] Cache
--On 23. Juni 2008 18:17:31 +0100 Kereoz [EMAIL PROTECTED] wrote: Hi, I use Zope 2.8 and I edit files via ssh. I would like to disable the FS cache for some folders only (where I edit the files) so I don't have it to flush it after each modification. Alternatively, would it be possible to flush the FS cache in command line (rather than via ZMI) and only for a given folder ? FS cache? -aj pgpu0EQq8vnNB.pgp Description: PGP signature ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] Cache
On Mon, Jun 23, 2008 at 6:44 PM, Andreas Jung [EMAIL PROTECTED] wrote: --On 23. Juni 2008 18:17:31 +0100 Kereoz [EMAIL PROTECTED] wrote: Hi, I use Zope 2.8 and I edit files via ssh. I would like to disable the FS cache for some folders only (where I edit the files) so I don't have it to flush it after each modification. Alternatively, would it be possible to flush the FS cache in command line (rather than via ZMI) and only for a given folder ? FS cache? -aj The filesystem cache, you can find it it the ZMI in Control Panel - Database Management - fs Sorry if I was not clear :) Cheers -- Kereoz ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] Cache
--On 23. Juni 2008 18:48:20 +0100 Kereoz [EMAIL PROTECTED] wrote: On Mon, Jun 23, 2008 at 6:44 PM, Andreas Jung [EMAIL PROTECTED] wrote: --On 23. Juni 2008 18:17:31 +0100 Kereoz [EMAIL PROTECTED] wrote: Hi, I use Zope 2.8 and I edit files via ssh. I would like to disable the FS cache for some folders only (where I edit the files) so I don't have it to flush it after each modification. Alternatively, would it be possible to flush the FS cache in command line (rather than via ZMI) and only for a given folder ? FS cache? -aj The filesystem cache, you can find it it the ZMI in Control Panel - Database Management - fs No idea what you're talking about. The standard Zope setup has nothing like a FS cache. There ZODB caches configured for each ZODB storage. And there is nothing like 'fs' under Control Panel - fs. If you have some 3rd party instaleld, tell us - we can't guess what's installed on _your_ system. Andreas pgpvcMcjMudJg.pgp Description: PGP signature ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
[Zope] Cache values may only be in one cache
I'm getting the following error: Cache values may only be in one cache I'm getting this error every time I refresh my skin product. So I have to remember to restart zope every time I make a change. I'm running Plone 2.5.2 and Zope 2.9.6 On this page: http://plone.org/documentation/error/one_cache Wichert Akkerman says: Zope no longer supports product refreshing fully. For products using the component architecture it will probably never work. For others it can break as well. This is a Zope matter, not a Plone problem. Is this really true? Wouldn't it be an idea to remove the functionality completely then? ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] Cache values may only be in one cache
Product refreshing is a brilliant timesaver for development if it suits your development style. Some people prefer to restart Zope on every change which is the only option for Zope 2.9 and Zope 2.8. The error is somehow related to the use of the Session Manager I think. If you instead use my Zope refreshing script http://www.fry-it.com/at/refresh-my-zope-products unlike automatic refreshing which comes out-of-the-box in Zope, the refresh is done before you reload the page which means that you won't no longer see this error message. Note: My script work best with the Zope 2.7 and Zope 2.8 branch. On 2/19/07, Jonas Nielsen [EMAIL PROTECTED] wrote: I'm getting the following error: Cache values may only be in one cache I'm getting this error every time I refresh my skin product. So I have to remember to restart zope every time I make a change. I'm running Plone 2.5.2 and Zope 2.9.6 On this page: http://plone.org/documentation/error/one_cache Wichert Akkerman says: Zope no longer supports product refreshing fully. For products using the component architecture it will probably never work. For others it can break as well. This is a Zope matter, not a Plone problem. Is this really true? Wouldn't it be an idea to remove the functionality completely then? ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev ) -- Peter Bengtsson, work www.fry-it.com home www.peterbe.com hobby www.issuetrackerproduct.com ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] Cache values may only be in one cache
Jonas Nielsen wrote at 2007-2-19 13:54 +0100: I'm getting the following error: Cache values may only be in one cache I'm getting this error every time I refresh my skin product. I think this is a long standing bug in the auto refresh machinery. Do not use auto refresh and the problem should not occur. The manual refresh is not affected. -- Dieter ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] Zope/Cache/Memory
kevin7kal wrote at 2006-12-6 14:30 -0500: I have a database that is just under 200K objects with plans that it will grow larger. The objects are created by using another object with methods that read files and create the objects from the data in the files. When creating the objects, I find I have to manually clear the cache or else zope eventually crashes with an out of memory error. There are 4GB of ram on the server. The same issue arises when I catalog the objects. I am trying maintain as much speed as possible, so I do not want to catalog until the end of the import. Is there a way to programmatically clear the cache during a large indexing to avoid out of memory errors? A ZODB Connection has the method cacheGC() which you can call to start a cache garbage collection. As others already pointed out, it is implicitely called during large catalog operations -- controlled by the so called subtransaction threshold. Note that in early versions of ZODB 3.4, there was a bug preventing the call to cacheGC at subtransaction boundaries. -- Dieter ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
[Zope] Zope/Cache/Memory
I have a database that is just under 200K objects with plans that it will grow larger. The objects are created by using another object with methods that read files and create the objects from the data in the files. When creating the objects, I find I have to manually clear the cache or else zope eventually crashes with an out of memory error. There are 4GB of ram on the server. The same issue arises when I catalog the objects. I am trying maintain as much speed as possible, so I do not want to catalog until the end of the import. Is there a way to programmatically clear the cache during a large indexing to avoid out of memory errors? I am using zeo storages and setting the cache on those to a smaller size has no real effect in this case, because the cache seems to outgrow its defined size when it is very active. Is zope even good for this? Should I consider another database? It still seems that cataloging is an issue whether the objects are stored in the zodb or elsewhere. -Kevin ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] Zope/Cache/Memory
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 - --On 6. Dezember 2006 14:30:40 -0500 kevin7kal [EMAIL PROTECTED] wrote: I have a database that is just under 200K objects with plans that it will Is there a way to programmatically clear the cache during a large indexing to avoid out of memory errors? You're indexing with the ZCatalog? Are you sure that you're using subtransactions (or savepoints as they are called now). There is a ZCatalog parameter that controls this behavior. For large indexing operations this might cause the OutOfMember error. When using subtransactions changes will be written to disk after N objects. Please check that. - -aj -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (Darwin) iD8DBQFFdykGCJIWIbr9KYwRAsz/AJ9kUeK+Vd8guq8EnxR+bajzKvAPGgCeNG1L jxZ9z8CZUjYbGAsTxZmWi+A= =YIf2 -END PGP SIGNATURE- ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] Zope/Cache/Memory
- Original Message - From: kevin7kal [EMAIL PROTECTED] To: zope@zope.org Sent: Wednesday, December 06, 2006 2:30 PM Subject: [Zope] Zope/Cache/Memory I have a database that is just under 200K objects with plans that it will grow larger. The objects are created by using another object with methods that read files and create the objects from the data in the files. When creating the objects, I find I have to manually clear the cache or else zope eventually crashes with an out of memory error. There are 4GB of ram on the server. The same issue arises when I catalog the objects. I am trying maintain as much speed as possible, so I do not want to catalog until the end of the import. Make sure you have correctly set the cache parameters in zope.conf, and make sure that the ZCatalog subtransactions are enabled - and you can play around with the threshold values to improve performance (I am assuming that the database you mentioned was a ZCatalog). hth Jonathan ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
[Zope] Cache headers
I am trying to ensure that zope delivered content (Zope 2.7 at this point) is upstream cacheable regardless of whether theusers delivered to are authenticated or not(currently my site is fronted by Cookie Crumbler based login/authentication). My understanding is that the way to do this is to create an HTTPcache object and associate all the material that should be cached with it(in addition to unchecking the anonymous only cache check box). Am I making a correct assumption? Is there any way to automatically force that association on all content created in a directory and subdirectories or must this association always be done by hand? Some simple call to the cache software perhaps? ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
[Zope] Cache flipping?
Chris Withers wrote: Darian V Schramm wrote: I'm getting many of these in my event.log 2005-03-15T10:17:56 INFO(0) ZEC:1-None-1 flipping cache files. new current = 1 This is nothing to worry abotu from a crashing point of view. Worry abotu it when you want to improve performance once you have a happilly running server. Let's say that I have a happily running server, that I get quite a lot of flipping cache files with a cache-size at 6000 in my Zope instances, and that I want to improve performances. What should I do? Guillaume Tamboise ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
[Zope-dev] Re: [Zope] Cache Parameters
Is there a way in Zope 2.5 to see what kind of hit/miss ratio our cache is having? Currently we have 260,000 objects in our database and an ideal cache size of 10,000. And I'm not sure how often it's accessing the database. Thanks, -Brian On Fri, 22 Nov 2002, Toby Dickenson wrote: On Friday 22 November 2002 10:18 am, Chris Withers wrote: Brian R Brinegar wrote: Within the Control_Panel/Database/ Cache Parameters there is a Target max time between accesses what is the Unit for this value? Seconds? Minutes? I haven't found it documented anywhere. Best ask Toby Dickenson on the [EMAIL PROTECTED] list, he is the god of all things cache like ;-) No need to go to a specific list. I am everywhere. ;-) That parameter has been removed in Zope 2.6. Previously its units were in seconds, but the parameter that it controls does not relate to anything easily explained. If you think you need to understand this parameter, then I think you need to upgrade to Zope 2.6 ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope] Cache manager in zope 2.3.0b1
-Original Message- From: Shane Hathaway [EMAIL PROTECTED] To: Bak@kedai [EMAIL PROTECTED] Date: Wednesday, January 24, 2001 9:10 PM Subject: Re: [Zope] Cache manager in zope 2.3.0b1 "Bak@kedai" wrote: From HelpSys for RAM CAche """ Finally, you can configure the list of REQUEST variables that will be used in the cache key. This can be a simple and effective way to distinguish requests from authenticated versus anonymous users or those with session cookies. """ so, if i access a particular DTML Method as such http://myserver.com/mymethod?objId=xxx can i use objId to distinguish between different objects? i tried by setting objId as the cache key in my RAM Cache object. however, nothing were cached. even after accessing mymethod with different objId. I'd like to help you out with this--could you give more details? What did you do to test the caching? Are you sure it wasn't being cached? Shane sorry. my mistake. i think more info on how/what should/can be a cache key is good. currently, there's two cache key fields, one in the object itself, one in the cache manager instance. the field in object can contain more than one cache keys, while the cache key in the cache manager instacne can contain only one. now that i can cache object, i can't invalidate it automatically ( the cache don't expire). how do i expire the cached object automatically? sorry for being a pain :) if i understand it more, i'll try and write up a howto/note ___ Zope maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] Cache manager in zope 2.3.0b1
"Bak @ kedai" wrote: sorry. my mistake. i think more info on how/what should/can be a cache key is good. currently, there's two cache key fields, one in the object itself, one in the cache manager instance. the field in object can contain more than one cache keys, while the cache key in the cache manager instacne can contain only one. Are you saying that entering multiple REQUEST variables doesn't work? Are you putting the variables on separate lines? now that i can cache object, i can't invalidate it automatically ( the cache don't expire). how do i expire the cached object automatically? Every time you change the object or push the "invalidate" button, it should expire. Are you having success with that? sorry for being a pain :) if i understand it more, i'll try and write up a howto/note Actually, we've been begging for user input. :-) I'd like to help you. Shane ___ Zope maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] Cache manager in zope 2.3.0b1
-Original Message- From: Shane Hathaway [EMAIL PROTECTED] To: [EMAIL PROTECTED] [EMAIL PROTECTED] Date: Wednesday, January 24, 2001 10:20 PM Subject: Re: [Zope] Cache manager in zope 2.3.0b1 Are you saying that entering multiple REQUEST variables doesn't work? Are you putting the variables on separate lines? i can have multiple REQUEST filled in the object cache option, but not in the cache manager instance. this was on 2.3.0b1. haven't yet it with the latest beta. if i have multiple REQUEST on separate lines, and save it, it'll be saved on one line (this is the cache manager instance). Every time you change the object or push the "invalidate" button, it should expire. Are you having success with that? invalidating manually works. but what can i do to expire a cached object? for instance, i now have a DTML Method A that is made of DTML Method B and C. i cached DTML Method A. somehpw, Method B changes, but DTML Method A still shows the cached object. by haveing it expire automatically, say every 3600 sec, or any configurable time limit, i'll be assured that DTML Method A will change, at least after the time limit set. also, if i have a situation as above, which is more preffered? caching object A or objects that make up A? Actually, we've been begging for user input. :-) I'd like to help you. i'll give b3 a try when i start work. thanks Shane ___ Zope maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev ) ___ Zope maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )
[Zope] Cache manager in zope 2.3.0b1
From HelpSys for RAM CAche """ Finally, you can configure the list of REQUEST variables that will be used in the cache key. This can be a simple and effective way to distinguish requests from authenticated versus anonymous users or those with session cookies. """ so, if i access a particular DTML Method as such http://myserver.com/mymethod?objId=xxx can i use objId to distinguish between different objects? i tried by setting objId as the cache key in my RAM Cache object. however, nothing were cached. even after accessing mymethod with different objId. thanks -- http://www.kedai.com.my/kk http://www.kedai.com.my/eZine use Zope? then you got HOPE! ___ Zope maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )
RE: [Zope] Cache concerns (was zope/proxy_pass configuration problem)
Ragnar,
Caching is a subject I'm not all that familiar with but one I need to learn
really fast. My site is about to go live, and I have a monster of a query
that will bring my system to its knees if 100 students run it at a time. So
I'm sending this off to the Zope mailing list wondering if anyone can give
us some caching/performance tips.
- T.J.
-Original Message-
From: Ragnar Beer [mailto:[EMAIL PROTECTED]]
Sent: Wednesday, August 02, 2000 12:48 PM
To: T.J. Mannos
Subject: RE: [Zope] zope/proxy_pass configuration problem
Very good idea! I tried it and it works like a charm :) Thanks a lot!
One problem is left over: apache doesn't cache the documents although I have
dtml-call "RESPONSE.setHeader('Expires',
_.DateTime(_.DateTime().timeTime() + 3600).toZone('GMT').rfc822())"
in my standard_html_header. ab -n 100 -c 1
http://www.dummy.com/index_html shows 100 queries in Z2.log where
there should be only one.
What could I be doing wrong?
Ragnar
Ragnar,
If you're referring to my ZServer+Apache+SSL HOWTO, this would be a
problem.
Going in through https will only give you access to the 'ssl' directory.
The quick dirty solution (while retaining the ability to distinguish
between http and https) is to reverse the setup, i.e. place the https
SiteRoot in the main folder and create a separate folder called, say,
'http', which holds the http SiteRoot. This solution will kill two birds
with one stone: it will grant access to the entire site via https while
restricting http users to an empty subdirectory.
Hope this helps,
T.J.
-Original Message-
From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED]]On Behalf Of
Ragnar Beer
Sent: Wednesday, August 02, 2000 1:30 AM
To: [EMAIL PROTECTED]
Subject: [Zope] zope/proxy_pass configuration problem
Hi Zope-Configuristas!
I would finally like to say goodbye to pcgi but one thing keeps me
hooked. I tried and tried but the solution just won't appear. Here is
the problem:
I have a site that is supposed to be reachable via http as well as
via https. That's not a problem per se. Configuration of zope with
proxy_pass is easy as can be. The problem is that management shall be
possible via https _only_ (for obvious reasons). But as soon as I use
site access to define the http-branch this branch is not
managable/accessable via https any more. Is there a solution?
Ragnar
___
Zope maillist - [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope
** No cross posts or HTML encoding! **
(Related lists -
http://lists.zope.org/mailman/listinfo/zope-announce
http://lists.zope.org/mailman/listinfo/zope-dev )
___
Zope maillist - [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope
** No cross posts or HTML encoding! **
(Related lists -
http://lists.zope.org/mailman/listinfo/zope-announce
http://lists.zope.org/mailman/listinfo/zope-dev )
[Zope] Cache X MySQL
Dear coleagues, I decided to use Zope as an Interface to maintain and search a touristic information database. All text is stored in MySQL tables and images will be stored outside the database, for cache reasons (I will keep only the path as TEXT columns in MySQL tables). My question is: for me to have an efficient cache system, Am I supposed to store the images as Zope Image Objects or can I store them outside Zope, in normal (Linux) folders? If I store them poutside Zope, is Zope able to cache them??? regrads, Rogerio Atem --- E-mail enviado pelo servidor do CEFETCampos ___ Zope maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] Cache
Jonothan Farr wrote:
How can I disable the browser cache in my zope documents ?
One thing you can do is set the 'Expires' header like so:
dtml-call "RESPONSE.setHeader('Expires', _.DateTime().rfc822())"
This works using Netscape. But for IE I had to use:
dtml-call "RESPONSE.setHeader('Expires', '-1')"
dtml-call "RESPONSE.setHeader('Cache-Control', 'no-cache')"
dtml-call "RESPONSE.setHeader('Pragma', 'no-cache')"
I think the last Pragma can be left out. But the Cache-Control header
ist neccessary. I got the information out of rfc2616.
--
connection reset by
Peer
___
Dr. Peer Griebel Tel. +49 7581 4831 23
Geschäftsführer Fax. +49 7581 4831 11
Knoll Informationssysteme GmbH http://www.knoll-is.de
Dreiköniggasse 17 mailto:[EMAIL PROTECTED]
88348 Saulgauprivat: mailto:[EMAIL PROTECTED]
___
Zope maillist - [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope
** No cross posts or HTML encoding! **
(Related lists -
http://lists.zope.org/mailman/listinfo/zope-announce
http://lists.zope.org/mailman/listinfo/zope-dev )
RE: [Zope] Cache
Does this work in IE5? I'm using similar META tags which work for IE4 and
Netscape but don't work in IE5.
-=Brad=-
-Original Message-
From: Dr. Peer Griebel [mailto:[EMAIL PROTECTED]]
Sent: Thursday, May 18, 2000 10:32 AM
To: [EMAIL PROTECTED]
Subject: Re: [Zope] Cache
Jonothan Farr wrote:
How can I disable the browser cache in my zope documents ?
One thing you can do is set the 'Expires' header like so:
dtml-call "RESPONSE.setHeader('Expires', _.DateTime().rfc822())"
This works using Netscape. But for IE I had to use:
dtml-call "RESPONSE.setHeader('Expires', '-1')"
dtml-call "RESPONSE.setHeader('Cache-Control', 'no-cache')"
dtml-call "RESPONSE.setHeader('Pragma', 'no-cache')"
I think the last Pragma can be left out. But the Cache-Control header
ist neccessary. I got the information out of rfc2616.
--
connection reset by
Peer
___
Dr. Peer Griebel Tel. +49 7581 4831 23
Geschäftsführer Fax. +49 7581 4831 11
Knoll Informationssysteme GmbH http://www.knoll-is.de
Dreiköniggasse 17 mailto:[EMAIL PROTECTED]
88348 Saulgauprivat: mailto:[EMAIL PROTECTED]
___
Zope maillist - [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope
** No cross posts or HTML encoding! **
(Related lists -
http://lists.zope.org/mailman/listinfo/zope-announce
http://lists.zope.org/mailman/listinfo/zope-dev )
___
Zope maillist - [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope
** No cross posts or HTML encoding! **
(Related lists -
http://lists.zope.org/mailman/listinfo/zope-announce
http://lists.zope.org/mailman/listinfo/zope-dev )
