Re: [Zope] temp_folder not MountTemporaryFolder?
Thanks to all... The problem was else where... I ran the bench and observed that /temp_folder/session_data reported no objects. So something else was causing the bunch of conflicts. I have found that the problem was Plone set the last login time in logged_in.cpy, commenting this line no more conflicts were issued, with this bench. Again, thanks to all. I'll keep reading and digging Plone and Zope. Currently my next move is to make improvements to CacheFu, in order to cache Five Views. Best regards, Manuel. On 6/24/07, Chris McDonough [EMAIL PROTECTED] wrote: On Jun 24, 2007, at 9:31 PM, Manuel Vázquez Acosta wrote: Let me see if I got this right: According to ZODB.Mount.MountPoint: mount points are Zope objects that, when traversed, accesses a different database. You got it. Do they report themselves as the container-class defined in zope.conf? I mean, when I traverse to /temp_folder what do I get? Is it the MountPoint instance or the container-class instance? Where should I look for this code? It's the container-class instance (or at least it looks like it when you get there, it does a bunch of trickery under the hood). The default container class is Products.TemporaryFolder.TemporaryContainer. You can influence it within zope.conf though. One of the container class instances (mounted at the /temp_folder mount point) is created within the OFS.Application.install_tempfolder_and_sdc method during Zope startup. I have tried faster but without any luck. I modified OFS.Application and replaced TransientObjectContainer with faster.SessionDataContainer, but still I had too many ConflictErrors (didn't make any measure to compare with TransientObjectContainer). Have you tried putting the session data container *not* in temp_folder? In other words, create a session data container in the root of your zodb, then cause the session_data_manager object to point at that? You may observe better performance (with the penalty of more storage growth) because FileStorage is typically better at resolving conflicts nowadays than TemporaryStorage is. Note that if you're using ZEO, don't put the data container in the root, you will only get more conflicts. Instead, mount a FileStorage somewhere. See http://plone.org/documentation/how-to/multiple-plone-sites-per- zope-instance-using-separate-data-fs-files-for-each-one for a reasonable explanation of how to create new mount points (ignore the Ploney bits, only pay attention to steps 1 and 2). - C ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] Several questions on Z3 Views backported thru Five
The Plone App is an Intranet for a customer of my employer that builds upon CMFPlone, but most of its interface is based on Five Views. So we need caching those. Thanks for the tip. I will try ZopeProfiler right away. Best regards, Manuel. Dieter Maurer wrote: Manuel Vázquez Acosta wrote at 2007-6-21 14:16 +: ... I have tested a fresh Plone 2.5.3 with Zope 2.9.7, plus Squid + CacheFu and everything went just fine. The laptop didn't even notice such a load. But, when I installed the Plone App, even much smaller load didn't pass the test. What is the Plone App? Use a profiler (e.g. ZopeProfiler) to obtain a timing profile. It will tell you where time is spent for. -- Dieter ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev ) -- View this message in context: http://www.nabble.com/Several-questions-on-Z3-Views-backported-thru-Five-tf3962154.html#a11308846 Sent from the Zope - General mailing list archive at Nabble.com. ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] Several questions on Z3 Views backported thru Five
I'm heading that way... I have been reading CacheFu does not support yet Five Views, but there's a roadmap (http://plone.org/products/cachefu/roadmap/6). I'm willing to help with that, but I have talked yet to the rest of the participants. However, I have a deadline for this App, I have proposed several in-house caching mechanisms, just for now... Thanks and best regards, Manuel. J Cameron Cooper-8 wrote: Manuel Vázquez Acosta wrote: Hi all, I've been asked to deploy a Plone App which must satisfy a load of at least 1200 users over 8 min. I have tested a fresh Plone 2.5.3 with Zope 2.9.7, plus Squid + CacheFu and everything went just fine. The laptop didn't even notice such a load. But, when I installed the Plone App, even much smaller load didn't pass the test. My first guess would be that the cache setup need to be configured to work with your application. CacheFu knows about the default setup, but not about a custom application. It may therefore not be caching, or be caching inappropriately. I think examining the response headers is the best way to determine this. --jcc -- Connexions http://cnx.org Building Websites with Plone http://plonebook.packtpub.com ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev ) -- View this message in context: http://www.nabble.com/Several-questions-on-Z3-Views-backported-thru-Five-tf3962154.html#a11308959 Sent from the Zope - General mailing list archive at Nabble.com. ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] Several questions on Z3 Views backported thru Five
Thanks for your response... I will try that. I have already started to clean up the views and creating a very simple custom caching mechanism to achieve better perfomance. We have made some success, but we're still working. Best regards, Manuel. Tres Seaver wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Manuel Vázquez Acosta wrote: Hi all, I've been asked to deploy a Plone App which must satisfy a load of at least 1200 users over 8 min. I have tested a fresh Plone 2.5.3 with Zope 2.9.7, plus Squid + CacheFu and everything went just fine. The laptop didn't even notice such a load. But, when I installed the Plone App, even much smaller load didn't pass the test. Thus, I have to dig into the source code of the app to find the source of the problems. I have found that the app uses Z3 concepts, specially Views. This question poped into my mind: 1. Does Zope2+Five creates Views everytime they are used, and discard them afterwards? If this is the case, then maybe I should code a ViewFactory which caches frequently used views. This may help. Nope, that won't help, because views are bindings between context objects and requests. The time required to create views / adapters is completely negligible compared to the time required to *render* the Plone main template. You need to focus on stripping out features you don't need in that template, and / or caching fragments of it. Tres. - -- === Tres Seaver +1 540-429-0999 [EMAIL PROTECTED] Palladion Software Excellence by Designhttp://palladion.com -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.6 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFGe92C+gerLs4ltQ4RAmVvAJ9+BXTwKTe9HqIq12XMYfu8CYtJkQCgpuce rRbBU2hqJKAQWXi3zFmS4V4= =zhVX -END PGP SIGNATURE- ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev ) -- View this message in context: http://www.nabble.com/Several-questions-on-Z3-Views-backported-thru-Five-tf3962154.html#a11309004 Sent from the Zope - General mailing list archive at Nabble.com. ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
[Zope] A question on pool-size
Hi all, I'm having a rather weird behavior configuring pool-size. I put a pool-size of 20 on two zeo-clients, but monitoring one of them I saw this on logs: 2007-06-26T16:47:02 WARNING ZODB.DB DB.open() has 19 open connections with a pool_size of 10 -- 2007-06-26T16:47:02 WARNING ZODB.DB DB.open() has 20 open connections with a pool_size of 10 -- 2007-06-26T16:47:02 CRITICAL ZODB.DB DB.open() has 90 open connections with a pool_size of 7 Sometimes it reported pool-size of 10, and sometimes it reported 7! What could this be? Another question: My expect a load of 50 concurrent requests, so I set zserver-threads to 25 on both zeo-clients, and a pool-size of 20 (but behaving as explained above). Do this conf make any sense? Where should I read to get more info about this matter? Best regards, Manuel. -- View this message in context: http://www.nabble.com/A-question-on-pool-size-tf3984717.html#a11313581 Sent from the Zope - General mailing list archive at Nabble.com. ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] A question on pool-size
Maciej, Zope is Zope 2.9.6 (2.9.6-4etch1 from Debian repo). I will try more zeo clients. Thanks for the tip. The thing that is bugging me is that it seems my configuration is not being taken into account. Is there an absolute limit for pool_size? Best regards, Manuel. Maciej Wisniowski wrote: Hello First, which Zope version do you have? Sometimes it reported pool-size of 10, and sometimes it reported 7! What could this be? Maybe you're seeing warnings from few storages? but I'm not sure how this works an I have no idea why you're seeing pool sizes as 7 and 10 if you set this to 20 Another question: My expect a load of 50 concurrent requests, so I set zserver-threads to 25 on both zeo-clients, and a pool-size of 20 (but behaving as explained above). Do this conf make any sense? Where should I read to get more info about this matter? I think it is better to use more Zeo clients than bump number of threads. There were some benchmarks (or sth like that) showing that bigger number of threads doesn't help too much to performance, and it may be even worse. In your setup, if you have 25 threads you should have pool size bigger than 25 - every thread will possibly use ZODB so it should have connection to use. In fact connection is created as needed, even if pool_size is too small. That is why number of connections in your logs is bigger than pool_size. -- Maciej Wisniowski ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev ) -- View this message in context: http://www.nabble.com/A-question-on-pool-size-tf3984717.html#a11314557 Sent from the Zope - General mailing list archive at Nabble.com. ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
[Zope] temp_folder not MountTemporaryFolder?
Hi all, I have been digging into Session Management in Zope, because is causing a little overhead. We have develop a Plone Application, which must respond to 30 concurrent user every 12 seconds, we have setup CacheFu and Squid for this. We have used OpenSTA to stress test the application. When we run the bench for a non login test, everything goes just fine. But when run a bench in which a user logs in, we observe too many ConflictErrors, which, I thinks, slows too much the application, because zope retries the request 3 times. I have read /temp_folder is RAM based folder, and also that it should be a MountPoint, but looking at the code and with the help of DocFinderTab, I have found /temp_folder is a Products.TemporaryFolder.SimpleTemporaryContainer, which seems to be just a folder in the ZODB... This sould be this way? Does /temp_folder/session_data is the RAM based storage? Best regards, Manuel. ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
[Zope] Several questions on Z3 Views backported thru Five
Hi all, I've been asked to deploy a Plone App which must satisfy a load of at least 1200 users over 8 min. I have tested a fresh Plone 2.5.3 with Zope 2.9.7, plus Squid + CacheFu and everything went just fine. The laptop didn't even notice such a load. But, when I installed the Plone App, even much smaller load didn't pass the test. Thus, I have to dig into the source code of the app to find the source of the problems. I have found that the app uses Z3 concepts, specially Views. This question poped into my mind: 1. Does Zope2+Five creates Views everytime they are used, and discard them afterwards? If this is the case, then maybe I should code a ViewFactory which caches frequently used views. This may help. Best regards, Manuel. ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
[Zope-dev] Is TF IDF implemented in zope search engine. On NED in Zope.
Hi all, I was reading a paper on News Event Detection (NED) and I started wondering how hard would it be to implement such a mechanism in Zope. My first step was to find out if Zope already implemented a vector space model (tf idf, maybe) for indexing and searching the documents. I know nothing of Zope internals yet. So, I'm counting with your help for me to start digging into Zope's. Best regards and thanks in advance, Manuel. ___ Zope-Dev maillist - Zope-Dev@zope.org http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
