[Zope-dev] Bump up the nr of ZOpe trhreads
Hello! Apart from the -t option to z2.py (that, afaik, limits me to only 7), what other settings do I need to change to bump up the number of Zope threads to around 20, both for ZServer and for ZODB Accesses? If i change these settings, which one will allow me to have around 20 threads available to access an external Oracle DB (the zserver or the ZODB)? TIA, /dario - Dario Lopez-Kästen, [EMAIL PROTECTED]IT Systems Services System Developer/System Administrator Chalmers University of Tech. ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] I/O Error
I get this same problem on our FreeBSD servers w/ Zope 2.5.1 and Python 2.1.1 (from ports). I've haven't found any correlation to anything that might be causing it yet... (sort of distressing) It doesn't happen very often though; I've only seen it about 3 times. Cheers, Tim Myroslav Opyr wrote: Hi, When running one of development servers (Zope 2.5.1, Python 2.1.3+freebsdPatch) Several times I've got I/O Error exception page when trying to render random ZMI page. Retrying always succeeds... I was not able to get traceback so far (it is in HTML comments). Any ideas what that can be? m. -- Tim McLaughlin Chief Technology Officer Siteworx, Inc... Set your site on the future! 703.390.5421 ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
exUserFolder (was: Re: [Zope-dev] I/O Error)
Hi, I've got it! === Site Error Error Type: IOError Error Value: [Errno 5] Input/output error Traceback (innermost last): File /usr/share/Zope-2.5.1/lib/python/ZPublisher/Publish.py, line 150, in publish_module File /var/zope/home/shared2/Products/Localizer/__init__.py, line 65, in new_publish File /usr/share/Zope-2.5.1/lib/python/ZPublisher/Publish.py, line 114, in publish File /usr/share/Zope-2.5.1/lib/python/Zope/__init__.py, line 159, in zpublisher_exception_hook (Object: events) File /usr/share/Zope-2.5.1/lib/python/ZPublisher/Publish.py, line 98, in publish File /usr/share/Zope-2.5.1/lib/python/ZPublisher/mapply.py, line 88, in mapply (Object: manage_main) File /usr/share/Zope-2.5.1/lib/python/ZPublisher/Publish.py, line 39, in call_object (Object: manage_main) File /usr/share/Zope-2.5.1/lib/python/Shared/DC/Scripts/Bindings.py, line 252, in __call__ (Object: manage_main) File /usr/share/Zope-2.5.1/lib/python/Shared/DC/Scripts/Bindings.py, line 283, in _bindAndExec (Object: manage_main) File /usr/share/Zope-2.5.1/lib/python/App/special_dtml.py, line 172, in _exec (Object: manage_main) File /var/zope/home/shared2/Products/exUserFolder/dummyZBabelTag.py, line 96, in render IOError: (see above) === The problem is that I do not have exUserFolder in acquisition at that place. exUserFolder had patched something... Should I avoid using it at all? m. -- Myroslav Opyr zope.net.ua * Ukrainian Zope Hosting e-mail: [EMAIL PROTECTED] cell: +380 50.3174578 On Mon, 9 Sep 2002, Tim McLaughlin wrote: I get this same problem on our FreeBSD servers w/ Zope 2.5.1 and Python 2.1.1 (from ports). I've haven't found any correlation to anything that might be causing it yet... (sort of distressing) It doesn't happen very often though; I've only seen it about 3 times. Cheers, Tim Myroslav Opyr wrote: Hi, When running one of development servers (Zope 2.5.1, Python 2.1.3+freebsdPatch) Several times I've got I/O Error exception page when trying to render random ZMI page. Retrying always succeeds... I was not able to get traceback so far (it is in HTML comments). Any ideas what that can be? m. -- Tim McLaughlin Chief Technology Officer Siteworx, Inc... Set your site on the future! 703.390.5421 ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] I/O Error
Myroslav Opyr wrote: When running one of development servers (Zope 2.5.1, Python 2.1.3+freebsdPatch) Several times I've got I/O Error exception page when trying to render random ZMI page. Retrying always succeeds... I was not able to get traceback so far (it is in HTML comments). Any ideas what that can be? If you have started Zope without a terminal for it to output it's errors and alerts to, it can do that. On Linux you should start it with a nohup ./start -D ... etc. regards Max M evolve ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Bump up the nr of ZOpe trhreads
You'll also want to change the number of database connections. If you use FileStorage, put the following in a custom_zodb.py file in your Zope software home or instance home (if you run an instance home setup): import ZODB.FileStorage import ZODB.DB filename = os.path.join(INSTANCE_HOME, 'var', 'Data.fs') Storage = ZODB.FileStorage.FileStorage(filename) DB = ZODB.DB(Storage, pool_size=25, cache_size=2000) The pool_size parameter is the number of database connections. The number of database connections should always be higher than the number of threads by a few (it doesn't make sense to have fewer database connections than threads). - C - Original Message - From: Dario Lopez-Kästen [EMAIL PROTECTED] To: [EMAIL PROTECTED] Sent: Monday, September 09, 2002 5:02 AM Subject: [Zope-dev] Bump up the nr of ZOpe trhreads Hello! Apart from the -t option to z2.py (that, afaik, limits me to only 7), what other settings do I need to change to bump up the number of Zope threads to around 20, both for ZServer and for ZODB Accesses? If i change these settings, which one will allow me to have around 20 threads available to access an external Oracle DB (the zserver or the ZODB)? TIA, /dario - -- -- Dario Lopez-Kästen, [EMAIL PROTECTED]IT Systems Services System Developer/System Administrator Chalmers University of Tech. ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope ) ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
[Zope-dev] ZCatalog and cataloguing remote sites
Has anyone successfully managed to use ZCatalog for cataloguing external sites? I followed the example from the Spicklemire's book (Zope - Web Application Development and Content Management, chapter 9), but didn't manage to get it working. The basic idea is that you have a TinyTablePlus called CatalogedURLs storing URLs to be catalogued (with one column of data called url). You also create a ZCatalog called HTMLCatalog with an index called contents, and the title and source fields in the metadata. Then you have an external method called HTMLForCatalog.py, which creates a dummy object with title and content. HTMLForCatalog.py: --- from ZPublisher import Client import string class dummyObject : pass def createTitle(url,data) : aTitle = string.split(url,'/')[-1] firstIndex = string.find(string.upper(data), 'TITLE') if (firstIndex -1): secondIndex = string.find(string.upper(data), 'TITLE') if (secondIndex -1) : aTitle = data[firstIndex+7:secondIndex] return aTitle def getHTMLForCatalog(self, url): x = dummyObject() theFile = Client.call(url) theData = theFile[1] x.title = createTitle(url, theData) x.content = theData aSource = string.split(url,'/')[-1] x.source = string.join(aSource, '/') return x --- You connect an external method to the Zope site by creating GetHTMLForCatolog external method in ZMI. You also have a DTML method called addFilesToCatalog which calls the external method addFilesToCatalog : dtml-var standard_html_header dtml-in CataloguedURLs dtml-let newObject=GetHTMLForCatalog(anUrl) dtml-call HTMLCatalog.catalog_object(newObject,url) /dtml-let /dtml-in p dtml-in HTMLCatalog()whatever a href='dtml-var getPath()' dtml-var getPath() dtml-var title/abr /dtml-in dtml-var standard_html_footer - This doesn't work because the line 3 passes 'anURL', which is not defined . If I change this to 'url' the URLs from the CatalogedURLs table are inserted into the catalog, but the method fails to retrive title or content. Any suggestions as to how to fix it or where I'm going wrong are welcomed. As, in fact, are any suggestions how I can implement a search engine across Zope and non-Zope sites. Many thanks, Agata ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
[Zope-dev] Zope-Dev digest, Vol 1 #1823 - 7 msgs
I am away on vacation until Sept 16. If your inquiry is urgent please resend your request to Chris Martin ([EMAIL PROTECTED]) and he will look after it. Alternatively, you can call Chris at 566-0604 Tom Germaine Access Services Administrator ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] I/O Error
Tim McLaughlin writes: I get this same problem on our FreeBSD servers w/ Zope 2.5.1 and Python 2.1.1 (from ports). I've haven't found any correlation to anything that might be causing it yet... (sort of distressing) It doesn't happen very often though; I've only seen it about 3 times. Enable Zope logging (-- doc/LOGGING.txt) and look into the resulting log file... Dieter ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: exUserFolder (was: Re: [Zope-dev] I/O Error)
Myroslav Opyr wrote: I've got it! === Site Error Error Type: IOError Error Value: [Errno 5] Input/output error Traceback (innermost last): File /usr/share/Zope-2.5.1/lib/python/ZPublisher/Publish.py, line 150, in publish_module [...snip...] File /usr/share/Zope-2.5.1/lib/python/App/special_dtml.py, line 172, in _exec (Object: manage_main) File /var/zope/home/shared2/Products/exUserFolder/dummyZBabelTag.py, line 96, in render IOError: (see above) === It is OrderedFolder + exUserFolder - ZBabel [ + FreeBSD] problem... OrderedFolder has NoBabelTag.py and exUserFolder has dummyZBabelTag.py to do the same thing. OrderedFolder does that in clean way. exUserFolder - not (at least on FreeBSD). Unfortunately exUserFolder' implementation does not check if babel and fish tags exist and simply overwrites other implementation... Regarding exUserFolder.py itself. That was plain print statement. And it look like it is not always safe. Why there is a reason of print instead of zLOG.LOG()? It is far not the last thing which people complain about in exUserFolder... Superior idea of plugins was buried in flaws of implementation... As for long-term benefit LDAPUserFolder appears to be stable solution... Regards, m. The problem is that I do not have exUserFolder in acquisition at that place. exUserFolder had patched something... Should I avoid using it at all? m. -- Myroslav Opyr zope.net.ua * Ukrainian Zope Hosting e-mail: [EMAIL PROTECTED] cell: +380 50.3174578 On Mon, 9 Sep 2002, Tim McLaughlin wrote: I get this same problem on our FreeBSD servers w/ Zope 2.5.1 and Python 2.1.1 (from ports). I've haven't found any correlation to anything that might be causing it yet... (sort of distressing) It doesn't happen very often though; I've only seen it abo ut 3 times. Cheers, Tim Myroslav Opyr wrote: Hi, When running one of development servers (Zope 2.5.1, Python 2.1.3+freebsdPatch) Several times I've got I/O Error exception page when trying to render random ZMI page. Retrying always succeeds... I was not able to get traceback so far (it is in HTML comments). Any ideas what that can be? m. -- Tim McLaughlin Chief Technology Officer Siteworx, Inc... Set your site on the future! 703.390.5421 -- Myroslav Opyr zope.net.ua http://zope.net.ua/ ° Ukrainian Zope Hosting e-mail: [EMAIL PROTECTED] mailto:[EMAIL PROTECTED] ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
[Zope-dev] Some basic questions on Zope performance/scalability
Hi all, First, I apologize for posting this. I'm sure the topic has been discussed time and again, but I couldn't find a definite answer to my queries: 1. I made a custom user folder using MySQL as a storage backend. But I always feel wary about that User Folder method getUsers(). I have about 300,000 users in a MySQL db table. Is this method really meant to return that many users? Or the fundamental design of a Zope User Folder is intended for a small group of users? 2. Again, I have a 300,000-strong user base. Would it be wise to let them create a home folder and start adding things of their own? Could ZODB's FileStorage model take that much data without any problems or without severe perfomance penalty? I'm trying to pull out huge data objects as external files (as I did with NeoBoard's attachments), but I guess there's a limit to that approach too (and it's seemingly stupid not to use ZODB for all the benefits it offers). Simply put, say you already have 300,000 users with tons of data for each of them and you want to put them and their data somewhere in and/or outside of Zope. What would you do? Thanks in advance. Best Regards, Wankyu Choi ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
