Re: [Zope-dev] RE: DBtab and BDBStorage
Andrew R. Halko wrote: Well, currently I cannot get python 2.2.3 to work with Plone. What do you need Python 2.2.3 for? 2.2.3 will support up to 4TB, which would solve all my problems, but it doesn't work. I have LFS in 2.1.3, have you tried recompiling Python 2.1.3 with LFS? cheers, Chris ___ Zope-Dev maillist - [EMAIL PROTECTED] http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] RE: DBtab and BDBStorage
(keep it on the list please) Andrew R. Halko wrote: Are you running Windows or Linux? Windows and python do not support LFS Why are you trying to run a production system on Windows? Chris ___ Zope-Dev maillist - [EMAIL PROTECTED] http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
R: [Zope-dev] RE: DBtab and BDBStorage
-Messaggio originale- Da: Chris Withers [mailto:[EMAIL PROTECTED] Inviato: giovedì 12 giugno 2003 15.40 A: Andrew R. Halko Cc: 'Fabio Paracchini'; [EMAIL PROTECTED]; 'Shane Hathaway' Oggetto: Re: [Zope-dev] RE: DBtab and BDBStorage Andrew R. Halko wrote: Well, currently I cannot get python 2.2.3 to work with Plone. What do you need Python 2.2.3 for? 2.2.3 will support up to 4TB, which would solve all my problems, but it doesn't work. I have LFS in 2.1.3, have you tried recompiling Python 2.1.3 with LFS? cheers, Chris I would add that 2.1.3 on Windows does not support LFS. At least from what I see from here: http://mail.zope.org/pipermail/zope/2002-October/124030.html Anyone has different info ? Another way is if you install Python 2.2 and ZODB3.2a, you can use ZEO and mount via DBTab. In this way you can use Py2.3+ZODB3.2a as ZEO server, and use LFS, and then mount the storage via ZEO Client on a Py2.1+ZODB3.2a+ZOPE. I tried this only on an experimental setup, and it seemed to work, at least I was able to mount a DB and create a Plone site; I didn't do any stress test, i.e. load more than 2Gb. If someone is willing to try more, I'll be happy to assist... Ciao Fabio ___ Zope-Dev maillist - [EMAIL PROTECTED] http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
Re: R: [Zope-dev] RE: DBtab and BDBStorage
Fabio Paracchini wrote: Another way is if you install Python 2.2 and ZODB3.2a, you can use ZEO and mount via DBTab. In this way you can use Py2.3+ZODB3.2a as ZEO server, and use LFS, and then mount the storage via ZEO Client on a Py2.1+ZODB3.2a+ZOPE. I tried this only on an experimental setup, and it seemed to work, at least I was able to mount a DB and create a Plone site; I didn't do any stress test, i.e. load more than 2Gb. If someone is willing to try more, I'll be happy to assist... Yes, this works and lets you grow beyond 2 GB. I know www.zope.org has run like this before--it might even be running that way now. Zope and the ZEO server don't need to run the same Python version at all. Shane ___ Zope-Dev maillist - [EMAIL PROTECTED] http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
RE: R: [Zope-dev] RE: DBtab and BDBStorage
Yeah, I tried to update python with Plone and that was mess. Now, are you able to run ZEO Server on the same server as Zope/Plone, maybe through another port? I am limited to one server and there is no getting around that. Right now I have my site mounted on 5 different ZODBs and it seems to be a pretty good solution for me. Still, it would be nice not to have that limitation. Andrew R. Halko -Original Message- From: Shane Hathaway [mailto:[EMAIL PROTECTED] Sent: Thursday, June 12, 2003 11:33 AM To: Fabio Paracchini Cc: 'Chris Withers'; Andrew R. Halko; [EMAIL PROTECTED] Subject: Re: R: [Zope-dev] RE: DBtab and BDBStorage Fabio Paracchini wrote: Another way is if you install Python 2.2 and ZODB3.2a, you can use ZEO and mount via DBTab. In this way you can use Py2.3+ZODB3.2a as ZEO server, and use LFS, and then mount the storage via ZEO Client on a Py2.1+ZODB3.2a+ZOPE. I tried this only on an experimental setup, and it seemed to work, at least I was able to mount a DB and create a Plone site; I didn't do any stress test, i.e. load more than 2Gb. If someone is willing to try more, I'll be happy to assist... Yes, this works and lets you grow beyond 2 GB. I know www.zope.org has run like this before--it might even be running that way now. Zope and the ZEO server don't need to run the same Python version at all. Shane ___ Zope-Dev maillist - [EMAIL PROTECTED] http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
RE: [Zope-dev] RE: DBtab and BDBStorage
The powers that be... Also, I did not know of the issue and didn't think I'd have any problems. Andrew R. Halko -Original Message- From: Chris Withers [mailto:[EMAIL PROTECTED] Sent: Thursday, June 12, 2003 11:25 AM To: Andrew R. Halko Cc: [EMAIL PROTECTED] Subject: Re: [Zope-dev] RE: DBtab and BDBStorage (keep it on the list please) Andrew R. Halko wrote: Are you running Windows or Linux? Windows and python do not support LFS Why are you trying to run a production system on Windows? Chris ___ Zope-Dev maillist - [EMAIL PROTECTED] http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
Re: R: [Zope-dev] RE: DBtab and BDBStorage
Andrew R. Halko wrote: Yeah, I tried to update python with Plone and that was mess. Now, are you able to run ZEO Server on the same server as Zope/Plone, maybe through another port? I am limited to one server and there is no getting around that. Right now I have my site mounted on 5 different ZODBs and it seems to be a pretty good solution for me. Still, it would be nice not to have that limitation. Yes, ZEO and Zope can easily coexist in a single box. ZEO always listens on a different port than Zope. Shane ___ Zope-Dev maillist - [EMAIL PROTECTED] http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
RE: [Zope-dev] RE: DBtab and BDBStorage
Well, currently I cannot get python 2.2.3 to work with Plone. I got a first error and was able to fix the problem, but then got another and have not been able to fix it for the life of me. I tried the Plone mailing list for the bug I got after installing python and got nothing. 2.2.3 will support up to 4TB, which would solve all my problems, but it doesn't work. Right now, my best solution is to scratch BDB and APE's Local Files System storage and go with 5 separate ZODBs at 2GB and then when the new version of Plone comes out, hopefully it will support Python 2.2.3 and all my DBs will have up to 4TB (pretty much unlimited) of available space. Andrew R. Halko -Original Message- From: Chris Withers [mailto:[EMAIL PROTECTED] Sent: Tuesday, June 10, 2003 8:27 AM To: Andrew R. Halko Cc: 'Fabio Paracchini'; [EMAIL PROTECTED]; 'Shane Hathaway' Subject: Re: [Zope-dev] RE: DBtab and BDBStorage Andrew R. Halko wrote: Plone/Members/ - BerkleyDB to allow a large number of users a large DB to create whatever they need in their areas I don't see why you're using BDB here. If you have a 4GB Data.fs in another part of your setup, what's the problem with just using a FileStorage for this? cheers, Chris ___ Zope-Dev maillist - [EMAIL PROTECTED] http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
[Zope-dev] RE: DBtab and BDBStorage
Hey Shane, After I converted a Plone folder into its own ZODB, I believe it still has the contents of the old site in it while loading the one folder from the new database. So, I copied data.fs to be files.fs and then deleted in the plone interface, created the mount point and it came back. Loading from the files.fs The thing is, all the old content from data.fs is still in files.fs just sitting dormant and inaccessible. This makes me wonder if the old stuff from my files folder is sitting dormant in data.fs? Do you know of any way to make fix these databases so they don't have the areas that they are not being used for anymore? Thanks! Andrew R. Halko ___ Zope-Dev maillist - [EMAIL PROTECTED] http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
[Zope-dev] Re: DBtab and BDBStorage
Andrew R. Halko wrote: Thanks Shane. Is all of your suggestions along with the setup I was considering? I have to research ZEO, cause I know nothing about it. Do you mind explaining the last two things just a slight more as I am unfamiliar. Such as how you figure out cache and what is packing? FileStorages only append until you pack. Visit the database control panel to remove old versions of objects. No wonder your database is big--since you've never packed, your database contains all revisions ever committed. Packing will help a lot. To figure out the right cache size, start with 4000 (as you have done.) Let your site run and look at the activity graph for each database after an hour of peak usage. If it's loading a lot of objects on every request, increase the cache size to use more RAM (but don't make Zope swap!) If it's hardly loading anything, decrease the cache size to give RAM back to the system. Mounting portal_catalog is a new trick I've been asking people to try. Just put it in a mounted database. Once you've done that, your main database will probably grow much more slowly than before. Shane ___ Zope-Dev maillist - [EMAIL PROTECTED] http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
[Zope-dev] Re: DBtab and BDBStorage
Andrew R. Halko wrote: Now, I am trying to setup my dbtab.conf to first test this before I try and integrate it into my current site, which has limited info now, but needs to be ready for major population in a week or two at most. Here is what I am guessing for config, maybe you can tell me if I am close and what more I need to do. Some suggestions: - Use ZEO. It makes starting/stopping Zope much faster and isolates the application from the database. - Put /Plone/portal_catalog in its own database, allowing you to tune its cache size and pack it more frequently than the rest of the data. - Watch the activity graphs in the Control_Panel to determine proper cache sizes. Note that DBTab 1.2 fixes a bug related to this. Shane ___ Zope-Dev maillist - [EMAIL PROTECTED] http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
[Zope-dev] RE: DBtab and BDBStorage
Thanks for the help!, a few more questions (lets hope). I haven't done anything yet by the way, I wanted to research my options and do some testing before I went ahead and did anything major. I did a little testing, but haven't gotten very far. The setup for Plone that I am thinking will support everything I need and work is: Main Plone site - ZODB 4gb once I install python 2.2 and enable large_file_support Plone/images/ - folder with all my images stores on Local File System Plone/files/ - folder with all my main files (word, pdf, etc.) stores on Local File System Plone/Members/ - BerkleyDB to allow a large number of users a large DB to create whatever they need in their areas Now, I am trying to setup my dbtab.conf to first test this before I try and integrate it into my current site, which has limited info now, but needs to be ready for major population in a week or two at most. Here is what I am guessing for config, maybe you can tell me if I am close and what more I need to do. [Storage: Main] type=FileStorage file_name=%(CLIENT_HOME)s/Data.fs [Database: Main] mount_paths=/ [Storage: Images] type=FileStorage basepath=%(CLIENT_HOME)s/images [Database: Images] mount_paths=/Plone/images/ container_class=OFS.Folder.Folder cache_size=4000 [Storage: Files] type=FileStorage basepath=%(CLIENT_HOME)s/files [Database: Files] mount_paths=/Plone/files/ container_class=OFS.Folder.Folder cache_size=4000 [Database: Members] mount_paths=/Plone/Members/ [Storage: Members] type=BDBFullStorage Thanks for all your help, it is very much appreciated. Andrew R. Halko ___ Zope-Dev maillist - [EMAIL PROTECTED] http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Re: DBtab and BDBStorage
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On Friday, June 6, 2003, at 06:17 AM, Shane Hathaway wrote: - Use ZEO. It makes starting/stopping Zope much faster and isolates the application from the database. I've noticed that this pattern doesn't hold with Zope 2.7 as it currently stands. Even on a powerful machine the ZEO clients can take quite some time to start up. Does anyone know why this might be? I'm talking here about a brand-new ZEO server with practically empty ZODB. No additional Products. Richard -BEGIN PGP SIGNATURE- Version: GnuPG v1.2.1 (Darwin) iD8DBQE+38vorGisBEHG6TARAiG5AJ0XBcUZkMnOX/4ECk/JChEu1NUhZgCeLs+a kvn9GuVvOswbWOplJr04WIc= =xlTW -END PGP SIGNATURE- ___ Zope-Dev maillist - [EMAIL PROTECTED] http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
[Zope-dev] RE: DBtab and BDBStorage
Thanks Shane. Is all of your suggestions along with the setup I was considering? I have to research ZEO, cause I know nothing about it. Do you mind explaining the last two things just a slight more as I am unfamiliar. Such as how you figure out cache and what is packing? Andrew R. Halko -Original Message- From: Shane Hathaway [mailto:[EMAIL PROTECTED] Sent: Thursday, June 05, 2003 4:17 PM To: Andrew R. Halko Cc: 'Fabio Paracchini'; [EMAIL PROTECTED] Subject: Re: DBtab and BDBStorage Andrew R. Halko wrote: Now, I am trying to setup my dbtab.conf to first test this before I try and integrate it into my current site, which has limited info now, but needs to be ready for major population in a week or two at most. Here is what I am guessing for config, maybe you can tell me if I am close and what more I need to do. Some suggestions: - Use ZEO. It makes starting/stopping Zope much faster and isolates the application from the database. - Put /Plone/portal_catalog in its own database, allowing you to tune its cache size and pack it more frequently than the rest of the data. - Watch the activity graphs in the Control_Panel to determine proper cache sizes. Note that DBTab 1.2 fixes a bug related to this. Shane ___ Zope-Dev maillist - [EMAIL PROTECTED] http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Re: DBtab and BDBStorage
Richard Jones wrote at 2003-6-6 09:01 +1000: - Use ZEO. It makes starting/stopping Zope much faster and isolates the application from the database. I've noticed that this pattern doesn't hold with Zope 2.7 as it currently stands. Even on a powerful machine the ZEO clients can take quite some time to start up. Does anyone know why this might be? I'm talking here about a brand-new ZEO server with practically empty ZODB. No additional Products. Starting Zope loads several hundreds of Python modules. This may take some time. Dieter ___ Zope-Dev maillist - [EMAIL PROTECTED] http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
