[Zope] accelerating Zope restart
Hi, My Data.fs is huge (21GB) because it contains many video files. This is not a problem in itself, however, I recently had to reboot my machine and now zope takes around 20-30 minutes to restart. Is a fstest automatically done ? How could I accelerate the restarting, if possible ? Thanks a lot for any advice, Eric ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] accelerating Zope restart
--On 31. August 2006 12:18:24 +0100 [EMAIL PROTECTED] wrote: Hi, My Data.fs is huge (21GB) because it contains many video files. This is not a problem in itself, however, I recently had to reboot my machine and now zope takes around 20-30 minutes to restart. Is a fstest automatically done ? How could I accelerate the restarting, if possible ? Zope does maintain a Data.fs.index file. If it becomes corrupt e.g. through an unclean shutdown then Zope will recreate it by scanning the whole Data.fs file when starting Zope the next time. This will take some timeso before rebooting you should shutdown down your Zope properly. -aj -- ZOPYX Ltd. Co. KG - Charlottenstr. 37/1 - 72070 Tübingen - Germany Web: www.zopyx.com - Email: [EMAIL PROTECTED] - Phone +49 - 7071 - 793376 E-Publishing, Python, Zope Plone development, Consulting pgppYVpplEYVN.pgp Description: PGP signature ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] accelerating Zope restart
[EMAIL PROTECTED] wrote: My Data.fs is huge (21GB) because it contains many video files. This is not a problem in itself, however, I recently had to reboot my machine and now zope takes around 20-30 minutes to restart. Is a fstest automatically done ? How could I accelerate the restarting, if possible ? Use ZEO. Make sure the storage server shuts down properly so it saves its indexes to disk. cheers, Chris -- Simplistix - Content Management, Zope Python Consulting - http://www.simplistix.co.uk ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] accelerating Zope restart
Zope does maintain a Data.fs.index file. If it becomes corrupt e.g. through an unclean shutdown then Zope will recreate it by scanning the whole Data.fs file when starting Zope the next time. This will take some timeso before rebooting you should shutdown down your Zope properly. -aj OK, thanks. Eric ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] accelerating Zope restart
- Original Message - From: [EMAIL PROTECTED] To: zope@zope.org Sent: Thursday, August 31, 2006 7:18 AM Subject: [Zope] accelerating Zope restart Hi, My Data.fs is huge (21GB) because it contains many video files. This is not a problem in itself, however, I recently had to reboot my machine and now zope takes around 20-30 minutes to restart. Is a fstest automatically done ? How could I accelerate the restarting, if possible ? You may also want to have a look at the localfs product which would allow you to store your large video files on the local file system instead of inside the ZODB (but still access them as if they were stored in the ZODB). http://sourceforge.net/projects/localfs Jonathan ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] accelerating Zope restart
Zope does maintain a Data.fs.index file. If it becomes corrupt e.g. through an unclean shutdown then Zope will recreate it by scanning the whole Data.fs file when starting Zope the next time. This will take some timeso before rebooting you should shutdown down your Zope properly. OK, I have two questions about shutting down zope: - To cleanly shut down zope daemon, is zopectl stop enough ? - If zope runs in the foreground, how to shut it down cleanly ? CTRL+C won't do it I guess ? Eric ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] accelerating Zope restart
On Thu, Aug 31, 2006 at 12:23:06PM +0100, Chris Withers wrote: [EMAIL PROTECTED] wrote: My Data.fs is huge (21GB) because it contains many video files. This is not a problem in itself, however, I recently had to reboot my machine and now zope takes around 20-30 minutes to restart. Is a fstest automatically done ? How could I accelerate the restarting, if possible ? Use ZEO. I can see how that could let Zope restart faster. But ZEO can have *severe* performance implications for large blobs such as videos. See the bottom of http://www.slinkp.com/code/zopestuff/blobnotes Maybe worth noting that DirectoryStorage starts up fast regardless of storage size. http://dirstorage.sourceforge.net/ It also does not require RAM proportional to storage size. It is also very reliable and has some other nice features. The downsides: - You need a filesystem that can handle very large number of tiny files. - Packing is VERY slow (21 GB could easily take all night). - Somewhat slower than Filestorage in general. - Requires more disk space (+30%). This page is old but maybe still useful: http://cvs.zope.org/ZODB3/Doc/storages.html?rev=1 -- Paul Winkler http://www.slinkp.com ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
