[Zope] accelerating Zope restart
Hi, My Data.fs is huge (21GB) because it contains many video files. This is not a problem in itself, however, I recently had to reboot my machine and now zope takes around 20-30 minutes to restart. Is a fstest automatically done ? How could I accelerate the restarting, if possible ? Thanks a lot for any advice, Eric ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] accelerating Zope restart
--On 31. August 2006 12:18:24 +0100 [EMAIL PROTECTED] wrote: Hi, My Data.fs is huge (21GB) because it contains many video files. This is not a problem in itself, however, I recently had to reboot my machine and now zope takes around 20-30 minutes to restart. Is a fstest automatically done ? How could I accelerate the restarting, if possible ? Zope does maintain a Data.fs.index file. If it becomes corrupt e.g. through an unclean shutdown then Zope will recreate it by scanning the whole Data.fs file when starting Zope the next time. This will take some timeso before rebooting you should shutdown down your Zope properly. -aj -- ZOPYX Ltd. Co. KG - Charlottenstr. 37/1 - 72070 Tübingen - Germany Web: www.zopyx.com - Email: [EMAIL PROTECTED] - Phone +49 - 7071 - 793376 E-Publishing, Python, Zope Plone development, Consulting pgppYVpplEYVN.pgp Description: PGP signature ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] accelerating Zope restart
[EMAIL PROTECTED] wrote: My Data.fs is huge (21GB) because it contains many video files. This is not a problem in itself, however, I recently had to reboot my machine and now zope takes around 20-30 minutes to restart. Is a fstest automatically done ? How could I accelerate the restarting, if possible ? Use ZEO. Make sure the storage server shuts down properly so it saves its indexes to disk. cheers, Chris -- Simplistix - Content Management, Zope Python Consulting - http://www.simplistix.co.uk ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] accelerating Zope restart
Zope does maintain a Data.fs.index file. If it becomes corrupt e.g. through an unclean shutdown then Zope will recreate it by scanning the whole Data.fs file when starting Zope the next time. This will take some timeso before rebooting you should shutdown down your Zope properly. -aj OK, thanks. Eric ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] accelerating Zope restart
- Original Message - From: [EMAIL PROTECTED] To: zope@zope.org Sent: Thursday, August 31, 2006 7:18 AM Subject: [Zope] accelerating Zope restart Hi, My Data.fs is huge (21GB) because it contains many video files. This is not a problem in itself, however, I recently had to reboot my machine and now zope takes around 20-30 minutes to restart. Is a fstest automatically done ? How could I accelerate the restarting, if possible ? You may also want to have a look at the localfs product which would allow you to store your large video files on the local file system instead of inside the ZODB (but still access them as if they were stored in the ZODB). http://sourceforge.net/projects/localfs Jonathan ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] accelerating Zope restart
Zope does maintain a Data.fs.index file. If it becomes corrupt e.g. through an unclean shutdown then Zope will recreate it by scanning the whole Data.fs file when starting Zope the next time. This will take some timeso before rebooting you should shutdown down your Zope properly. OK, I have two questions about shutting down zope: - To cleanly shut down zope daemon, is zopectl stop enough ? - If zope runs in the foreground, how to shut it down cleanly ? CTRL+C won't do it I guess ? Eric ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
[Zope] Re: accelerating Zope restart
On Thu, 2006-31-08 at 12:52 +0100, [EMAIL PROTECTED] wrote: Zope does maintain a Data.fs.index file. If it becomes corrupt e.g. through an unclean shutdown then Zope will recreate it by scanning the whole Data.fs file when starting Zope the next time. This will take some timeso before rebooting you should shutdown down your Zope properly. OK, I have two questions about shutting down zope: - To cleanly shut down zope daemon, is zopectl stop enough ? Yes. - If zope runs in the foreground, how to shut it down cleanly ? CTRL+C won't do it I guess ? I always thought CTRL+C would do it actually. It's only a force kill with -9 that will kill it without shutting down properly. But you could always go to the Control_Panel in the zmi and do a shutdown from there, that is for certain safe. - Rocky -- Rocky Burt ServerZen Software -- http://www.serverzen.com News About The Server (blog) -- http://www.serverzen.net signature.asc Description: This is a digitally signed message part ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
[Zope] Re: accelerating Zope restart
On Thu, 2006-31-08 at 12:18 +0100, [EMAIL PROTECTED] wrote: Hi, My Data.fs is huge (21GB) because it contains many video files. This is not a problem in itself, however, I recently had to reboot my machine and now zope takes around 20-30 minutes to restart. Is a fstest automatically done ? How could I accelerate the restarting, if possible ? I highly recommend you use some sort of external storage product to store such large files. Perhaps Chris McDonough's blob product might fit well here. - Rocky -- Rocky Burt ServerZen Software -- http://www.serverzen.com News About The Server (blog) -- http://www.serverzen.net signature.asc Description: This is a digitally signed message part ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] accelerating Zope restart
On Thu, Aug 31, 2006 at 12:23:06PM +0100, Chris Withers wrote: [EMAIL PROTECTED] wrote: My Data.fs is huge (21GB) because it contains many video files. This is not a problem in itself, however, I recently had to reboot my machine and now zope takes around 20-30 minutes to restart. Is a fstest automatically done ? How could I accelerate the restarting, if possible ? Use ZEO. I can see how that could let Zope restart faster. But ZEO can have *severe* performance implications for large blobs such as videos. See the bottom of http://www.slinkp.com/code/zopestuff/blobnotes Maybe worth noting that DirectoryStorage starts up fast regardless of storage size. http://dirstorage.sourceforge.net/ It also does not require RAM proportional to storage size. It is also very reliable and has some other nice features. The downsides: - You need a filesystem that can handle very large number of tiny files. - Packing is VERY slow (21 GB could easily take all night). - Somewhat slower than Filestorage in general. - Requires more disk space (+30%). This page is old but maybe still useful: http://cvs.zope.org/ZODB3/Doc/storages.html?rev=1 -- Paul Winkler http://www.slinkp.com ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
[Zope] Zope restart fails
Following a server restart in the last couple of days I have been unable to get Zope started. Is there anything in particular I should check for? Until the reboot Zope had been running for months without a problem, although it may not have been stopped correctly before the reboot. Should I need to delete any lockfiles that may have been left in existance or should they get deleted on restart? -- John ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] Zope restart fails
Eric Banford said: At 03:21 PM 10/3/2005, John Poltorak wrote: Following a server restart in the last couple of days I have been unable to get Zope started. Is there anything in particular I should check for? Until the reboot Zope had been running for months without a problem, although it may not have been stopped correctly before the reboot. Should I need to delete any lockfiles that may have been left in existance or should they get deleted on restart? Have you tried restarting via the C:\Plone 2\Data\bin\runzope.bat file? This will open a command prompt and show you startup messages, including any errors that cannot be resolved. Or, if you're on linux / unix, the equivalent is: path_to_your_instance/bin/runzope or, equivalently: path_to_your_instance/bin/zopectl fg -- Paul Winkler ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] Zope restart fails
On Mon, Oct 03, 2005 at 03:38:52PM -0400, Eric Banford wrote: At 03:21 PM 10/3/2005, John Poltorak wrote: Following a server restart in the last couple of days I have been unable to get Zope started. Is there anything in particular I should check for? Until the reboot Zope had been running for months without a problem, although it may not have been stopped correctly before the reboot. Should I need to delete any lockfiles that may have been left in existance or should they get deleted on restart? Have you tried restarting via the C:\Plone 2\Data\bin\runzope.bat file? This will open a command prompt and show you startup messages, including any errors that cannot be resolved. I'm using a remote Unix system. running 'sh zopectl start' appears to work but then Zope quickly falls over. Hope that help, Eric -- John ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
[Zope] Re: Zope restart fails
John Poltorak wrote: running 'sh zopectl start' appears to work but then Zope quickly falls over. try ./runzope and tell us what happens. ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] Restart button in Control Panel
I don't think that debug mode has anything to do with it. Rather, if Correct. i have debug mode off, no Restart button. you're using runzope it's not running in daemon mode, and so cannot restart. Run it as a service with 'zopectl start' and you'll have a Restart button. Correct again. Thank you JCC. -- Milos Prudek ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
[Zope] Restart button in Control Panel
Is it possible to have the Restart button in ZMI Control Panel? I only have Shutdown. What controls this? I start my Zope instance with instance/bin/runzope . I use Zope 2.7.4. -- Milos Prudek http://www.spoxdesign.com - your web usability testing ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] Restart button in Control Panel
You are starting it in Debug mode, which means it will not allow for the restart button. /etc/zope.conf (edit debug mode) Also, try running it with: /bin/zopectl start Jake -- http://www.ZopeZone.com Milos Prudek said: Is it possible to have the Restart button in ZMI Control Panel? I only have Shutdown. What controls this? I start my Zope instance with instance/bin/runzope . I use Zope 2.7.4. -- Milos Prudek http://www.spoxdesign.com - your web usability testing ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev ) ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] Restart button in Control Panel
Jake wrote: You are starting it in Debug mode, which means it will not allow for the restart button. /etc/zope.conf (edit debug mode) Also, try running it with: /bin/zopectl start I don't think that debug mode has anything to do with it. Rather, if you're using runzope it's not running in daemon mode, and so cannot restart. Run it as a service with 'zopectl start' and you'll have a Restart button. --jcc ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope-dev] ParsedXML in Zclass methods loses permissions on Zope restart
Brad Clements wrote: I'm still casting around for a suggestion on where I can go to fix this. I have a ParsedXML object in the methods list of a ZClass Product. The Access Contents Information Permission Mapping always get's reset to blank in the ParsedXML object when Zope restarts. Is this a problem with ZClasses, or with ParsedXML? Taking a look at ParsedXML, it looks like it just does a very simple permission definition, so it doesn't *look* like there's something wrong there. What it sounds like is that something that should be persistent isn't for some reason. Either an object attribute is changed without the permission mechanism being informed of the change, or it's for some reason an attribute on a nonpersistent is changed. This at least would explain why the permission mapping magically goes away.. Don't know if that helped at all; good luck. If you find out there's any problem in ParsedXML please let me know! Regards, Martijn ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Parsed-XML-Dev] Re: [Zope-dev] ParsedXML in Zclass methods loses permissions on Zope restart
Martijn Faassen [EMAIL PROTECTED] writes: Brad Clements wrote: I'm still casting around for a suggestion on where I can go to fix this. I have a ParsedXML object in the methods list of a ZClass Product. The Access Contents Information Permission Mapping always get's reset to blank in the ParsedXML object when Zope restarts. Is this a problem with ZClasses, or with ParsedXML? Taking a look at ParsedXML, it looks like it just does a very simple permission definition, so it doesn't *look* like there's something wrong there. What it sounds like is that something that should be persistent isn't for some reason. Either an object attribute is changed without the permission mechanism being informed of the change, or it's for some reason an attribute on a nonpersistent is changed. This at least would explain why the permission mapping magically goes away.. I don't understand the situation very well, but Martijn's explanation sounds familiar. Remember, there's only one persistent Zope object in a ParsedXML instance, and that's the document proxy object. All of the proxy subobjects are transient, and that includes proxy documents that are navigated to from proxy subobjects. I.E. if app.foo.PXML is the ParsedXML instance, then setting Zope attributes on app.foo.PXML.firstChild() and app.foo.PXML.firstChild.parentNode() won't persist. Same goes if you traverse to these nodes via the web-exposed URLs of these methods. Perhaps you're trying to persist changes to Zope attributes on those nodes? -- Karl Anderson [EMAIL PROTECTED] http://www.monkey.org/~kra/ ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
[Zope-dev] Method invocation after Zope restart
Hi everybody, Just one question (maybe a newbie question): After a Zope restart I want to invoke a method from an object instance. Is there a such mechanism builtin in the Zope startup? Or in a more wide perspective, how could an object instance be notified of a Zope restart? Thanks, Paulo --- Paulo Marques Goncalves CDFtel, Lda Ph. No: +351.22.3389843 Rua Goncalo Cristovao, 347 - Sala 205 FAX No: +351.22.3389845 4000-270 PORTO E-mail: mailto:[EMAIL PROTECTED]Portugal --- ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Method invocation after Zope restart
Use the __init__.py of a package inside the Products directory to do something at startup (e.g. Products/ZCatalog/__init__.py). Use Python's sys.exitfunc to hook a shutdown. Paulo M. Goncalves wrote: Hi everybody, Just one question (maybe a newbie question): After a Zope restart I want to invoke a method from an object instance. Is there a such mechanism builtin in the Zope startup? Or in a more wide perspective, how could an object instance be notified of a Zope restart? Thanks, Paulo --- Paulo Marques Goncalves CDFtel, Lda Ph. No: +351.22.3389843 Rua Goncalo Cristovao, 347 - Sala 205 FAX No: +351.22.3389845 4000-270 PORTO E-mail: mailto:[EMAIL PROTECTED]Portugal --- ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope ) -- Chris McDonough Digital Creations, Inc. Publishers of Zopehttp://www.zope.org Killing hundreds of birds with thousands of stones ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope] Restart...
I said: I'll probably start experimenting with ZEO and IDLE and a way to get unrestricted Python code into ZODB. Smalltalk kicks ass, and Zope is only that far from becoming a superset of it. I did a quick hack that might be interesting to take a look at. I posted it on zope-dev, here's the link: http://lists.zope.org/pipermail/zope-dev/2000-December/008164.html Basically it's a quick hack to let you browse Zope's ZODB from within IDLE. The next steps I'm thinking about is see whether tkhtml works with Tkinter (anyone?) and if yes, open tkhtml windows as a double click action on the DB browser tree (with communication, if possible, through Python and not through HTTP). I'm aware of the (stalled?) Zope-devenv-under- mozilla project. The approach by extending IDLE seems much simpler to me, and I think Zope really needs a decent development environment in order to move from useful to insanely useful - I did a pilot project with Zope last week (http://domein.worldsites.be), and while I am not unhappy with the result as a producer, I am very unhappy with the result as a software engineer. Zope needs an IDE and a decent versioning system (the current CVS project is a good start, but as far as I can see it at the moment too cumbersome to be practical), and until that time I fear I'll have do all my work in Python (maybe with Webware, it seems decent enough and has better support, through its single-shot adapter, for development-time work in Python). -- Cees de Groot http://www.cdegroot.com [EMAIL PROTECTED] GnuPG 1024D/E0989E8B 0016 F679 F38D 5946 4ECD 1986 F303 937F E098 9E8B ___ Zope maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )
[Zope] Restart Zope script
Hello. Do you like my script to restart Zope? I don't. I followed instructions in the Zope archive to write a restart script for Zope. It works if I run it from the command line but if I put it in a cron job, it hangs and does not start properly. Can you help me? THANK YOU. Heather #!/usr/bin/python import os, string # My Zope is installed in /usr/zope # So the commands to stop and start it are, stopcmd = "/usr/zope/stop" startcmd = "/usr/zope/start " # Command to check Zope processes running, cmd = "ps aux | grep zope" # Find the Zope PIDs that are actually running, readstdin = os.popen(cmd).readlines() pids = [] for eachline in readstdin : words = string.split(eachline) if len(words) 2 : pids.append(words[1]) pids.append(string.split(eachline)[1]) # Find the PIDs that should be running, pidsfile = "/usr/zope/var/Z2.pid" f = open(pidsfile, 'r') data = f.read() f.close() runningpids = 0 zopepids = string.split(data) for eachpid in zopepids : if eachpid in pids : runningpids = runningpids + 1 if runningpids != 2 : os.popen(stopcmd) os.popen(startcmd) __ Do You Yahoo!? Yahoo! Messenger - Talk while you surf! It's FREE. http://im.yahoo.com/ ___ Zope maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )
[Zope] Restart button corrupted data.fs.index file
After installing two new Products (ZCounter the first time,and FSCounter
the next time), I hit the Restart button in the Zope Control Panel. Zope
did not come up. I tried a manual stop/start. The start resulted in this
error message:
Traceback (innermost last):
File "/usr/home/txpn/Zope/z2.py", line 554, in ?
exec "import "+MODULE in {}
File "string", line 1, in ?
File "/usr/home/txpn/Zope/lib/python/Zope/__init__.py", line 110, in ?
DB=ZODB.FileStorage.FileStorage(Globals.BobobaseName)
File "/usr/home/txpn/Zope/lib/python/ZODB/FileStorage.py", line 292,
in
+__init__
r=self._restore_index()
File "/usr/home/txpn/Zope/lib/python/ZODB/FileStorage.py", line 427,
in
+_restore_index
info=p.load()
cPickle.UnpicklingError: pickle data was truncated
The data.fs.index file was then corrupt. If I renamed it, and tried
another start, Zope would start fine. I did this twice w/ the same
results.
I'm using Zope 2.2.2.
Stevea on #zope suggested Jim might be interested in this, and that I
should also send it to a Zope mailing list -- since I'm not on Zope Dev
yet, I'm sending it here. I have a copy of the old index files if anyone
needs to see them.
Cheers,
Kit
___
Zope maillist - [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope
** No cross posts or HTML encoding! **
(Related lists -
http://lists.zope.org/mailman/listinfo/zope-announce
http://lists.zope.org/mailman/listinfo/zope-dev )
