Re: [Zope] Re: Packing Data.fs

2006-08-31 Thread Chris Withers
Jens Vagelpohl wrote: It's also f'ing slow and doesn't scale ;-) Translation: In our experience, large databases with a lot of objects can lead to very slow operations, such as packing and backing up the data. This might be improved by using a file system designed for many small files, but

[Zope] Re: Packing Data.fs

2006-08-30 Thread Duncan Booth
Tres Seaver wrote: Mark Gibson wrote: I know zope makes a copy of Data.fs before packing. Is it possible to specify a location other than zope/var to place that copy? Actually, it makes a *new* file when packing, and then unlinks the old file and re-links the copy under its name after

[Zope] Re: Packing Data.fs

2006-08-30 Thread Philipp von Weitershausen
Duncan Booth wrote: Tres Seaver wrote: Mark Gibson wrote: I know zope makes a copy of Data.fs before packing. Is it possible to specify a location other than zope/var to place that copy? Actually, it makes a *new* file when packing, and then unlinks the old file and re-links the copy

Re: [Zope] Re: Packing Data.fs

2006-08-30 Thread Chris Withers
Philipp von Weitershausen wrote: I should note that DirectoryStorage (http://dirstorage.sf.net) has excellent replication support which make things like moving live Zope instances from one partition to another one w/o lots of downtime almost trivial. It's also f'ing slow and doesn't scale ;-)

Re: [Zope] Re: Packing Data.fs

2006-08-30 Thread Jens Vagelpohl
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 30 Aug 2006, at 15:48, Chris Withers wrote: Philipp von Weitershausen wrote: I should note that DirectoryStorage (http://dirstorage.sf.net) has excellent replication support which make things like moving live Zope instances from one partition

[Zope] Re: Packing Data.fs

2006-08-29 Thread Tres Seaver
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Mark Gibson wrote: I know zope makes a copy of Data.fs before packing. Is it possible to specify a location other than zope/var to place that copy? Actually, it makes a *new* file when packing, and then unlinks the old file and re-links the copy

Re: [Zope] Re: Packing data.fs programmatically

2006-02-25 Thread Jens Vagelpohl
On 25 Feb 2006, at 04:27, Derrick Hudson wrote: | Then introduce it, it's simple to set up and adds a world of | functionality! I could. I'd have to learn how to work with it :-). The deployments I've worked with are all single uniprocessor machines, thus ZEO wouldn't yield a performance

[Zope] Re: Packing data.fs programmatically

2006-02-24 Thread Chris Withers
Derrick Hudson wrote: Chris, On Tue, Jan 31, 2006 at 01:36:36PM +, Chris Withers wrote: | ZEO Stepper Is ZEO required to use Stepper? Yes, otherwise you'd have to shut down your Zope instance to run Stepper ;-) Does 'zopectl run' require exclusive access to the database? (IOW

[Zope] Re: Packing data.fs programmatically

2006-02-24 Thread Derrick Hudson
On Fri, Feb 24, 2006 at 09:18:35PM +, Chris Withers wrote: | Derrick Hudson wrote: | Chris, | | On Tue, Jan 31, 2006 at 01:36:36PM +, Chris Withers wrote: | | ZEO Stepper | | Is ZEO required to use Stepper? | | Yes, otherwise you'd have to shut down your Zope instance to run

[Zope] Re: Packing data.fs programmatically

2006-02-23 Thread Derrick Hudson
Chris, On Tue, Jan 31, 2006 at 01:36:36PM +, Chris Withers wrote: | ZEO Stepper Is ZEO required to use Stepper? | Or if you don't like Stepper, then zopectl run... Does 'zopectl run' require exclusive access to the database? (IOW must the zope server be stopped before zopectl run can

Re: [Zope] Re: Packing data.fs programmatically

2006-02-23 Thread Paul Winkler
On Thu, Feb 23, 2006 at 11:27:59AM -0500, Derrick Hudson wrote: Does 'zopectl run' require exclusive access to the database? (IOW must the zope server be stopped before zopectl run can be used?) Yes, IFF you are not running zeo. That's another useful reason to use zeo :-) I just came

[Zope] Re: Packing data.fs programmatically

2006-01-31 Thread Jonathan Cleaver
Ah-ha, that's another approach I had not thought of! Many thanks! Cheers Jonathan Reinoud van Leeuwen wrote: On Tue, Jan 31, 2006 at 11:38:34AM +, Jonathan Cleaver wrote: I am using the following module to pack my data.fs programmatically before a backup is made. This was largely taken

[Zope] Re: Packing data.fs programmatically

2006-01-31 Thread Max M
Chris Withers wrote: Reinoud van Leeuwen wrote: I do it though the webinterface with a wget from the crontab: @daily cd /some_path/zeo_server/var \ cp Data.fs Data.fs.pre_pack_backup \ /usr/local/bin/wget \

Re: [Zope] Re: Packing data.fs programmatically

2006-01-31 Thread Chris Withers
ZEO Stepper Or if you don't like Stepper, then zopectl run... Chris Max M wrote: Chris Withers wrote: Reinoud van Leeuwen wrote: I do it though the webinterface with a wget from the crontab: @daily cd /some_path/zeo_server/var \ cp Data.fs Data.fs.pre_pack_backup \

Re: [Zope] Re: Packing data.fs programmatically

2006-01-31 Thread Reinoud van Leeuwen
On Tue, Jan 31, 2006 at 01:36:36PM +, Chris Withers wrote: ZEO Stepper Or if you don't like Stepper, then zopectl run... Chris Sounds interesting. Do you have a working example that you can post here? -- __ Nothing is as

Re: [Zope] Re: Packing data.fs programmatically

2006-01-31 Thread Chris Withers
The product comes with a whole raft of examples for doing things: http://www.simplistix.co.uk/software/zope/stepper base.py and config.py contain the examples, lemme know if you have any problems... Chris Reinoud van Leeuwen wrote: On Tue, Jan 31, 2006 at 01:36:36PM +, Chris Withers