Dario Lopez-K�sten wrote: > > > -------- Original Message -------- > Subject: Re: [Dirstorage-users] [Fwd: [CPS-devel] directorystorage and > ext3?] > Date: Thu, 12 May 2005 11:10:57 -0400 > From: Paul Winkler <[EMAIL PROTECTED]> > To: [EMAIL PROTECTED] > References: <[EMAIL PROTECTED]> > > On Thu, May 12, 2005 at 12:32:08PM +0200, Dario Lopez-K?sten wrote: > >> -------- Original Message -------- >> Subject: [CPS-devel] directorystorage and ext3? >> Date: Thu, 12 May 2005 12:30:20 +0200 >> From: Jean-Marc Orliaguet <[EMAIL PROTECTED]> >> Organization: Chalmers >> To: L-CPS-devel <[email protected]> >> >> Hi! >> >> Are there any reports of large CPS3 sites running with ZEO / >> DirectoryStorage + ext3 compared to DS + reiserfs? > > > At my workplace, we don't run CPS, just a customized CMFDefault and > a bunch of legacy vanilla-zope stuff; but our primary development > environment > has been using ZEO and a "bushy" DirectoryStorage on an ext3 filesystem > for well over a year now, with no problems whatsoever. > > I'm not sure of uncompressed size, but compressed full backup is > currently 3.1 GB. > > We do run reiserfs on the production systems. >
Hi! according to the benchmarks I'd done so far, ext3 does not seem to scale well after 3 or 4GB of data (corresponding to ~ 400.000 small files in the storage) I've simply uploaded documents: - 1000 x 2MB image attachment - 1000 x 80Kb pdf file (this also includes a transformation from pdf to text) and measured the time that it takes to upload each document: 1000x 2MB image - http://www.medic.chalmers.se/~jmo/dokarkiv/perf-2.pdf + 1000 x 80kb pdf file - http://www.medic.chalmers.se/~jmo/dokarkiv/perf-3.pdf It seems that directory storage does a transaction flush every ten document or so, which knocks ext3 out. Apart from that the figures with reiserfs3 have reached a plateau (1-2 seconds / document) whereas the ext3 figures keep on increasing. regards /JM _______________________________________________ cps-devel mailing list http://lists.nuxeo.com/mailman/listinfo/cps-devel
