Re: [Zope-dev] Massive scalability

2001-01-17 Thread Steve Spicklemire
L PROTECTED] Cc: "Michael Andy Bernstein" [EMAIL PROTECTED] Sent: Tuesday, January 16, Andy 2001 3:22 PM Subject: Re: [Zope-dev] Massive scalability Michael Bernstein wrote: So, again: Has anyone run up against any performance or other limitation

[Zope-dev] [Fwd: Re: [Zope-dev] Massive scalability]

2001-01-17 Thread Michael Bernstein
Forwarded to the list to maintain the thread. Original Message From: John Eikenberry [EMAIL PROTECTED] Subject: Re: [Zope-dev] Massive scalability To: Michael Bernstein [EMAIL PROTECTED] Michael Bernstein wrote: John Eikenberry wrote: Can you tell us a bit about how many

Re: [Zope-dev] Massive scalability

2001-01-17 Thread Andy McKay
Are you saying that Zope's startup and shutdown time is affected by the size of the ZODB? Yep. Over small ZODB's you wont notice the effect until it gets large. I found it very annoying when doing a lot of work in python and so had two databases, one with a small amount of data and one with a

Re: [Zope-dev] Massive scalability

2001-01-17 Thread Andy McKay
D]; [EMAIL PROTECTED]; [EMAIL PROTECTED] Sent: Wednesday, January 17, 2001 3:43 AM Subject: Re: [Zope-dev] Massive scalability Hi Andy, I'm not sure what you mean by 'interface/way', so.. I'm going to guess at two possible interpretations. 1) Basically ZPatterns allows you to define classes

Re: [Zope-dev] Massive scalability

2001-01-17 Thread ender
On Tuesday 16 January 2001 20:42, Michael Bernstein wrote: Are you saying that Zope's startup and shutdown time is affected by the size of the ZODB? AFAIK on a filestorage zope loads up the indexes (oid, file_offset?) into memory on start to facilitate object retrieval which impacts start up

Re: [Zope-dev] Massive scalability

2001-01-17 Thread Andy McKay
y McKay" [EMAIL PROTECTED] Cc: [EMAIL PROTECTED] Sent: Wednesday, January 17, 2001 12:05 PM Subject: Re: [Zope-dev] Massive scalability On Tuesday 16 January 2001 20:42, Michael Bernstein wrote: Are you saying that Zope's startup and shutdown time is affected by the size of the ZODB? AFA

Re: [Zope-dev] Massive scalability

2001-01-16 Thread Andy McKay
While that would work for the simple object case, I find the prospect of storing a bunch of BLOBs (for the image data of the Photos) in an RDBMS to be *most* un-appetizing. Storing them on the server's file-system seems in-elegant as well. Okey dokey, just a suggestion. I have heard people

Re: [Zope-dev] Massive scalability

2001-01-16 Thread John Eikenberry
Michael Bernstein wrote: So, again: Has anyone run up against any performance or other limitations regarding large numbers (hundreds of thousands or more) of objects stored within the ZODB either in a BTree Folder or a Rack? I was looking into the same issues recently, but for a much

Re: [Zope-dev] Massive scalability

2001-01-16 Thread Andy McKay
ot; [EMAIL PROTECTED] To: [EMAIL PROTECTED] Cc: "Michael Bernstein" [EMAIL PROTECTED] Sent: Tuesday, January 16, 2001 3:22 PM Subject: Re: [Zope-dev] Massive scalability Michael Bernstein wrote: So, again: Has anyone run up against any performance or other limitations regarding lar

Re: [Zope-dev] Massive scalability

2001-01-16 Thread Michael Bernstein
John Eikenberry wrote: Michael Bernstein wrote: So, again: Has anyone run up against any performance or other limitations regarding large numbers (hundreds of thousands or more) of objects stored within the ZODB either in a BTree Folder or a Rack? I was looking into the same

Re: [Zope-dev] Massive scalability

2001-01-16 Thread Michael Bernstein
Andy McKay wrote: While that would work for the simple object case, I find the prospect of storing a bunch of BLOBs (for the image data of the Photos) in an RDBMS to be *most* un-appetizing. Storing them on the server's file-system seems in-elegant as well. Okey dokey, just a

Re: [Zope-dev] Massive scalability

2001-01-16 Thread Michael Bernstein
RDM wrote: On Mon, 15 Jan 2001, Michael Bernstein wrote: as Squishdot). Adding a dependency on an RDBMS or requiring additional setup on the server's FS seems a step in the wrong direction. [...] So the question remains: Will either approach (within the ZODB) allow me to scale the

Re: [Zope-dev] Massive scalability

2001-01-16 Thread John Eikenberry
Andy McKay wrote: Does ZPatterns provide a nice interface / way for storing classes in a RDBMS? I have to say using an RDBMS is not as transparent as I would like, this may may improve it. Finally a reason for me to ZPatterns... The best way to get a taste is to try it out. The easiest way

Re: [Zope-dev] Massive scalability

2001-01-16 Thread John Eikenberry
Michael Bernstein wrote: John Eikenberry wrote: I was looking into the same issues recently, but for a much smaller set of data (5ish). In my tests ZPatterns/binary-trees scaled well for storage and retrieval. But ZCatalog did not. It was basically useless for partial matching

Re: [Zope-dev] Massive scalability

2001-01-15 Thread Andy McKay
I am currently planning two separate 'Archive' type projects/Products. In both cases, I need to make sure that my implementation will scale to hundreds of thousands or even millions of objects. I would recommend using an RDMBS behind Zope then. Its faster, simpler and I have always had

Re: [Zope-dev] Massive scalability

2001-01-15 Thread Michael Bernstein
Andy McKay wrote: I am currently planning two separate 'Archive' type projects/Products. In both cases, I need to make sure that my implementation will scale to hundreds of thousands or even millions of objects. I would recommend using an RDMBS behind Zope then. Its faster, simpler

Re: [Zope-dev] Massive scalability

2001-01-15 Thread Jimmie Houchin
I would like to echo Michael's sentiment and comments. I am at the beginning stage of Zope development of a website which will have millions of objects of a single object type and multiple of such. I currently plan on using mounted databases for the various object repositories and am currently

Re: [Zope-dev] Massive scalability

2001-01-15 Thread Michael Bernstein
Jimmie Houchin wrote: I would like to echo Michael's sentiment and comments. I am at the beginning stage of Zope development of a website which will have millions of objects of a single object type and multiple of such. are your objects intended to be indexed by ZCatalog as well, or are you

Re: [Zope-dev] Massive scalability

2001-01-14 Thread Steve Alexander
Michael Bernstein wrote: I am currently planning two separate 'Archive' type projects/Products. In both cases, I need to make sure that my implementation will scale to hundreds of thousands or even millions of objects. In one project the objects are very simple ZClasses with a few

Re: [Zope-dev] Massive scalability

2001-01-14 Thread Michael Bernstein
Steve Alexander wrote: Michael Bernstein wrote: I am currently planning two separate 'Archive' type projects/Products. In both cases, I need to make sure that my implementation will scale to hundreds of thousands or even millions of objects. In one project the objects are very