Re: [Zope3-Users] Zope 3 Capacities
On 1/20/06, Andreas Jung [EMAIL PROTECTED] wrote: It's even worser (due to a calculation error): 10 billion would mean 310 tx/second but 100 billion would mean 3100 tx/second...you should look for something _bigger_. 3100 WRITE transactions per second? 3100 changed or added objects per second? Yes, I want to know what kind of web app creates that amount of data too. ;) -- Lennart Regebro, Nuxeo http://www.nuxeo.com/ CPS Content Management http://www.cps-project.org/ ___ Zope3-users mailing list Zope3-users@zope.org http://mail.zope.org/mailman/listinfo/zope3-users
Re: [Zope3-Users] Zope 3 Capacities
--On 20. Januar 2006 10:52:05 +0100 Lennart Regebro [EMAIL PROTECTED] wrote: On 1/20/06, Andreas Jung [EMAIL PROTECTED] wrote: It's even worser (due to a calculation error): 10 billion would mean 310 tx/second but 100 billion would mean 3100 tx/second...you should look for something _bigger_. 3100 WRITE transactions per second? 3100 changed or added objects per second? Yes, I want to know what kind of web app creates that amount of data too. ;) Perhaps the new NSA-we-collect-all-your-data database? -aj pgpncvsSeLr0e.pgp Description: PGP signature ___ Zope3-users mailing list Zope3-users@zope.org http://mail.zope.org/mailman/listinfo/zope3-users
Re: [Zope3-Users] Zope 3 Capacities
David Johnson wrote: We're looking at 10-100 billion tx per year stored and performed. Partly I'm trying to gauge where the dividing line is between using the ZODB and not, and also estimate how many server instances should be running. I'm not sure any transactional database will handle that sort of rate with a single database. We did some tests 2 years ago and with commodity hardware, we were able to commit around 50 simple transactions per second (tps) to a file storage over ZEO. This is about 60 times slower than you need, assuming 100 billion tx per year or about 3000 tps. I imagine you could do somewhat better than that if you got beefier hardware. A *quick* google on transaction rates yielded a fairly old article: http://www.wintercorp.com/rwintercolumns/ie_9903.html At that time, most of the databases tested on Unix did less that 100 tps. Many of them much less. Of course that was a long time ago. Does anyone know of more recent data? Of course, if you can segregate your data, you can get higher transaction rates by employing multiple database servers, ZODB or otherwise. I've faily confident that this is what you'll need to do. Jim -- Jim Fulton mailto:[EMAIL PROTECTED] Python Powered! CTO (540) 361-1714http://www.python.org Zope Corporation http://www.zope.com http://www.zope.org ___ Zope3-users mailing list Zope3-users@zope.org http://mail.zope.org/mailman/listinfo/zope3-users
[Zope3-Users] Zope 3 Capacities
Im trying to scope out Zope 3s capacities. Does anyone have a large ZODB? How big is it (in terms of objects)? Any performance issues? Does anyone have a very high volume site? What kind of volume with what kind of degree of application logic? What architectural things have affected performance? I general were looking at using an RDBMS, but were trying to get a better feeling of when we can use the ZODB and when we should stick to the RDBMS. I like the ZODB because of its versioning information in particular. We have various datasets: Transactions: 10-100 billion objects Users: 10-100 million objects Contacts: 100,000 objects Customers: 100-1000 objects -- David Johnson [EMAIL PROTECTED] 201 Main Street Suite 1320 Fort Worth, TX 76102 (877) 572-8324 x2200 ___ Zope3-users mailing list Zope3-users@zope.org http://mail.zope.org/mailman/listinfo/zope3-users
Re: [Zope3-Users] Zope 3 Capacities
On 1/19/06, David Johnson [EMAIL PROTECTED] wrote: I'm trying to scope out Zope 3's capacities. A quick note: In the things you mention, Zope 2 and Zope 3 are similar, as they both use the same ZODB. So answers to your question could equally be done with Zope 2 example. And I personally do not have a high volume site, but such sites has been installed. The people who did that gets to answer on how big they were. :) The bottleneck with ZODB tends to be writing transactions, while just reading transactions is handled with much greater ease, so that's the most critical data in tis type of evaluations, I would guess. -- Lennart Regebro, Nuxeo http://www.nuxeo.com/ CPS Content Management http://www.cps-project.org/ ___ Zope3-users mailing list Zope3-users@zope.org http://mail.zope.org/mailman/listinfo/zope3-users
