I wish I could say what we're doing, but I know potential competitors are
listening and these lists are public. I can discuss privately if you would
like to know more. You're close with the NSA stuff, although on a much
smaller and public scale.
Today, alone, we've processed 15M TX in about 2 hours (2080tps), using a
single MySQL server (not TTW), and MySQL just yawns. In our experience,
only MySQL and Oracle are capable of doing this (and Oracle only in versions
9 and above). This is also why I ask so many RDBMS questions on this list.
I do think we will need multiple instances. I would like to use Zope and
perhaps replace Gadfly with MySQL. Has anyone done this in Zope 3? If so,
how? I would estimate based upon my preliminary tests that Zope with ZODB
can handle about 300/tps on our hardware.
The versioning feature of Zope alone would blow our clients away.
> -----Original Message-----
> From: Jim Fulton [mailto:[EMAIL PROTECTED]
> Sent: Friday, January 20, 2006 6:23 AM
> To: David Johnson
> Cc: 'Andreas Jung'; email@example.com
> Subject: Re: [Zope3-Users] Zope 3 Capacities
> David Johnson wrote:
> > We're looking at 10-100 billion tx per year stored and performed.
> > Partly I'm trying to gauge where the dividing line is between using the
> > and not, and also estimate how many server instances should be running.
> I'm not sure any transactional database will handle that sort of rate with
> a single database. We did some tests 2 years ago and with commodity
> hardware, we were able to commit around 50 simple transactions per second
> to a file storage over ZEO. This is about 60 times slower than you need,
> 100 billion tx per year or about 3000 tps. I imagine you could do
> somewhat better
> than that if you got beefier hardware.
> A *quick* google on transaction rates yielded a fairly old article:
> At that time, most of the databases tested on Unix did less that 100 tps.
> Many of them much less. Of course that was a long time ago.
> Does anyone know of more recent data?
> Of course, if you can segregate your data, you can get higher
> transaction rates by employing multiple database servers, ZODB
> or otherwise. I've faily confident that this is what you'll
> need to do.
> Jim Fulton mailto:[EMAIL PROTECTED] Python Powered!
> CTO (540) 361-1714 http://www.python.org
> Zope Corporation http://www.zope.com http://www.zope.org
Zope3-users mailing list