[ZODB-Dev] ZEO and relstporage performance

2009-10-13 Thread Jim Fulton
I've been working on a project to speed up ZEO. The speedup mainly involves getting ZEO to use more threads by giving each client it's own thread, and changing FileStorage to allow multiple simultaneous readers. This is especially valuable for us (ZC) for large databases (~1TB) running on multi-s

Re: [ZODB-Dev] ZEO and relstporage performance

2009-10-13 Thread Ross J. Reedstrom
Very interesting. I wonder how the postgresql version fairs? Ross On Tue, Oct 13, 2009 at 05:08:07PM -0400, Jim Fulton wrote: > I've been working on a project to speed up ZEO. The speedup mainly > involves getting ZEO to use more threads by giving each client it's > own thread, and changing Fil

Re: [ZODB-Dev] ZEO and relstporage performance

2009-10-13 Thread Laurence Rowe
Shane's earlier benchmarks show MySQL to be the fastest RelStorage backend: http://shane.willowrise.com/archives/relstorage-10-and-measurements/ Laurence 2009/10/13 Ross J. Reedstrom : > Very interesting. I wonder how the postgresql version fairs? > > Ross > > > On Tue, Oct 13, 2009 at 05:08:07PM

Re: [ZODB-Dev] ZEO and relstporage performance

2009-10-13 Thread Shane Hathaway
Jim Fulton wrote: > These benchmarks make ZEO+FS look pretty good relative to > MySQLAdapter. The overall performance assuming even moderate;y > effective ZEO pr object caches is significantly better for ZEO. This is an excellent analysis. It pointed out some rough edges in RelStorage performan

Re: [ZODB-Dev] ZEO and relstporage performance

2009-10-13 Thread Shane Hathaway
Laurence Rowe wrote: > Shane's earlier benchmarks show MySQL to be the fastest RelStorage backend: > http://shane.willowrise.com/archives/relstorage-10-and-measurements/ Yep, despite my efforts to put PostgreSQL on top. :-) It seems that PostgreSQL has more predictable performance and behavior,