Here's my quick take after a cursory glance through the results. This test suite was clearly designed around the strengths of ObjectDB. The factor of six between the 'ObjectDB server' and 'Hibernate with PostgreSQL server' performance is just not credible otherwise.
Once you get past that, there is an even more troubling claim that no combination of OpenJPA with any database passed all 58 tests. It is not clear whether this is a bug in their tests or in OpenJPA, but that would seem to be worth examining. There are two tests which are reported as failing across all databases: * Multithreading Test - Query Operations - Few Entities (5/100) * Multithreading Test - Query Operations - Many Entities (5000) It might be worth while to look at one or both of these first. -=- Jerry On Nov 2, 2010, at 9:50 AM, Kevin Sutter [via OpenJPA] wrote: > Although this "benchmark" is obviously biased, it's still good to be > reminded of potential pitfalls and/or inconsistencies. For example, I took > a quick look at one set of results and it seems to indicate a repeating > issue with obtaining a primary key sequence from the OpenJPA sequence > table. This could be a problem with the application, or it could be a > problem with the OpenJPA processing. Digging in a bit on these type of > issues would probably be worthwhile. > > But, spending a lot of time attempting to match the results of ObjectDB is > probably not that interesting... > > Kevin > > On Tue, Nov 2, 2010 at 7:58 AM, Georgi Naplatanov <[hidden email]> wrote: > > > Hi gkorland. > > > > Do not trust on this tests. It is better to make your own test and then > > decide which implementation is good for you. > > > > My testing indicates that OpenJPA (with or without cache) is faster than > > Hibernate on mostly write and less read operations. > > > > On read operation probably all JPA implementation are very close due the > > cache. > > > > Best regards > > Georgi > > > > > > gkorland wrote: > > > >> Did anyone review the JPAB (http://www.jpab.org/) results? It seems like > >> all the other JPA guys are running faster and even better... > >> > > > > > > > View message @ > http://openjpa.208410.n2.nabble.com/JPAB-results-tp5693298p5697322.html > To start a new topic under OpenJPA Users, email > [email protected] > To unsubscribe from OpenJPA Users, click here. > -- View this message in context: http://openjpa.208410.n2.nabble.com/JPAB-results-tp5693298p5697524.html Sent from the OpenJPA Users mailing list archive at Nabble.com.
