Good idea, if I could propose a few more specific parameters :
A) XML:DB tests --------------- 1* access times for adding documents graphed against total resource count 2* access times for deleting documents graphed against total resource count 3* access times for updating documents graphed against total resource count
B) XML:DB:XPATH tests
------------------------
1* access times for querying documents graphed against total resource count
-for single document match
-for multiple document match
2* perform more and more general query to find the maximum ResourceSet size which can be managed
C) Stress & Robustness tests
--------------------------
1* repeatedly add a single smallish document with different id to get max resource count possible
2* update a single document repeatedly, while increasing it's size, to get max single resource size
If anyones interested, it might be an idea to start up a separate project either under XML:DB or on something like Sourceforge to provide
a decent set of tests/benchmarks for all these various XML db's.
Send me a mail directly if you're interested, and if there's enough people, I'll put the framework together.
Cheers. Steve
Terence Kearns wrote:
maybe we should make a list of items that should be in the comparrison list?
* access times for adding documents
* return times for result sets
* data extraction times
* memory footprint and recovery (leaks)
* capacity -- how many resource per collection, how many collection before instability under a cirtain amount of load...
there are lots of variables and factors. it will be difficult to produce a list of benchmark parameters.
