Jacob Munson wrote:
> 
> If you want an example of bad benchmarks, check out this site:
> http://www.tpc.org/tpcc/results/tpcc_perf_results.asp
> These guys test databases, but they don't remove external variables.

They don't test databasess. They publish a benchmarking method for 
transaction performance and publish claims of vendors.


> The top 10 list is made up of widely varied hardware systems of widely
> varying strength and cost.  That is not a valid benchmark, and their
> results are useless.

It is a very valid benchmark. Especially considering that most 
mainframes are a package deal of both hardware and software. You just 
have to be careful to draw the right conclusions from it and usually 
those conclusions are not about databases :)

But if you run it on identical hardware you can even use it to benchmark 
databases. For instance, several of the TPC benchmarks are used to test 
specific patches to PostgreSQL before they are applied.

Jochem

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~|
Upgrade to Adobe ColdFusion MX7 
Experience Flex 2 & MX7 integration & create powerful cross-platform RIAs 
http:http://ad.doubleclick.net/clk;56760587;14748456;a?http://www.adobe.com/products/coldfusion/flex2/?sdid=LVNU

Archive: 
http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:268522
Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm
Unsubscribe: 
http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4

Reply via email to