On 2/2/07, Cutter (CFRelated) <[EMAIL PROTECTED]> wrote:
> No, I have to agree that it is apples and oranges. If both servers were
> running the same PHP application, or the same ColdFusion application,
> concurrently, then you could properly call it a benchmark. Since one app
> is PHP and one app is ASP then, to me, the benchmark isn't on IIS vs
> Apache, but on PHP vs ASP (which again is apples to oranges as it's in
> two different languages on two different web servers).

Sorry, you're wrong cutter.  Part of your mistake is that this test is
/not/ comparing IIS to Apache.  That is what I was interested in
finding, but this benchmark is the closest I could find.  The question
these guys were asking was, "What is faster, ASP/IIS/Windows or
PHP/Apache/Linux?"  They put together a valid benchmark to test that
question.  They even went as far as removing the variable of the
database by testing a bunch of different databases.  All benchmarks
have problems, but a generally accepted way to compare to objects is
to put them both in an identical test scenario, where the only
variable is the object being tested.  That is what these guys did.

Here's another example from Toms Hardware:
http://www.tomshardware.com/2007/01/29/xp-vs-vista/

You guys would probably say that trying to compare Windows XP to Vista
is comparing apples to oranges.  I'll say it again.  That's exactly
the point!!  If someone wants to find out the difference between two
things, like AMD vs. Intel, or SQL Server vs. Oracle, or ColdFusion
vs. ASP, there's gotta be a way to test it right?  Its called
Benchmarking.

If you want an example of bad benchmarks, check out this site:
http://www.tpc.org/tpcc/results/tpcc_perf_results.asp
These guys test databases, but they don't remove external variables.
The top 10 list is made up of widely varied hardware systems of widely
varying strength and cost.  That is not a valid benchmark, and their
results are useless.

-- 
My Sites:
http://www.techfeed.net/blog/
http://www.cfquickdocs.com/
http://cfformprotect.riaforge.org/

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~|
Upgrade to Adobe ColdFusion MX7 
Experience Flex 2 & MX7 integration & create powerful cross-platform RIAs 
http:http://ad.doubleclick.net/clk;56760587;14748456;a?http://www.adobe.com/products/coldfusion/flex2/?sdid=LVNU

Archive: 
http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:268515
Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4

Reply via email to