Edward, We usually associate playing strength directly with the software, but it's clear that this is not really correct. We have to consider the whole game playing system, the machine or machines it runs on as well as the software. CGOS doesn't really distinguish this.
To truly evaluation software you have to run on the same platform but this is not practical either for things like CGOS, although tournaments can be organized around this idea. It was painfully obvious in chess. Even from the early day of computer chess then well funded companies would come to big tournaments with big hardware. I remember the "fidelity" machines. They were never the machines you could buy at stores but often were "thick" because they had cooling gadgets so that they could run seriously over-clocked. When such a gadget won a tournament, it was never advertised what it run on. The ad would say something like "The program that won the microcomputer chess championship can be yours!" - Don Edward de Grijs wrote: > > > > Nobody really believes ratings are 100% "right on the money" accurate. > > > > But it's silly not to use the most correct method possible. Ratings > > are "a very useful approximation to reality" and you might as well get > > as close to that reality as you can. > > > > > > - Don > > But then we have to take the amount of computing power > (nr of cpu and speed of cpu's) into account. > This has a major influence on UCT/MC programs. > Otherwise we only test the package of progam+computer together > and not the progam alone. > Speed differences of more then 10 exists in the rating pool... > > --Edward > > > > > > ------------------------------------------------------------------------ > Windows Live Mail: Nu 2gb aan opslag - dat zijn maar liefst 1000 > foto's - en nog steeds gratis! Windows Live Mail > <http://imagine-windowslive.com/mail/launch/default.aspx?Locale=nl-nl%29> > ------------------------------------------------------------------------ > > _______________________________________________ > computer-go mailing list > [email protected] > http://www.computer-go.org/mailman/listinfo/computer-go/ _______________________________________________ computer-go mailing list [email protected] http://www.computer-go.org/mailman/listinfo/computer-go/
