Hello, in my experiments of MoGo against Gnu-Go (in 19x19 of course), with some parameters making 65% win against GnuGo 3.6 level 8, I have 59% against GnuGo 3.7.10 level 8, and 52% against GnuGo 3.7.10 level 16. The confidence intervals are quite small as there are between 500 and 1000 games.
So between the default level (8) and the level 16, there are 7% winning difference at around 50%, which is significant, but do not change "by far" the results Hiroshi posted. It is far less than 100 ELO right? I did not measure the thinking time of GnuGo level 16, but it seems quite long, and some games (at least 1, I don't remember) never finish after a lot of hours. Perhaps it is just a bug :). So I think using GnuGo level 8 is reliable (and for experiments much faster). I could be interesting to know the results with the newest version of these commercial programs. Sylvain 2007/1/10, Chrilly <[EMAIL PROTECTED]>:
You must test with Gnu-Go level 16.. This is according to Stefan Mertin by far the best mode. But it takes sometimes quite a long time till Gnu-Go makes it move. In your experiments Gun-Go played very fast. You played fast Blitz and Gnu-Go had a big time handicap (besides Handtalk, which plays Ultra-Blitz). Chrilly ----- Original Message ----- From: "Hiroshi Yamashita" <[EMAIL PROTECTED]> To: "computer-go" <computer-go@computer-go.org> Sent: Wednesday, January 10, 2007 6:10 PM Subject: [spam probable] [computer-go] Gnugo vs commercial programs >I tested Gnugo against some commercial programs. > > Gnugo is 3.7.10. > Level is default with --never-resign and --komi 6.5 option. > Commercial program is max level. > > All game is Japanese rule and komi is 6.5. > > gnugo wins losses winning rate average score > GinseiIgo5 (KCC Igo ) 11 55 0.17 -31.3 points > Saikouhou3 (Haruka ) 13 44 0.23 -41.4 points > TuyoiIgo4 (Go4++ ) 27 54 0.33 -11.4 points > ShudanTaikyoku3 (Handtalk) 29 37 0.44 - 4.5 points > > > GinseiIgo5 ... KCC Igo, published in 2004. > Saikouhou3 ... Haruka, published in 2002. Latest version. > TuyoiIgo4 ... Go4++, published in 2003. Engine is 2002 version. > ShudanTaikyoku3 ... Handtalk, published in 1999. > > These are not latest version except Haruka. > All game records are here. > http://www.yss-aya.com/gnugo_vs_result.zip > > Average expended hours. > KCC 17m51s Gnugo 3m14s, Opteron248(2.2GHz) > Haruka 11m53s Gnugo 4m28s, Opteron248(2.2GHz) + AthlonXP 2100+( 1.73GHz) > Go4++ 4m59s Gnugo 2m18s, Opteron248(2.2GHz) > Handtalk 2m42s Gnugo 5m22s, AthlonXP 2100+(1.73GHz) > > > Appendix. > > GnuGo 3.5.4 (January, 2004 version) test result. Level is default. > > gnugo wins losses winning rate average score > ValueIgo3 (KCC Igo ) 4 26 0.13 -36.6 points > TuyoiIgo4 (Go4++ ) 11 19 0.37 -6.5 points > ShudanTaikyoku3 (Handtalk ) 12 18 0.40 -3.8 points > AI Igo2004 (ManyFaces) 18 12 0.60 +11.7 points > > ValueIgo3 ... KCC Igo, published in 2003. same GinseiIgo2PW(2001?) > AI Igo2004 ... ManyFaces, published in 2003. engine is 2003? > ------------------------------------------- > > Regards, > Hiroshi Yamashita > > _______________________________________________ > computer-go mailing list > computer-go@computer-go.org > http://www.computer-go.org/mailman/listinfo/computer-go/ _______________________________________________ computer-go mailing list computer-go@computer-go.org http://www.computer-go.org/mailman/listinfo/computer-go/
_______________________________________________ computer-go mailing list computer-go@computer-go.org http://www.computer-go.org/mailman/listinfo/computer-go/
