Hello!
Play-testing your Go engine (e.g. measuring performance against GNUGo)
has never been easier! ;-) For purposes of Pachi testing, I have finally
got fed with manual twogtp invocations on many machines, and wrote a set
of (mostly) fairly simple shell scripts that will automatically schedule
specified pairings and show current results in a nice way - "Autotest":
http://repo.or.cz/w/pachi.git/tree/HEAD:/t-play/autotest
(you can click on the tar.gz link in the header to get the tree, extract
it from Pachi's git clone or examine it over the web). The framework is
developed as part of the Pachi tree, but don't worry - it is completely
independent and basically unrelated to the rest of Pachi!
It is geared to UNIX (Linux, MacOSX) systems and designed to allow
automatic scheduling of test matches between specified GTP players, on
many networked machines (sharing a filesystem) - e.g. if you have shell
access to 10 computers, you can start clients on all of them and leave
the system to automatically schedule and play games - you can just
keep examining match results or update the pairings on the fly.
However, you may find this useful even on individual machines, just
start one client per core and reap the same benefits.
Example output from autotest:
$ ./autotest-gather ; ./autotest-show
S GAMES WINRATE S.D. PAIRING
. 580 0.314 0.019 19-7.5-a-gnugo10-zamafmoggy5k-a9413
. 591 0.347 0.02 19-7.5-a-gnugo10-zamafmoggy5k-a9413-ltree=1
/ 226 0.23 0.028
19-7.5-a-gnugo10-zamafmoggy5k-a9413-ltree=1,ltree_prate=100
/ 190 0 0
19-7.5-a-gnugo10-zamafmoggy5k-a9413-ltree=1,ltree_prate=100,local_tree_pseqroot
. 458 0.338 0.022
19-7.5-a-gnugo10-zamafmoggy5k-a9413-ltree=1,ltree_prate=25
. 562 0.324 0.02
19-7.5-a-gnugo10-zamafmoggy5k-a9413-ltree=1,ltree_prate=50
. 450 0.331 0.022
19-7.5-a-gnugo10-zamafmoggy5k-a9413-ltree=1,ltree_prate=75
. 208 0.678 0.032 9-0.5-1-gnugo10-zamafmoggy5k-6e3cb
. 570 0.639 0.02 9-0.5-1-gnugo10-zamafmoggy5k-a9413
. 595 0.682 0.019 9-0.5-1-gnugo10-zamafmoggy5k-a9413-topsecrethack=15
/ 243 0.605 0.031 9-0.5-1-gnugo10-zamafmoggy5k-a9413-xyzzy
The framework is released under the MIT licence, thus essentially
in public domain. You can get details about the usage and
implementation in
http://repo.or.cz/w/pachi.git/blob/HEAD:/t-play/autotest/README
and an example configuration file:
http://repo.or.cz/w/pachi.git/blob/HEAD:/t-play/autotest/rc
Have fun,
Petr "Pasky" Baudis
_______________________________________________
computer-go mailing list
[email protected]
http://www.computer-go.org/mailman/listinfo/computer-go/
