Hi, I want to get more people interested into this scaling, therefore I did also some scaling tests fuego against pachi :)
It is not as bad as oakfoam against pachi, but pachi scales a lot better than fuego too. (attached file) To avoid additional complications I set the number of playouts to the same value for both opponents. ELO is again as defined in CGOS from winning rate. I used: Pachi version 10.00 (Satsugen) fuego 1.1 (does not show a more detailed version) with following configuration opponent_program2='/home/detlef/fuego-1.1/fuegomain/fuego' opponent_settings2='uct_param_player ignore_clock 1\nuct_param_player max_games '+str(playouts)+'\nuct_param_player resign_min_games 5000 \nuct_param_search number_threads 8\nuct_max_memory 8000000000 \nuct_param_player reuse_subtree 1' opponent_program3='/home/detlef/pachi/pachi -d 0 -t ='+str(playouts)+' -r chinese threads=8,max_tree_size=2048,pondering=0,pass_all_alive ' opponent_settings3='' taken from a CLOP like python file. For oakfoam I tried to optimize a number of parameters which I thought are relevant to scaling (progressive widening, ucb_c weighting of random moves in playouts), but none of them was as relevant as I thought :( I hope I did not understand the playout number parameters wrong in pachi and fuego. To me it seems there is a lot of potential in scaling, not only for oakfoam... I read fuego and pachi mailing list too, if it is not of too much interest here, we might change the mailing list:) Detlef Am Samstag, den 23.11.2013, 11:32 +0100 schrieb Detlef Schmicker: > Just to let you know: > > I did a comparison of the playings strength vs. playouts. > > This time I used 4 times the oakfoam playouts for pachi > (eg. 1000 for oakfoam 4000 for pachi) > > The graph shows how bad we become (in comparison) with more playouts:(. > >From the games the first impression is, that the joseki becomes worse > with more playouts e.g. > > http://www.physik.de/playouts2.pdf > The plot is 1050 games fitted with a 5th order polynome. The borders of > the plot are not statistical significant! > > Thanks for every hint :) > > Detlef > > > Am Montag, den 18.11.2013, 22:45 +0100 schrieb Detlef Schmicker: > > Am Montag, den 18.11.2013, 21:11 +0100 schrieb Petr Baudis: > > > On Sun, Nov 17, 2013 at 03:11:22PM +0100, Erik van der Werf wrote: > > > > make sure Pachi isn't doing any kind of pondering in the > > > > background. > > > > > > Indeed, Pachi will ponder by default. Turn pondering off by passing > > > > > > pondering=0 > > > > > > on the commandline. > > > > Thanks a lot for the hint!!! From the command line documentation I > > thought pondering is off by default.and I did not check it:( > > > > > > > > > > > pachi -d 0 -t =4000 -r chinese threads=1,max_tree_size=2048 > > > > > > Also, it may be worth passing pass_all_alive unless you are doing a > > > sophisticated scoring procedure, to make sure Pachi captures all dead > > > groups at the end of the game. > > > > > > P.S.: Do your results imply that on 4000 playouts/move, oakfoam is > > > quite stronger than Pachi now? I'd love to hear more. :) How does the > > > playout speed compare? > > > > Yes, we play even with 1000 against this settings. But I did not take > > pondering into account, as I thought it is turned off. Therefore I do > > not know if pachi really played 4000 playouts, as I thought. > > > > We have a little less than 1000 playouts/core/second. And my main aim is > > to get the iPad version strong, therefore the strength with lower > > playouts is more important to me. > > > > I did not optimize parameter against pachi alown, I started running clop > > with three opponents gnugo level 10, pachi with this setting and > > > > /home/detlef/fuego-1.1/fuegomain/fuego > > > > with setting > > uct_param_player ignore_clock 1 > > uct_param_player max_games 3000 > > uct_param_player resign_min_games 5000 > > uct_max_memory 300000000 > > > > All 4 programs have comparable strenght than. > > > > Always happy to share any idea:) > > > > Detlef > > > > > > > > > > > > > _______________________________________________ > > Computer-go mailing list > > [email protected] > > http://dvandva.org/cgi-bin/mailman/listinfo/computer-go > > > > > _______________________________________________ > Computer-go mailing list > [email protected] > http://dvandva.org/cgi-bin/mailman/listinfo/computer-go >
playouts_oakfoam_fuego_pachi.pdf
Description: Adobe PDF document
_______________________________________________ Computer-go mailing list [email protected] http://dvandva.org/cgi-bin/mailman/listinfo/computer-go
