Ah ok, I have little experience testing against Pachi, but obviously your scaling doesn't look good. Perhaps a bug or some fundamental knowledge that is lacking. I'd say, try to also get some data at 10^5 and make sure Pachi isn't doing any kind of pondering in the background.
I remember some years ago I had some cases where tuning with very low numbers of simulations seemed to hurt scaling performance. Don't remember all the details, but obviously if you always only run a few hundred simulation per move some aspects will not be tested well. BR, Erik On Sun, Nov 17, 2013 at 2:09 PM, Detlef Schmicker <[email protected]> wrote: > The graph seems not to displayed nice in all e-mail programs, > > here is a link > > http://physik.de/playouts.png > > > Am Sonntag, den 17.11.2013, 13:52 +0100 schrieb Detlef Schmicker: >> Sorry, >> >> as it is an logarithmic plot it looks like a limit of +150ELO. Do other >> experience simelar results. There is no significant improvenment between >> 10^3,4 and 10^4 (3000 and 10000 playouts) >> >> What might be the reason? If I do the same comparison against gnugo L10 >> it does not seem to have such an early limit (there is an improvnment >> between 3000 and 10000 playouts)?! >> >> What is the problem? Can such plots guide us to where to improve the >> program (tree vs. playout)? >> >> Something like this:) >> >> Thanks Detlef >> >> >> >> Am Sonntag, den 17.11.2013, 13:18 +0100 schrieb Erik van der Werf: >> > On Sun, Nov 17, 2013 at 8:21 AM, Detlef Schmicker <[email protected]> wrote: >> > > >> > > What is the experts guess?! >> > >> > About what? >> > >> > Maybe compare to Don's old study at >> > http://cgos.boardspace.net/study/index.html >> > >> > Best, >> > Erik >> > _______________________________________________ >> > Computer-go mailing list >> > [email protected] >> > http://dvandva.org/cgi-bin/mailman/listinfo/computer-go >> > >> >> >> _______________________________________________ >> Computer-go mailing list >> [email protected] >> http://dvandva.org/cgi-bin/mailman/listinfo/computer-go >> > > > _______________________________________________ > Computer-go mailing list > [email protected] > http://dvandva.org/cgi-bin/mailman/listinfo/computer-go _______________________________________________ Computer-go mailing list [email protected] http://dvandva.org/cgi-bin/mailman/listinfo/computer-go
