On Jan 21, 2009, at 10:23 AM, Magnus Persson wrote:
Quoting Thomas Lavergne <thomas.laver...@reveurs.org>:
- the best play is a good only if played immediatly and very bad if
played later in the game :
- the first playout for this play resulted in a lost.
score and RAVE score will be very low and this play will never be
considered again until a very long time.
You raise an interesting concern.
The simple solution to your question is to add an exploration term
using UCT for example. Then it becomes an empirical question what
parameter for exploration gives the strongest play. My experience is
that the best parameter is so small it can be set to zero.
Well, empirically, when I set the exploration component to zero it
starts to play a lot worse. Like I wrote: the winning percentage drops
to 24% vs. the same program with the exploration component, which is a
huge difference.
So if you have a different experience, you must have something else
that overcomes this hurdle that's not part of a simple MCTS-RAVE
implementation. I'd be very interested to learn what that is. Sylvain
didn't take the bait ;-)
Mark
_______________________________________________
computer-go mailing list
computer-go@computer-go.org
http://www.computer-go.org/mailman/listinfo/computer-go/
