RE: [computer-go] benchmark tests for static evaluation functions

2010-01-18 Thread Thomas Wolf
Thanks for the comment.

On Sun, 17 Jan 2010, David Fotland wrote:

 I think you can only evaluate static evaluation in the context of a search
 and a tournament between programs.  You could start with a simple 1-ply
 search and play against gnugo.  Strength in life and death or predicting pro
 moves doesn't correlate with the ability to win games.

I know of the limited correlation, also it depends how you test the
evaluation function. Having only limited time to work on and off on Go
I do not have a game-playing program and tested the function on its own
on professional games. Anyway, my question was whether people had published
any related tests.

Thomas

 
 David
 
 -Original Message-
 From: computer-go-boun...@computer-go.org
 [mailto:computer-go-boun...@computer-go.org] On Behalf Of Thomas Wolf
 Sent: Sunday, January 17, 2010 9:03 AM
 To: computer-go@computer-go.org
 Subject: [computer-go] benchmark tests for static evaluation functions
 
 Last year I was working on a static evaluation function.
 
 Does anyone know references about published benchmark tests for static
 evaluation functions, for example, in predicting moves in professional games
 or best moves in life and death problems or predicting the status of
 semeai problems?
 
 The published benchmarks need not be for a static evaluation function in the
 traditional sense, they could be for an opening book or a MCTS program with
 very short times available.
 
 Thanks,
 
 Thomas Wolf
 ___
 computer-go mailing list
 computer-go@computer-go.org
 http://www.computer-go.org/mailman/listinfo/computer-go/
 
 ___
 computer-go mailing list
 computer-go@computer-go.org
 http://www.computer-go.org/mailman/listinfo/computer-go/
 
___
computer-go mailing list
computer-go@computer-go.org
http://www.computer-go.org/mailman/listinfo/computer-go/


RE: [computer-go] benchmark tests for static evaluation functions

2010-01-17 Thread David Fotland
I think you can only evaluate static evaluation in the context of a search
and a tournament between programs.  You could start with a simple 1-ply
search and play against gnugo.  Strength in life and death or predicting pro
moves doesn't correlate with the ability to win games.

David

-Original Message-
From: computer-go-boun...@computer-go.org
[mailto:computer-go-boun...@computer-go.org] On Behalf Of Thomas Wolf
Sent: Sunday, January 17, 2010 9:03 AM
To: computer-go@computer-go.org
Subject: [computer-go] benchmark tests for static evaluation functions

Last year I was working on a static evaluation function.

Does anyone know references about published benchmark tests for static
evaluation functions, for example, in predicting moves in professional games
or best moves in life and death problems or predicting the status of
semeai problems?

The published benchmarks need not be for a static evaluation function in the
traditional sense, they could be for an opening book or a MCTS program with
very short times available.

Thanks,

Thomas Wolf
___
computer-go mailing list
computer-go@computer-go.org
http://www.computer-go.org/mailman/listinfo/computer-go/

___
computer-go mailing list
computer-go@computer-go.org
http://www.computer-go.org/mailman/listinfo/computer-go/