[Computer-go] A Regression test set for exploring some limitations of current MCTS programs in Go
Hi Aja, The testing program codes different problems in the same sgf file like in: loadsgf sgf/seki/case1.sgf 4 14 genmove w #? [B2|J3] loadsgf sgf/seki/case1.sgf 6 16 genmove w #? [B2] If you ignore the move numbers, j3 is not even a legal move. Unfortunately, move numbers hardly mean anything since the sgf file is not a game, but a list of stones. Each program will translate that its own way and get different move numbers, possibly alternating B,W,B,W.. or whatever. I also, don't know what the numbers 4 and 6 mean at the end of the loadsgf command. Can you please provide a list of the last moves played before the genmove so we can verify that we are all analyzing the same position? Ideally, I would prefer a simple sgf file without tricks representing the tested position, but assuming that this position is reachable by just removing the last move a number of times, I can produce the SGF file myself. I would be happy to participate in your test. Jacques. ___ Computer-go mailing list Computer-go@dvandva.org http://dvandva.org/cgi-bin/mailman/listinfo/computer-go
Re: [Computer-go] A Regression test set for exploring some limitations of current MCTS programs in Go
Hi Jacques, We will appreciate very much if you could participate in our test. In the specification of GTP, about the command 'loadsgf' it says Board size and komi are set to the values given in the sgf file. Board configuration, number of captured stones, and move history are found by replaying the game record up to the position* before move_number *or until the end if omitted. So for the command loadsgf sgf/seki/case1.sgf 4 The program should load the position of case1.sgf BEFORE move 4, not AFTER. Just today some author found a bug of gogui-adapter and kindly reported to me: gogui-adapter incorrectly loads the position AFTER move_number. Markus has already fixed the bug for us, see https://sourceforge.net/tracker/?func=detailaid=3527339group_id=59117atid=489964 If you use gogui-adapter to translate 'loadsgf' for your program, please download the newest version of gogui which is available at https://sourceforge.net/scm/?type=gitgroup_id=59117 Best regards, Aja ___ Computer-go mailing list Computer-go@dvandva.org http://dvandva.org/cgi-bin/mailman/listinfo/computer-go
Re: [Computer-go] A Regression test set for exploring some limitations of current MCTS programs in Go
By the way, to use gogui-adapter to translate 'loadsgf' the command is something like ./run.sh -p java -jar gogui-adapter.jar \PATH_TO_PROGRAM \ -t g_seki_moves.tst (use backslash character (\) to escape the quotes in the string) I used gogui-adapter to run pachi and Mogo as well because they both don't support 'loadsgf'. Please don't hesitate to let me know if it doesn't work for you. Best regards, Aja ___ Computer-go mailing list Computer-go@dvandva.org http://dvandva.org/cgi-bin/mailman/listinfo/computer-go
Re: [Computer-go] A Regression test set for exploring some limitations of current MCTS programs in Go
I used gogui-adapter too because many faces doesn't have loadsgf, but gogui doesn't send the komi, so I had to adjust it by hand. From: computer-go-boun...@dvandva.org [mailto:computer-go-boun...@dvandva.org] On Behalf Of Aja Huang Sent: Wednesday, May 16, 2012 8:53 PM To: computer-go@dvandva.org Subject: Re: [Computer-go] A Regression test set for exploring some limitations of current MCTS programs in Go By the way, to use gogui-adapter to translate 'loadsgf' the command is something like ./run.sh -p java -jar gogui-adapter.jar \PATH_TO_PROGRAM \ -t g_seki_moves.tst (use backslash character (\) to escape the quotes in the string) I used gogui-adapter to run pachi and Mogo as well because they both don't support 'loadsgf'. Please don't hesitate to let me know if it doesn't work for you. Best regards, Aja ___ Computer-go mailing list Computer-go@dvandva.org http://dvandva.org/cgi-bin/mailman/listinfo/computer-go
