Actually, such a tool for AI testing already exists: https://github.com/wesnoth/wesnoth-old/tree/master/utils/ai_test It only does 1:1 matches, but it runs the result many times to get statistically significant results. Saving replays is probably possible but not implemented, however the volume (several thousand for some of the times I've used it) makes it impractical to actually look at all of them, so it's not too important.
On Tue, Feb 11, 2014 at 4:03 PM, Lars Poetter <[email protected]> wrote: > > Hey folks! > > Hi, > > I really like Wesnoth a lot, but could not find a way to contribute, yet. > > > As you can see this will probably not be enough to be accepted in GSoC. > Maybe > > someone can add some AI related idea? What about some work on the editor > or > > the eclipse plugin? > > But as you ask for an AI Idea,.. > > With AI Development I see a big problem with testing. You will need a > lot of testing, but testing is a lot of work. A solution could be an AI > Tournament. Wesnoth already has the ability to record games. Why not use > that for AI testing. > > Assume we have several AI strategy engines. A special software (run on a > Server or locally) would do an automated tournament of these Engines. > Every engine would fight against all the Engines. In one on one matches > and in group matches. All games would be recoded. This tournament could > then be also on different Maps, different start conditions,.. > > As a result a table would be generated showing which engine wins in > which situations against which other engines. > > So an AI developer would look at the result of "his" engine and would > then check out the matches the engine lost. She could then analyze what > the biggest mistakes have been and how to change them. And the changed > Engine would then go into the next round of the Tournament. As the > Tournament is completely automatic this could be done several times a day. > > So now you have an "AI related idea" it probably wont help as I can't > really help implementing it. But you asked for Ideas,.. > > A big thank you for everybody involved for making Wesnoth such a great > game. > > Cheers, > > Lars > > _______________________________________________ > Wesnoth-dev mailing list > [email protected] > https://mail.gna.org/listinfo/wesnoth-dev >
_______________________________________________ Wesnoth-dev mailing list [email protected] https://mail.gna.org/listinfo/wesnoth-dev
