That is not the Tool I was searching for. It might become it, but it currently is not. The "structured_test=yes" mode goes into the right direction. But I think recoding the matches is essential to analyze why the AI lost.
Doing several thousand test games is a way to test if the fractions are good balanced and to test the reliability of the AI code. But that does not help with making the AI smarter. By the way is a smart AI a wanted feature? If the AI is just to help beginners get started and the really interesting matches are then Multi-player then a smart AI is not needed. If a smarter AI is a desired feature then I would suggest to add more features to this ai_test thing. -recording of the matches -matches with more than 2 players -ai against itself -several different ai in the same match To help with the analyze it would be good if some kind of evaluation of the current situation of the player would be possible. In chess you can count the number of lost figures and the area of the chess board controlled by a player. In Wesnoth the number of units and the amount of gold and probably others could be indicators that could be summed up. If the indicator works it would show if a move has increased or decreased the power of the player. So attacks that did not do much harm but killed some units should reduce the value. Killing units of the enemy or conquering enemy villages should increase the value. With such an indicator the first thing to analyze would be to look at the turns with a drop in this value. Because these moves would signal a wrong decision of the AI. So perhaps the enhancement of "ai_test" would be a interesting project for someone? Am 11.02.2014 23:47, schrieb Simon Forsyth: > Actually, such a tool for AI testing already > exists: https://github.com/wesnoth/wesnoth-old/tree/master/utils/ai_test > It only does 1:1 matches, but it runs the result many times to get > statistically significant results. Saving replays is probably possible > but not implemented, however the volume (several thousand for some of > the times I've used it) makes it impractical to actually look at all of > them, so it's not too important. > > > On Tue, Feb 11, 2014 at 4:03 PM, Lars Poetter <[email protected] > <mailto:[email protected]>> wrote: > > > Hey folks! > > Hi, > > I really like Wesnoth a lot, but could not find a way to contribute, > yet. > > > As you can see this will probably not be enough to be accepted in GSoC. > Maybe > > someone can add some AI related idea? What about some work on the > editor or > > the eclipse plugin? > > But as you ask for an AI Idea,.. > > With AI Development I see a big problem with testing. You will need a > lot of testing, but testing is a lot of work. A solution could be an AI > Tournament. Wesnoth already has the ability to record games. Why not use > that for AI testing. > > Assume we have several AI strategy engines. A special software (run on a > Server or locally) would do an automated tournament of these Engines. > Every engine would fight against all the Engines. In one on one matches > and in group matches. All games would be recoded. This tournament could > then be also on different Maps, different start conditions,.. > > As a result a table would be generated showing which engine wins in > which situations against which other engines. > > So an AI developer would look at the result of "his" engine and would > then check out the matches the engine lost. She could then analyze what > the biggest mistakes have been and how to change them. And the changed > Engine would then go into the next round of the Tournament. As the > Tournament is completely automatic this could be done several times > a day. > > So now you have an "AI related idea" it probably wont help as I can't > really help implementing it. But you asked for Ideas,.. > > A big thank you for everybody involved for making Wesnoth such a > great game. > > Cheers, > > Lars > > _______________________________________________ > Wesnoth-dev mailing list > [email protected] <mailto:[email protected]> > https://mail.gna.org/listinfo/wesnoth-dev > > > > > _______________________________________________ > Wesnoth-dev mailing list > [email protected] > https://mail.gna.org/listinfo/wesnoth-dev > _______________________________________________ Wesnoth-dev mailing list [email protected] https://mail.gna.org/listinfo/wesnoth-dev
