Re: [SPAM] Re: [SPAM] [computer-go] Paper about Mogo's Opening Strategy

2010-01-17 Thread Olivier Teytaud
 I'm sure many people are curious - MoGo(TW?) doesn't participate much
 in computer tournaments nowadays, are you working on some new exciting
 things or is the project mostly asleep right now? :-)

Competitions are very boring and time consuming. Other people from the mogo-team
can participate in tournaments if they want to, but for me I prefer to
work on improvements, and in particular I prefer to try big changes
(which fail 97% of the time) than small changes which provide
negligible improvements. When there are computations every 2 months,
the small improvements often take all the place.

There are works in progress around MoGo:
- We'd like to have an almost solving of 9x9 Go, by working in
particular on a huge
   opening book. Nonetheless, there's still a lot of work on that. For
example, MoGoTW
   can play very stupid move if the opponent makes a stupid opening
move, and
   removing this would be great.

- As many people, we would really like to have learning from one
branch of the tree
   to another. We have some things which provide a few percents improvements,
   but we are a bit tired of this kind of small improvements, and
I'd like a big
   change.

- Also, we have many applications in progress in other fields, from
classical artificial
   intelligence tasks (like expensive optimization or active learning)
or for completely
   industrial tasks (like my favorite application, namely power management)

- We also try to automatize the building and validation of patterns or
UCT formula -
something which is important far beyond Go. However, for Go, this
is clearly not
very important - mogo and all strong programs are by far too optimized for
improving a lot by empirical tuning. For partially observable
games, things are very
different I think - as pointed out in some nice papers tuning
becomes the main
thing in very difficult frameworks like partially observable
games, making them
quite interesting as a benchmark.

I guess some of these goals are shared by many people in this mailing
list, so I'm
sorry for this long email with probably nothing very original in it :-)
___
computer-go mailing list
computer-go@computer-go.org
http://www.computer-go.org/mailman/listinfo/computer-go/


Re: [SPAM] Re: [SPAM] [computer-go] Paper about Mogo's Opening Strategy

2010-01-17 Thread Petr Baudis
  Hi!

On Sun, Jan 17, 2010 at 04:02:38PM +0100, Olivier Teytaud wrote:
  I'm sure many people are curious - MoGo(TW?) doesn't participate much
  in computer tournaments nowadays, are you working on some new exciting
  things or is the project mostly asleep right now? :-)
 
 Competitions are very boring and time consuming. Other people from the 
 mogo-team
 can participate in tournaments if they want to, but for me I prefer to
 work on improvements, and in particular I prefer to try big changes
 (which fail 97% of the time) than small changes which provide
 negligible improvements. When there are computations every 2 months,
 the small improvements often take all the place.

  I understand this sentiment a bit. :) I've found that when working on
big new things, the required infrastructure changes bring improvements
even to the original engine, but that's probably only true in very
modular designs and for young programs like mine, not very evolved ones
like Mogo. But looking backwards, I also wish I'd spend less time
fine-tuning playout strategies etc. and focus on more fundamental changes.

 - As many people, we would really like to have learning from one
 branch of the tree
to another. We have some things which provide a few percents improvements,
but we are a bit tired of this kind of small improvements, and
 I'd like a big
change.

  Yes, I'm personally convinced that solving this really well will lead
to the next big advance in Computer Go. I'm working hard on this problem
as well. ;-)

 - Also, we have many applications in progress in other fields, from
 classical artificial
intelligence tasks (like expensive optimization or active learning)
 or for completely
industrial tasks (like my favorite application, namely power management)

  This is very interesting, do you have pointers to any papers or
presentations concerning MCTS applications like this in any detail?
If not yet, I'm sure many people on this list will be interested
to hear about any publications in this area too when you finish some
of the applications.

  Thanks,

Petr Pasky Baudis
___
computer-go mailing list
computer-go@computer-go.org
http://www.computer-go.org/mailman/listinfo/computer-go/


Re: [SPAM] Re: [SPAM] Re: [SPAM] [computer-go] Paper about Mogo's Opening Strategy

2010-01-17 Thread Olivier Teytaud

   This is very interesting, do you have pointers to any papers or
 presentations concerning MCTS applications like this in any detail?
 If not yet, I'm sure many people on this list will be interested
 to hear about any publications in this area too when you finish some
 of the applications.


1) Application to fundamental AI tasks:

Application to noisy non-linear optimization (Algorithmica 2009):
 http://hal.inria.fr/inria-00369788 (personnally, this
work convinced
 me that UCT was really a great algorithm - for noisy
applications,
 UCT really brings an improvement over many forms of
MCTS, and
 as I've spent a long time trying to solve the same
thing with
 other tools without success, I've been very surprised
of succeeding
 at the first trial with UCT)

Application to non-linear optimization:
http://hal.inria.fr/inria-00374910/fr/

Application to active learning (ECML 2009)
http://hal.inria.fr/inria-00433866

2) Benchmarks on problems not too far from industry:
   - Guillaume Chaslot et al published something around stock management
   - Martin Müller et al published something around planning

3) Directly real-world or industrial applications
Application to library tuning (ICML 2009)
http://hal.inria.fr/inria-00379523/

The application to energy management is a big concern to me - it's in
progress. These problems have a huge ecological and economical importance,
it would really be great if computer-Go had an impact on this, and the
specificities of the problem are perfect - withing the partially observable
nature of the problem :-)
___
computer-go mailing list
computer-go@computer-go.org
http://www.computer-go.org/mailman/listinfo/computer-go/