Re: [agi] Emergent ethics via training - eg. game playing

[cosmodelia]

Eliezer S. Yudkowsky wrote: "I think I caught a glimpse of what non-evolutionary morality would be like. And what our world looks like from there. It's... really very, very, very sad. I don't think AGIs should play competitive games."   Agree. I think Myst, Riven, Exile [ http://www.cyan.com/links.ssi ] would be a better training for an AGI than Sim City, Civilization 3, Alpha Centauri and Black & White, or any competitive and/or combative game.   These games of Myst series are first-person perspective games where your character is not identified in any way. The individual components; the graphics, animations, sound effects, music, story and puzzles all combine to make 'the whole' a training experience. First of all, you have to learn about the way these games work, understanding how they work and what they do is crucial if you are to make any progress in this game. In fact the game, to some extent, forces you into leisurely exploration as there are few immediate solutions to problems. Sure you can push that lever, but it may be some time before you become aware of what effect it has had. The more complex problems require you to visit many locations, observe certain actions and learn and understand how the small pieces of information you gather integrate into the scheme of things. You may need to learn about the D'ni numbering system. The clues are all there in what you see (and hear) around you, it's up to you to make the connections. And you must have a ethics to arrive to the *right* end. During the game you have to go ahead and to experiment, it is a very good exercise for your imagination. What could an AGI imagine if it learns "the D'ni Art" of linking books?   "Uru: Online Ages Beyond MYST", would have a additional value: in this forthcoming online adventure an AGI would be able to play with humans and alaso a Baby-AGI would have "the opportunity to explore and interact with meticulously crafted environments. Uru is designed to appeal to a broad audience and enable players of all skill levels and interests to experience expansive ages of the Myst universe in a uniquely social environment. Playing their own avatars, hundreds of thousands of players will meet new people, all realistic impersonations of themselves, play games, solve mysteries and embark on a voyage of discovery with friends. Players will be able to customize their level of interaction with other players, choosing to play alone, with small groups of friends or in areas where they can meet new people."    Full at: http://www.ubi.com/US/Articles/news_01-08-2003.htm   cosmodelia www.mp3.com.au/cosmodelia