Hi Ben, > For example, consider the two scenarios where AGI's are developed by > a) the US Army > b) Sony's toy division > > In the one case, AGI's are introduced to the world as super-soldiers (or > super virtual fighter pilots, super strategy analyzers,etc.); in the other > case, as robot companions for their children... > > .... the nature of the socialization the AGI gets will be quite different > in case b from case a.
The Sony option is starting to look good! :) Better in fact than working as the manager of the computer players in most advanced computer games since so many of these games are no more peaceful than the US Army! If AGIs get involved in running aspects of computer games, my feeling is the that the games they contribute to would have to be chosen *very* carefully - unless AGIs have a brilliant capacity to stop the work they do from significantly reshaping their ethics. Maybe instilling this capacity is one essential general element in the implementation of friendliness regardless of what work they do. The implementation of this capacity might need to be quite subtle since AGIs would need to be able to learn and refine their ethics in the light of experience and yet certain types of work that violate their ethics shouldn't result in the emergence of unfriendliness. (I think some AGIs will be able to get work as ethics counsellors to their AGI colleagues! In fact it could be a growth industry.) Cheers, Philip ------- To unsubscribe, change your address, or temporarily deactivate your subscription, please go to http://v2.listbox.com/member/[EMAIL PROTECTED]
