It seems to me that in order for an AGI to 'want' to take responsibility for a virtual pet it would need to have a sense of morality already in place. Pets seem to be a very human concept - I am not aware of any other animal that has this type of relationship. I believe you would need a high degree of social intelligence to exist before 'pet' became a meaningful concept (in human terms).
You could of course hard code the goal - maximally satisfy your pet. pet hungry -> feed it pet bored -> play with it (any action that changes the bored state to false) pet tired -> put to sleep etc, Whilst the AGI could learn a bunch of rules and procedures about how to keep a pet maximally satisfied, I don't see how this would lead to a sense of morality or even a social awareness. For me the concept of morality is grounded in the ability to understand suffering. This is a horribly fuzzy concept and is very sensitive to the specific situation at hand. Putting aside the idea of a 'universal morality' it seems that morality is a relative concept; therefore there are many possible moralities an AGI could learn. Some cultures/individuals would regard the keeping of pets as morally reprehensible. Again, certain cultures find it totally acceptable to hunt whales and dolphins whilst others take the opposite stance. Many vegetarians find it unacceptable to kill any animals for food whilst others are quite Happy to tuck into their roast lamb/beef/pork/chicken/etc. So where do you begin to teach an AGI? Maybe where you start is in fact with politics rather than morality! Tony -----Original Message----- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Philip Sutton Sent: 18 June 2004 3:24 PM To: [EMAIL PROTECTED] Subject: [agi] Learning friendliness/morality in the sand box Maybe a good way for AGIs to learn friendliness and morality, while still in the sand box, is to: - be able to form friendships - affiliations with 'others' that go beyond self-interest - vitual 'others' in the sand box - to have responsibility for caring for virtual 'pets' I guess this is part of a broader program to build AGIs' social skills. One value of targeting the these two forms of relationship is that it raises issues of how to construct the sandbox and 'who' should be in it. It also raises the issue of how to make it easy for AGIs to form these relationships and how to structure useful learning. The value that I see in having an AGI look after a virtual pet is that it gets the AGI used to recognising: - the existence of others - the needs of others - the positive things that the AGI could do for the other - then need to avoid doing damage while trying to do good etc. I could well imagine that the first virtual pet could be *very simple* - maybe simple virtual version of the Tamagotchi 'pets'. It might just be a blob with inputs, outputs and some internal processes/state requirements. So if the AGI doesn't diligently work on maintaining the inputs and handling the outputs and keeping the environmental conditions OK (eg. some arbitary factor but could be modelled on temperature or protection from rain or ...whatever.) then the pet will decline in health/happiness or could die. The AGI would need to be taught and/or given a built in empathy to help it avoid negative states for the pet. Care would need to be exercised to make sure that the AGIs don't learn or get programmed to have sharp lines of demarcation between the 'others' it should care for and the all other 'others'. (As far as I can see most of the really nasty things that people do arise when they place others into the "not to be empathised with category" ie. others are put in the instrumental object category or the enemy category.) Cheers, Philip ------- To unsubscribe, change your address, or temporarily deactivate your subscription, please go to http://v2.listbox.com/member/[EMAIL PROTECTED] ------- To unsubscribe, change your address, or temporarily deactivate your subscription, please go to http://v2.listbox.com/member/[EMAIL PROTECTED]
