It seems to me that in order for an AGI to 'want' to take responsibility for
a virtual pet it would need to have a sense of morality already in place.
Pets seem to be a very human concept - I am not aware of any other animal
that has this type of relationship. I believe you would need a high degree
of social intelligence to exist before 'pet' became a meaningful concept (in
human terms).

You could of course hard code the goal - maximally satisfy your pet.

pet hungry -> feed it
pet bored -> play with it (any action that changes the bored state to false)
pet tired -> put to sleep

etc,

Whilst the AGI could learn a bunch of rules and procedures about how to keep
a pet maximally satisfied, I don't see how this would lead to a sense of
morality or even a social awareness. 

For me the concept of morality is grounded in the ability to understand
suffering. This is a horribly fuzzy concept and is very sensitive to the
specific situation at hand. 

Putting aside the idea of a 'universal morality' it seems that morality is a
relative concept; therefore there are many possible moralities an AGI could
learn. 

Some cultures/individuals would regard the keeping of pets as morally
reprehensible. Again, certain cultures find it totally acceptable to hunt
whales and dolphins whilst others take the opposite stance. Many vegetarians
find it unacceptable to kill any animals for food whilst others are quite
Happy to tuck into their roast lamb/beef/pork/chicken/etc.

So where do you begin to teach an AGI?

Maybe where you start is in fact with politics rather than morality!

Tony

-----Original Message-----
From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf
Of Philip Sutton
Sent: 18 June 2004 3:24 PM
To: [EMAIL PROTECTED]
Subject: [agi] Learning friendliness/morality in the sand box

Maybe a good way for AGIs to learn friendliness and morality, while still 
in the sand box, is to:

-   be able to form friendships - affiliations with 'others' that go
    beyond self-interest - vitual 'others' in the sand box

-   to have responsibility for caring for virtual 'pets'

I guess this is part of a broader program to build AGIs' social skills. 

One value of targeting the these two forms of relationship is that it 
raises issues of how to construct the sandbox and 'who' should be in it.  
It also raises the issue of how to make it easy for AGIs to form these 
relationships and how to structure useful learning.

The value that I see in having an AGI look after a virtual pet is that it 
gets the AGI used to recognising:

- the existence of others

- the needs of others

- the positive things that the AGI could do for the other

- then need to avoid doing damage while trying to do good

etc.

I could well imagine that the first virtual pet could be *very simple* - 
maybe simple virtual version of the Tamagotchi 'pets'.  It might just be 
a blob with inputs, outputs and some internal processes/state 
requirements.  So if the AGI doesn't diligently work on maintaining the 
inputs and handling the outputs and keeping the environmental 
conditions OK (eg. some arbitary factor but could be modelled on 
temperature or protection from rain or ...whatever.) then the pet will 
decline in health/happiness or could die. 

The AGI would need to be taught and/or given a built in empathy to 
help it avoid negative states for the pet.

Care would need to be exercised to make sure that the AGIs don't learn 
or get programmed to have sharp lines of demarcation between the 
'others' it should care for and the all other 'others'.

(As far as I can see most of the really nasty things that people do arise 
when they place others into the "not to be empathised with category" ie. 
others are put in the instrumental object category or the enemy 
category.)

Cheers, Philip

-------
To unsubscribe, change your address, or temporarily deactivate your
subscription, 
please go to http://v2.listbox.com/member/[EMAIL PROTECTED]


-------
To unsubscribe, change your address, or temporarily deactivate your subscription, 
please go to http://v2.listbox.com/member/[EMAIL PROTECTED]

Reply via email to