Re: [agi] Unlimited intelligence. --- Super Goals

[deering]

Yes, we have instincts, drives built into our systems at a hardware level, beyond the ability to reprogram through merely a software upgrade.  These drives, sex, pain/pleasure, food, air, security, social status, self-actualization, are not supergoals, they are reinforcers.   Reinforcers give you positive or negative feelings when they are encountered.    Supergoals are the top level of rules you use to determine a choice of behavior.   You can make reinforcers your supergoals, which is what animals do because their contextual understanding, and reasoning ability is so limited.  People have a choice.  You don't have to be a slave to the biologically programmed drives you were born with.  You can perceive a broader context where you are not the center of the universe.  You can even imagine redesigning your hardware and software to become something completely different with no vestige of your human reinforcers.    Can a system choose to change its supergoal, or supergoals?  Obviously not, unless some method of supergoal change is specifically written into the supergoals.  People's supergoals change as they mature but this is not a voluntary process.  Systems can be designed to have some sensitivity to the external environment for supergoal modification.  Certainly systems with immutable supergoals are more stable, but stability isn't always desirable or even safe.     To unsubscribe, change your address, or temporarily deactivate your subscription, please go to http://v2.listbox.com/member/[EMAIL PROTECTED]