Re: Re[2]: [agi] Unlimited intelligence. --- Super Goals

[deering]

Dennis, I suspect than much of our disagreement is a matter of faulty communication.  If you don't know what I mean by "top level rule" I have a lot of explaining to do.  To make things more clear let me take a concrete example of an intelligent system, a human being, but the same would apply to and AGI.   Description of a human being - human beings sense multi-channel data input from the external environment, process data using a variety of methods, and produce behaviors as an output to the system.   In the interest of brevity, let sex drive, hunger and thirst, and pain/pleasure be the reinforcers in the example, with the understanding that there are more but they would work the same way, and just take longer to explain.     In the example, a human is sitting at his computer at 2 AM after having worked all day.  His wife is already in bed.  There is food and drink in the frig.  He considers a list of possible behaviors:   OPTION 1: go have sex with his wife. OPTION 2: go to frig and get something to eat/drink. OPTION 3: go to sleep so he can get up tomorrow and go to work. OPTION 4: stay on the computer explaining some esoteric point of intelligent systems to a complete stranger.   Weighting the reinforcement value of each option:   OPTION 1: 10. OPTION 2:  7. OPTION 3:  5. OPTION 4:  0.   Next we list the rules used to choose which option is executed.    Supergoals: (in no particular order)   SUPERGOAL 1:  take actions which will aid the advancement of intelligence in the universe. SUPERGOAL 2:  take actions which will aid in the continued survival and advancement of me. SUPERGOAL 3:  do not take actions which will harm others.   All supergoals are equal in value.  Not all supergoals are applicable to all situations or decisions.  Subgoals are created, edited, or deleted to support supergoals.  Supergoals take precedence over subgoals.  Subgoals are more specific than supergoals and therefore more commonly directly applicable to situations or decisions.   Subgoals: (in no particular order)   SUBGOAL 1:  satisfy bodily needs, sex, food, sleep. SUBGOAL 2:  make money. SUBGOAL 3:  wear seatbelt in car. SUBGOAL 4:  build websites explaining the coming Singularity. SUBGOAL 5:  play with and read to son. SUBGOAL 6:  annoy Eliezer. SUBGOAL 7:  learn about nanotechnology. SUBGOAL 8:  do household chores. SUBGOAL 9:  use proper grammar and spelling.     The subject chooses option 4 because it satisfies supergoal 1, which takes precedence over all subgoals despite producing no reinforcement.       Mike Deering, General Editor, http://nano-catalog.com/   Director, http://www.singularityawareness.com/ Email: deering9 at mchsi dot com To unsubscribe, change your address, or temporarily deactivate your subscription, please go to http://v2.listbox.com/member/[EMAIL PROTECTED]