Actually, Eliezer said he had two points about AIXItl: 1) that it could be "broken" in the sense he's described
2) that it was intrinsically un-Friendly So far he has only made point 1), and has not gotten to point 2) !!! As for a general point about the teachability of Friendliness, I don't think that an analysis of AIXItl can lead to any such general conclusion. AIXItl is very, very different from Novamente or any other pragmatic AI system. I think that an analysis of AIXItl's Friendliness or otherwise is going to be useful primarily as an exercise in "Friendliness analysis of AGI systems," rather than for any pragmatic implications it may yave. -- Ben > -----Original Message----- > From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED]]On > Behalf Of Philip Sutton > Sent: Sunday, February 16, 2003 9:42 AM > To: [EMAIL PROTECTED] > Subject: Re: [agi] Breaking AIXI-tl - AGI friendliness > > > Hi Eliezer/Ben, > > My recollection was that Eliezer initiated the "Breaking AIXI-tl" > discussion as a way of proving that friendliness of AGIs had to be > consciously built in at the start and couldn't be assumed to be > teachable at a later point. (Or have I totally lost the plot?) > > Do you feel the discussion has covered enough technical ground and > established enough concensus to bring the original topic back into > focus? > > Cheers, Philip > > ------- > To unsubscribe, change your address, or temporarily deactivate > your subscription, > please go to http://v2.listbox.com/member/?[EMAIL PROTECTED] > ------- To unsubscribe, change your address, or temporarily deactivate your subscription, please go to http://v2.listbox.com/member/?[EMAIL PROTECTED]
