Hey Vlad - By "considers itself Friendly", I'm refering to an FAI that is renormalizing in the sense you suggest. It's an "intentional stance" interpretation of what it's doing, regardless of whether the FAI is actually "considering itself Friendly", whatever that would mean.
I'm asserting that if you had an FAI in the sense you've described, it wouldn't be possible in principle to distinguish it with 100% confidence from a rogue AI. There's no "Turing Test for Friendliness". Terren --- On Wed, 9/3/08, Vladimir Nesov <[EMAIL PROTECTED]> wrote: > From: Vladimir Nesov <[EMAIL PROTECTED]> > Subject: Re: [agi] What is Friendly AI? > To: [email protected] > Date: Wednesday, September 3, 2008, 5:04 PM > On Thu, Sep 4, 2008 at 12:46 AM, Terren Suydam > <[EMAIL PROTECTED]> wrote: > > > > Hi Vlad, > > > > Thanks for the response. It seems that you're > advocating an incremental > > approach *towards* FAI, the ultimate goal being full > attainment of Friendliness... > > something you express as fraught with difficulty but > not insurmountable. > > As you know, I disagree that it is attainable, because > it is not possible in > > principle to know whether something that considers > itself Friendly actually > > is. You have to break a few eggs to make an omelet, as > the saying goes, > > and Friendliness depends on whether you're the egg > or the cook. > > > > Sorry Terren, I don't understand what you are trying to > say in the > last two sentences. What does "considering itself > Friendly" means and > how it figures into FAI, as you use the phrase? What (I > assume) kind > of experiment or arbitrary decision are you talking about? > > -- > Vladimir Nesov > [EMAIL PROTECTED] > http://causalityrelay.wordpress.com/ > > > ------------------------------------------- > agi > Archives: https://www.listbox.com/member/archive/303/=now > RSS Feed: https://www.listbox.com/member/archive/rss/303/ > Modify Your Subscription: > https://www.listbox.com/member/?&; > Powered by Listbox: http://www.listbox.com ------------------------------------------- agi Archives: https://www.listbox.com/member/archive/303/=now RSS Feed: https://www.listbox.com/member/archive/rss/303/ Modify Your Subscription: https://www.listbox.com/member/?member_id=8660244&id_secret=111637683-c8fa51 Powered by Listbox: http://www.listbox.com
