On 10/26/07, Richard Loosemore <[EMAIL PROTECTED]> wrote: > > Stefan can correct me if I am wrong here, but I think that both yourself > and Aleksei have misunderstood the sense in which he is pointing to a > circularity. > > If you build an AGI, and it sets out to discover the convergent desires > (the CEV) of all humanity, it will be doing this because it has the goal > of using this CEV as the basis for the "friendly" motivations that will > henceforth guide it. > > But WHY would it be collecting the CEV of humanity in the first phase of > the operation? What would motivate it to do such a thing? What exactly > is it in the AGI's design that makes it feel compelled to be friendly > enough toward humanity that it would set out to assess the CEV of > humanity? > > The answer is: its initial feelings of friendliness toward humanity > would have to be the motivation that drove it to find out the CEV. > > The goal state of its motivation system is assumed in the initial state > of its motivation system. Hence: circular.
Interesting point and I guess asking if a programmers CEV would be to let an AGI find the CEV of humanity is another aspect of finding circularity in the concept. -- Stefan Pernar 3-E-101 Silver Maple Garden #6 Cai Hong Road, Da Shan Zi Chao Yang District 100015 Beijing P.R. CHINA Mobil: +86 1391 009 1931 Skype: Stefan.Pernar ----- This list is sponsored by AGIRI: http://www.agiri.org/email To unsubscribe or change your options, please go to: http://v2.listbox.com/member/?member_id=4007604&id_secret=57839625-1849b7
