Jonathan, although I certainly can't speak for either Ben or the SIAI, note that the two items you reference were written by different people -- Ben Goertzel and Eliezer Yudkowsky -- and they can't be expected to be in agreement. Neither of these items, certainly not Goertzel's, can be considered "official."
Ben only recently joined the SIAI as Director of Research along with a number of advisors and researchers; I'm certainly keeping my eyes open to learn about the mode of collaboration between these smart people. Mason, on the question of maximizing entropy, I think that Samantha summarized Yudkowsky's Friendliness insights well: Eliezer has decided that he wants to preserve the best of human values, since we don't have anything better for now. A super-intelligence may help us refine these values, but for now the most important thing -- even more important than pinning down the exact form of utopia we want -- is to ensure that the soon-to-come AGI does not wipe out humanity as a side effect. When you understand the following, you will have surpassed most AI experts in understanding the risks: If the first AGI is given or decides to try for almost any goal, including a simple "harmless" goal like being as good as possible at proving theorems, then humanity will be wiped out by accident. Joshua 2007/5/25, Jonathan H. Hinck <[EMAIL PROTECTED]>:
Dear Dr. Goertzel, I realize that you are not the overseer for the Singularity General Discussion group, but, if you are reading this, I have a question I am hoping you would answer if you have the time and inclination: How would you reconcile your call for an "A.I. Manhattan Project" (the article for which you posted at http://www.kurzweilai.net/meme/frame.html?main=memelist.html?m=3%23701 ) with the concerns your institute has expressed regarding the potential pitfalls of governmental regulation (at http://www.singinst.org/upload/CFAI/policy.html#policies )? -- Jonathan Hinck Serials & Archives Librarian Viterbo University Library 900 Viterbo Drive La Crosse, WI 54601 ------------------------------ This list is sponsored by AGIRI: http://www.agiri.org/email To unsubscribe or change your options, please go to: http://v2.listbox.com/member/?&;
----- This list is sponsored by AGIRI: http://www.agiri.org/email To unsubscribe or change your options, please go to: http://v2.listbox.com/member/?member_id=4007604&user_secret=7d7fb4d8
