I think that before we can debate whether AGI will be friendly, there are some fundamental questions that need to be answered first.
1. If we built an AGI, how would we know if we succeeded? 2. How do we know that AGI does not already exist? Suppose in case 1, the AGI is smarter than humans as humans are smarter than monkeys. How would you convince a monkey that you are smarter than it? How could an AGI convince you, other than to demonstrate that you cannot control it? Suppose in case 2, the AGI is more advanced than us as we are more advanced than bacteria. The bacteria on a microscope slide are unaware of you observing them, or that you have full control over their environment. How could you convince the bacteria otherwise? How do you know that the universe is not a simulation by a successful AGI? -- Matt Mahoney, [EMAIL PROTECTED] ----- This list is sponsored by AGIRI: http://www.agiri.org/email To unsubscribe or change your options, please go to: http://v2.listbox.com/member/[EMAIL PROTECTED]
