Robin <mixent...@aussiebroadband.com.au> wrote:
> If it killed off several thousand people, the rest of us > >would take extreme measures to kill the AI. Yudkowsky says it would be far > >smarter than us so it would find ways to prevent this. > > Multiple copies, spread across the Internet, would make it almost > invulnerable. > (Assuming a neural network can be "backed up".) > I do not think it would be difficult to find and expurgate copies. They would be very large. However smart the AI is, humans are also smart, and we know how computer networks work. They are designed to be transparent. In any case, killing off all humans, or most humans, would surely kill the AI itself. It could not survive without electricity. It would know that. In short, I think we would do well to be cautious. > I agree.
