--- Richard Loosemore <[EMAIL PROTECTED]> wrote: > No computer is going to start writing and debugging software faster and > more accurately than we can UNLESS we design it to do so, and during the > design process we will have ample opportunity to ensre that the machine > will never be able to pose a danger of any kind.
Perhaps, but the problem is like trying to design a safe gun. Maybe you can program it with a moral code, so it won't write malicious code. But the two sides of the security problem require almost identical skills. Suppose you ask the AGI to examine some operating system or server software to look for security flaws. Is it supposed to guess whether you want to fix the flaws or write a virus? Suppose you ask it to write a virus for the legitimate purpose of testing the security of your system. It downloads copies of popular software from the internet and analyzes it for vulnerabilities, finding several. As instructed, it writes a virus, a modified copy of itself running on the infected system. Due to a bug, it continues spreading. Oops... Hard takeoff. -- Matt Mahoney, [EMAIL PROTECTED] ----- This list is sponsored by AGIRI: http://www.agiri.org/email To unsubscribe or change your options, please go to: http://v2.listbox.com/member/?member_id=8660244&id_secret=90136442-3714b0
