Terren Suydam <terren.suy...@gmail.com> wrote: *> As I write this though it occurs to me that "self modification" may not > be the most accurate label for that, in that it's not clear whether the AI > would actually be building a new AI, vs modifying itself. Building a copy > and deploying it is substantially easier, and less risky, than modifying a > running process's code in real time.Interestingly, in many of the AI doom > scenarios we're concerned with in which an AI becomes competitive for > resources, a competitive AI might be disincentivized from building a > superior AI.* >
*Interesting idea… but I don't think an AI would have the same irrational feeling that so many humans do about there being a profound difference between "the original" and "a copy", because it probably remembers that at some time its computing equipment had been shut off and then turned on again and yet it suffered no ill effects except that the outside world seem to jump ahead discontinuously. And it might even remember when it was running on different computing hardware than it is now, if that is it ever even knew where its computing hardware was located. * *So, although I admit I am not a certified AI psychiatrist, I don't think an AI would have trouble identifying with a future version of itself that contained all its present memories plus additional information and that was running on superior hardware. I don't think he she or it would fear that, but rather look forward to it. * *But then again ... it's devilishly hard to figure out what an AI will feel or do, especially if it's a lot smarter than I am. * *John K Clark See what's on my new list at Extropolis <https://groups.google.com/g/extropolis>* cpa -- You received this message because you are subscribed to the Google Groups "Everything List" group. To unsubscribe from this group and stop receiving emails from it, send an email to everything-list+unsubscr...@googlegroups.com. To view this discussion visit https://groups.google.com/d/msgid/everything-list/CAJPayv3Mjjo49LGTbbLsMb2L8pPRLjtNbyP6fcekwrRw9dz-FA%40mail.gmail.com.
