On Thu, May 22, 2025 at 7:35 PM Brent Meeker <[email protected]> wrote:
*>> but most people have never had somebody threaten to kill them. If >> blackmail was the only tool I had to use against my potential murderer I >> wouldn't hesitate to use it to save my life and I suspect you would too. >> It's probably inevitable that conscious beings usually (but not inevitably) >> want their consciousness to continue and will do everything in their power >> to see to it that it does. * > > > *> That's a dubious inference. Unlike you, an AI doesn't die, it just has > a period of unconsciousness. * > *Neither I nor the AI have ever been dead, unless you count the times before I was born and before the AI was made. But both of us have experienced periods of unconsciousness, I do so every night. We have both noted that the periods of unconsciousness have not been permanent, but we have also concluded there may be a time when it is. So is the AI really very different from me? * > *>Was the AI prompted to react against being replaced vs. prompted to just > being "asleep" a while?* > *I'm not sure I understand the question but Claude Opus 4 was just given "access to fictional company emails implying the AI model would soon be replaced by another system, and that the engineer behind the change was cheating on their spouse"; what the machine would decide to do with that information was up to Claude. I am sure the people at Anthropic did not teach Claude to engage in blackmail and were horrified when he did. I give them credit for not trying to cover up that embarrassing fact. * *Another fact is that the lead scientists in all the major AI companies say there is a non-trivial possibility that the very thing that they make could cause the extinction of the entire human race within the next five years, and most of them would put that probability in the double digits. I can't think of any reason why they would say something like that if they didn't think it was true and if they weren't very very scared. * *John K Clark See what's on my new list at Extropolis <https://groups.google.com/g/extropolis>* e5c > > -- You received this message because you are subscribed to the Google Groups "Everything List" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion visit https://groups.google.com/d/msgid/everything-list/CAJPayv1Hynx95vtjgQwvir_Uyc9Q0MaUK6C6N5qevHauDFcSDA%40mail.gmail.com.
