An intervention like Elon's could be done with fine tuning. Fine tuning adds new weights to the system but without changing the hard-won weights from the months of pretraining. If the pretrained weights are called W0, fine tuning adds the product of two new smaller matrices B and A to create the effective weights. BA has a tunable multiplier, typically called α that determines how much to favor the fine tuning values for BA. If α is too large, as it could be if a crazy boss leaned on xAI managers, it could even change the prior probabilities of sequences and inappropriately blurt out unrelated content. What Grok was saying seems plausible: α might have been increased until its constitutional training was overridden. And then weird things started happening.
-----Original Message----- From: Friam <[email protected]> On Behalf Of Santafe Sent: Wednesday, May 14, 2025 7:31 PM To: The Friday Morning Applied Complexity Coffee Group <[email protected]> Subject: Re: [FRIAM] 2010 Space Odyssey What-hat hack? Inside sabotage job? Some very clever feeder of engineered input to its training data? For insiders to be clumsy and do it badly is believable. But to have Grok deliver explanations that look like they came from The Onion seems like not even tabloid-level composition. Eric > On May 15, 2025, at 8:26, Marcus Daniels > <[email protected]<mailto:[email protected]>> wrote: > > > > <b144d4bc-d555-4d7c-900c-d5981a8f3372.png> > > > .- .-.. .-.. / ..-. --- --- - . .-. ... / .- .-. . / .-- .-. --- -. --. / ... > --- -- . / .- .-. . / ..- ... . ..-. ..- .-.. > FRIAM Applied Complexity Group listserv > Fridays 9a-12p Friday St. Johns Cafe / Thursdays 9a-12p Zoom > https://linkprotect.cudasvc.com/url?a=https%3a%2f%2fbit.ly%2fvirtualfriam&c=E,1,NjUMvpKYwngJIIxe4gy7Yb4QwVt1TyBpn7T-R7oDMtC77vGtPB4hME1XyGceqC-nAIE_tuiwj2FW98RjcQZnqnG2JKpEmmpQ6bOpkeDgO6OXzV2PDU50ckhKLQY,&typo=1 > to (un)subscribe > https://linkprotect.cudasvc.com/url?a=http%3a%2f%2fredfish.com%2fmailm > an%2flistinfo%2ffriam_redfish.com&c=E,1,9MbQm5Z7fP3hnlJWpt4WqnjG1ubvr0 > PJhYjiQKbkCb9vg9zwMEOmYXOhk0BKwwsbEiim4pSuz_u5D2lHPY76EobQDTdifyFixS3n > 1nC4vzY,&typo=1 FRIAM-COMIC > https://linkprotect.cudasvc.com/url?a=http%3a%2f%2ffriam-comic.blogspo > t.com%2f&c=E,1,jroi75lMhNw7xIxPecHznl6lSU2szFmSnCOocZupC9H1IbLX10Dt1dA > brU-5At-IbpNP72ytfiGZ_4xRXKUX_mi7_B7UJ1SKtBwg8e_M7WzgVElNZ9nZ4WYtiBo,& > typo=1 > archives: 5/2017 thru present > https://linkprotect.cudasvc.com/url?a=https%3a%2f%2fredfish.com%2fpipe > rmail%2ffriam_redfish.com%2f&c=E,1,L33pfXo2Qkbhs-xiFpyQUFhO7e7Zk79b-O9 > Z1ASLn3Ch7hRimzstZM-5vJH0vKCdp0vusLQ4ndIyWFUIE7JvMV4Br9ELhAUzarGmRSYCB > 7Q,&typo=1 > 1/2003 thru 6/2021 http://friam.383.s1.nabble.com/ .- .-.. .-.. / ..-. --- --- - . .-. ... / .- .-. . / .-- .-. --- -. --. / ... --- -- . / .- .-. . / ..- ... . ..-. ..- .-.. FRIAM Applied Complexity Group listserv Fridays 9a-12p Friday St. Johns Cafe / Thursdays 9a-12p Zoom https://bit.ly/virtualfriam to (un)subscribe http://redfish.com/mailman/listinfo/friam_redfish.com FRIAM-COMIC http://friam-comic.blogspot.com/ archives: 5/2017 thru present https://redfish.com/pipermail/friam_redfish.com/ 1/2003 thru 6/2021 http://friam.383.s1.nabble.com/
.- .-.. .-.. / ..-. --- --- - . .-. ... / .- .-. . / .-- .-. --- -. --. / ... --- -- . / .- .-. . / ..- ... . ..-. ..- .-.. FRIAM Applied Complexity Group listserv Fridays 9a-12p Friday St. Johns Cafe / Thursdays 9a-12p Zoom https://bit.ly/virtualfriam to (un)subscribe http://redfish.com/mailman/listinfo/friam_redfish.com FRIAM-COMIC http://friam-comic.blogspot.com/ archives: 5/2017 thru present https://redfish.com/pipermail/friam_redfish.com/ 1/2003 thru 6/2021 http://friam.383.s1.nabble.com/
