Interesting article. I have found this link to "GPT in 60 Lines of NumPy" on Hacker Newshttps://jaykmody.com/blog/gpt-from-scratch/It is similar to nanoGPT and minGPT from Andrej Karpathy, who has joined OpenAI again recentlyhttps://github.com/karpathy/nanoGPTThe secret is apparently not to use a complicated algorithm but just a huge amount of data, as Rich Sutton writes here http://www.incompleteideas.net/IncIdeas/BitterLesson.html-J. -------- Original message --------From: Russ Abbott <[email protected]> Date: 2/10/23 5:53 PM (GMT+01:00) To: The Friday Morning Applied Complexity Coffee Group <[email protected]> Subject: [FRIAM] A very good piece about ChatGPT. It's in the New Yorker and intended for a non-scientific audience.
-. --- - / ...- .- .-.. .. -.. / -- --- .-. ... . / -.-. --- -.. . FRIAM Applied Complexity Group listserv Fridays 9a-12p Friday St. Johns Cafe / Thursdays 9a-12p Zoom https://bit.ly/virtualfriam to (un)subscribe http://redfish.com/mailman/listinfo/friam_redfish.com FRIAM-COMIC http://friam-comic.blogspot.com/ archives: 5/2017 thru present https://redfish.com/pipermail/friam_redfish.com/ 1/2003 thru 6/2021 http://friam.383.s1.nabble.com/
