On 7/10/21, YKY (Yan King Yin, 甄景贤) <[email protected]> wrote: > On 7/10/21, [email protected] > <[email protected]> wrote: >> IOW kinda like that page that explains GPT real good, >> it, didn't, remarkably, despite all those kindergarten images. And he >> thinks >> he did a real good job! > > You just need to follow the calculations in the Transformer to verify > my statement. > I have done that once but I've forgotten the details. It's just > simple algebra of matrices.
PS: the diagram I included was for self-attention, but I remember having verified it for "ordinary" attention. Sorry about the sloppiness, and it reminds me I should add some explanation about self-attention... :) ------------------------------------------ Artificial General Intelligence List: AGI Permalink: https://agi.topicbox.com/groups/agi/Tb5526c8a9151713b-M9c085fece3d1365234f7554a Delivery options: https://agi.topicbox.com/groups/agi/subscription
