[agi] Re: Why do Transformers have layers of Attention Heads?

[stefan.reich.maker.of.eye via AGI]

Not enough attention heads activated here...
------------------------------------------
Artificial General Intelligence List: AGI
Permalink: 
https://agi.topicbox.com/groups/agi/Ta21b3b47e26f50e7-Meb027e15ed9d959fd04c4d53
Delivery options: https://agi.topicbox.com/groups/agi/subscription