[agi] Re: Thursday, March 25, 2021 Constructing Transformers For Longer Sequences with Sparse Attention Methods

[Jim Bromer]

I did not understand what they were saying well enough but the fundamentals of 
my criticisms are relevant - as are yours.  The reference to GAN was something 
that I reacted to in the same way you did when I first read it although I can 
appreciate it better now that I had time to think about it.  The formalizations 
do tend to make ideas like that narrow.  On the other hand making something 
small and solid would make it more specialized.  But that is part of it. Make 
stuff solid and fast and then try to generalize on it. Try to express it in 
general terms (as much as possible) if you want to make a difference. 
------------------------------------------
Artificial General Intelligence List: AGI
Permalink: 
https://agi.topicbox.com/groups/agi/T68be2fedf1f53ef2-M410196e39832707b06265527
Delivery options: https://agi.topicbox.com/groups/agi/subscription