Re: [ot][spam][crazy][data] transformer model 'attention' improvement

[Undiscussed Horrific Abuse, Victim & Survivor of]

I'm pretty sure the "n" in time * memory = O(n^2) relates to the
key/query count, which are the same in self-attention. The batch
dimension is used by the user to set memory bounds.