Re: [ot][spam][log] poking at km-infinite was: attempt bits: talk to a language model on list

[Undescribed Horrific Abuse, One Victim & Survivor of Many]

ok i found some numbers that i think indicate lm-infinite is poor
which is sad because it was fun to try to learn to implement it

in the lm-infinite paper they have this data:

actually no i am not sure

grumph

how confusing these things are

i don’t fully understand the lm-infinite approach at this time
but basically they are all heuristics that try to