Did you try a pre-processor? Did it not help your algorithm? I'm assuming it did not, since you don't include a dictionary in your program size.
Do you do some sort of BPE then? Like, word prediction? It's basically what the pre-processor does. ------------------------------------------ Artificial General Intelligence List: AGI Permalink: https://agi.topicbox.com/groups/agi/T0ab60589326cfa6a-Me6df174d73fae59cf427e833 Delivery options: https://agi.topicbox.com/groups/agi/subscription
