James, if theirs is trained on enwik9 and if GPT was too, then we can compare. Remember, if both models reached a training level where both really need not eat more data, you'd see the smarter one is better no matter how much data the other eats. So let's say GPT scores better than theirs, it's ok if it has a big model, because the other can't reach its accuracy even if eats to get a as big model as GPT's. Big model is only a problem if can't run it. That requires optimization before moving on. One day when we reach the seemingly best AI, we can then start worrying about model size and speed as its the only gain left.
And if I'm wrong, then my first thought on this thread is correct. ------------------------------------------ Artificial General Intelligence List: AGI Permalink: https://agi.topicbox.com/groups/agi/T6761a13445e5864b-Mc32deb96ba6f64b000912289 Delivery options: https://agi.topicbox.com/groups/agi/subscription
