800+GBs of pure English text - as good as what GPT-2 trained on if not better even. https://the-eye.eu/public/AI/pile/
They are making massive models: https://www.eleuther.ai/ FAQ: https://www.eleuther.ai/faq/ Conner Leah lol. It's kinda funny I've had people on discord, youtube, and here all ask me if I'm actually a markov chain and if I'm GPT... ------------------------------------------ Artificial General Intelligence List: AGI Permalink: https://agi.topicbox.com/groups/agi/Tf7a6ec59f595351b-M665535b8fefc3e09dfc45ccf Delivery options: https://agi.topicbox.com/groups/agi/subscription
