On Tue, Aug 24, 2021, 6:55 PM <[email protected]> wrote:
> > https://roxxcloud.com/cerebras-systems-lays-the-foundation-for-massive-artificial-intelligence/ > So this is all in the planning stage. They haven't designed or built anything yet, or written any code. They are just looking for investors to raise a few billion dollars because they have an idea. It's not a bad idea. I just wonder what it will cost to build a 120 trillion parameter neural network on 192 nodes each with 800,000 cores optimized for sparse matrix operations implemented on untested wafer scale integration, and 2.4 PB memory. (Or 8 TB. It's not clear from the article. It says each node has 40 GB, which would only give you a few trillion parameters). But if it worked it would give you pretty close to a human brain sized neural network (600 trillion synapses). Would this give the investors a return? What's the electric bill per hour? Anybody want to bet on when something this big will be built, and who will do it? ------------------------------------------ Artificial General Intelligence List: AGI Permalink: https://agi.topicbox.com/groups/agi/T607f92b6c1ea30a8-M1afab30f9788d3d08c45f024 Delivery options: https://agi.topicbox.com/groups/agi/subscription
