Video clearly has a lot more commercial and military applications. Moreover, audio alone doesn't really offer a simulation of physical world with object permanence etc. Now there won't be user customized movies right away, but the present production process surely is going to get upended, and not to mention the areas like advertising and porn. The capability increment here wrt humans is significant, so perhaps we're not very far from the exponential slide.
regards, https://muskdeer.blogspot.com/ ---- On Fri, 16 Feb 2024 23:46:38 +0530 Matt Mahoney <[email protected]> wrote --- On Fri, Feb 16, 2024, 1:33 AM <mailto:[email protected]> wrote: https://openai.com/research/video-generation-models-as-world-simulators So many questions. How much training data, how much compute to train, how much compute to generate a video, how many parameters? It is estimated (because OpenAI didn't say) that GPT4 has 1.8 trillion parameters, was trained on 13 billion tokens (most of the public Internet), cost $100M to train (10^25 ops at 10^17 per dollar) and runs on 128 A100 GPUs (around $2M). https://the-decoder.com/gpt-4-architecture-datasets-costs-and-more-leaked/ But other sources give different guesses. Is audio a harder problem than video, or does video have a bigger payoff so they attacked it first? It costs $1M to $10M to produce a movie for a mass audience that you would pay $1 to $10 to watch. If Moore's law drops the price by half every 18 months, then we are still 25 years from customized movie genres replacing mass entertainment. Should we expect a similar time scale for music? https://agi.topicbox.com/latest / AGI / see https://agi.topicbox.com/groups/agi + https://agi.topicbox.com/groups/agi/members + https://agi.topicbox.com/groups/agi/subscription https://agi.topicbox.com/groups/agi/T4ad5d8c386d0e116-Mc9f3c07a5bb0dac06360e952 ------------------------------------------ Artificial General Intelligence List: AGI Permalink: https://agi.topicbox.com/groups/agi/T4ad5d8c386d0e116-M3dec15e64cdb652d277cade3 Delivery options: https://agi.topicbox.com/groups/agi/subscription
