On Sat, Mar 21, 2020 at 12:00 PM Matt Mahoney <[email protected]> wrote:
> Data compression won't solve AGI. It's just a useful tool for evaluating > language models... > I'd put it more like "Data compression _alone_ won't solve AGI. It's just the gold standard for model selection. Model selection _alone_ won't solve AGI." > Compression is not so useful for evaluating images, video, or audio > models. > That doesn't mean it's not the gold standard for model selection. "usefulness" aka "utility"gets one into the Sequential Decision Theory aspect of AIXI. > Lossless algorithms are overwhelmed by incompressible noise. > As long as two models are challenged with _exactly_ the same data, the small differences make all the difference in terms of model selection. One man's noise is another man's ciphertext. ------------------------------------------ Artificial General Intelligence List: AGI Permalink: https://agi.topicbox.com/groups/agi/T2a0cd9d392f9ff94-M7e108fbea78c86fa66282984 Delivery options: https://agi.topicbox.com/groups/agi/subscription
