I, quite deliberately, did not mention "Solomonoff Induction" as an information criterion for model selection, precisely because it is not computable. The point of my conjecture is that there is a very good reason to select "the smallest executable archive of the data" as your information criterion over the other information criteria -- and it has to do with the weakness of "lossy compression" as model selection.
------------------------------------------ Artificial General Intelligence List: AGI Permalink: https://agi.topicbox.com/groups/agi/T0fc0d7591fcf61c5-M34b02ac693743894b722d9b9 Delivery options: https://agi.topicbox.com/groups/agi/subscription
