--- On Sat, 11/29/08, Jim Bromer <[EMAIL PROTECTED]> wrote: > I am not sure if Norvig's application of a probabilistic method to > detect overfitting is truly directed toward the agi community. In > other words: Has anyone in this grouped tested the utility and clarity > of the decision making of a fully automated system to detect > overfitting in a range of complex IO data fields that one might expect > to encounter in AGI?
The general problem of detecting overfitting is not computable. The principle according to Occam's Razor, formalized and proven by Hutter's AIXI model, is to choose the shortest program (simplest hypothesis) that generates the data. Overfitting is the case of choosing a program that is too large. -- Matt Mahoney, [EMAIL PROTECTED] ------------------------------------------- agi Archives: https://www.listbox.com/member/archive/303/=now RSS Feed: https://www.listbox.com/member/archive/rss/303/ Modify Your Subscription: https://www.listbox.com/member/?member_id=8660244&id_secret=120640061-aded06 Powered by Listbox: http://www.listbox.com
