2008/11/29 Matt Mahoney [EMAIL PROTECTED]:
The general problem of detecting overfitting is not computable. The principle
according to Occam's Razor, formalized and proven by Hutter's AIXI model, is
to choose the shortest program (simplest hypothesis) that generates the data.
Overfitting is
AIXI is a purely theoretic construct, requiring infinite computational resources
AIXItl is a version that could be implemented in principle, but not in
practice due to truly insane computational resource requirements
Whether the line of thinking and body of theory underlying these
things can be
Philip Hunt wrote:
2008/11/29 Matt Mahoney [EMAIL PROTECTED]:
The general problem of detecting overfitting is not computable. The
principle according to Occam's Razor, formalized and proven by
Hutter's AIXI model, is to choose the shortest program (simplest
hypothesis) that generates the data.
