>
> Yes, its amazing what even simple animal brains can do with
> simple learning problems, when rewards quickly follow
> behaviors. The forebrain evolved to solve the hard learning
> problems, when there are long delays between behaviors and
> rewards, and multiple behaviors precede rewards. To solve
> this 'credit assignment problem' it needs a model of how
> the world works. The forebrain seems stupid unless we award
> it points for difficulty.
I thought about that too, but then I thought of games like slot machines, craps and
roulette. In these cases, reward follows commission very quickly, and yet we're still
hopelessly bad at stopping.
Obviously a time delay has a big impact on credit assignment, but even some games with
short time scales are outside of our rationality agents' range of analysis. I think
it's an issue of task complexity (very odd given that roulette's probabilities are so
trivial).
"Strange game, the only winning move is... not to play"
-WarGames
-------
To unsubscribe, change your address, or temporarily deactivate your subscription,
please go to http://v2.listbox.com/member/[EMAIL PROTECTED]
