Ben, Am I reading this right - that this is "just" a VERY good demo of SUPERVISED learning - with no unsupervised components?
Steve ========= On Tue, Oct 20, 2015 at 11:19 PM, Ben Goertzel <[email protected]> wrote: > > On Wed, Oct 21, 2015 at 1:54 PM, Benjamin Kapp <[email protected]> wrote: > >> They are using reinforcement learning to train their system. But one of >> the problems with this is that it is dependent on a reward/punishment >> system which for them is determined by game scores. But in the real world >> there is no game score. Also in the game world game score is temporally >> closely related to the actions the agent performs. However in the real >> world rewards and punishments may be delayed by a great deal of time (if >> they are ever given). >> > > > Demis, Shane and the other Deep Mind folks are well aware of these issues, > of course... > > A fallacy I commonly see is that people like to compare their own ideas, > with other peoples' practical demonstrations... Of course Deep Mind's > practical demos, so far, embody only a small fraction of their ideas and > understanding... > > >> >> Further, Demis says in his talk they assume humans gain knowledge from >> experience, however the poverty of the stimulus argument proposed by >> Chomsky demonstrates clearly that humans acquire language faster than is >> possible given the limited stimuli they are exposed to. As such (for some >> kinds of knowledge of the world at least) it seems that human knowledge >> acquisition is due in no small part to a priori instinctual knowledge, >> something they do not seem to be representing in their system. >> > > > While I agree that humans have some inborn "inductive bias" as well as > some specific hard-wired skills, the extent and nature of this bias and > hard-wiring in the context of language is certainly not well-understood > currently. Derek Bickerton's writing on this topic has often been > interesting.... I note that using a deep network with a specific > architecture for language understanding is also a way of coding "inductive > bias" into one's architecture.... It is not clear how specific are the > inductive biases for language encoded into the human brain... Old-style > Chomskian "principles and parameters" ideas are clearly not correct in > detail... > > >> >> Also even if Demis is up to speed on all the latest knowledge from the >> domains of the mind sciences (which he likely is not), it wouldn't be the >> case that he would know how the brain functions deterministically since >> this is still outside the scope of human knowledge. As such he and his >> team can only guess at how the brain does intelligence. >> > > > Demis is a top-grade neuroscientist as well as an AGI guy, and many of the > Deep Mind folks are deeply into cognitive neuroscience. They know the > latest research.... Which means they also know how incomplete that > research is, yeah... > > -- Ben > *AGI* | Archives <https://www.listbox.com/member/archive/303/=now> > <https://www.listbox.com/member/archive/rss/303/10443978-6f4c28ac> | > Modify > <https://www.listbox.com/member/?&> > Your Subscription <http://www.listbox.com> > -- Full employment can be had with the stoke of a pen. Simply institute a six hour workday. That will easily create enough new jobs to bring back full employment. ------------------------------------------- AGI Archives: https://www.listbox.com/member/archive/303/=now RSS Feed: https://www.listbox.com/member/archive/rss/303/21088071-f452e424 Modify Your Subscription: https://www.listbox.com/member/?member_id=21088071&id_secret=21088071-58d57657 Powered by Listbox: http://www.listbox.com
