Hi James, Thanks for sharing that link - I think Ray Kurzweil played that video recently in one of his talks (I'll see if I can dig up the link, the rest of the talk is really relevant to us).
The designer of the mule made some interesting choices. He didn't build a big "mule head" on the front! He's dead right - this robot has a great brainstem and some basic "follow-the-leader" and "follow commands' behaviours, but is not really making high-level decisions about what it needs to do. It's the equivalent of a real baby mule, just after birth - it can stand, walk and run after its mother, but its neocortex is seeing these being done for the very first time and is only beginning to learn its sensorimotor model of the world. Matthew is correct: the API NuPIC would need to talk to is the equivalent of the Central Pattern Generators (CPGs) which are already controlling balance, taking the load, and performing basic walking and stepping behaviours. This is exactly the kind of thing I'd love to see combined with HTM. Maybe you could bring one to the hackathon! Regards, Fergal Byrne On Sat, Oct 11, 2014 at 3:40 AM, Matthew Lohbihler <[email protected] > wrote: > Hi James, > > NuPIC won't do any leg control and stuff out of the box. Personally, i > believe that sort of thing fits into the innate knowledge of the agent. I > have been working on innate behaviours in simulations, but it's tricky > stuff. (Well, i was working on it a bit back. I've been busy with other > work lately.) The idea is that innate commands would be included with > sensory afferents in the feeds to higher hierarchy levels, and that the > associations that happen there could learn what effect behaviours have on > the environment. Eventually, these learnings can be used to override innate > behaviours. See https://www.youtube.com/watch?v=ZFazR5yqesk for more > details. > > Hope this helps. > > Regards, > Matthew > > On 10/10/2014 8:53 AM, James Chen wrote: > > hello every one, > I am a newbie ,I want to use nupic to control this robot( > http://security.blogs.cnn.com/2012/02/07/meet-the-mule-bot/) > not vision detect part,just the four leg control,and realize > self-balancing and walking. > so my question is where can I start ,any suggestions will be grateful, > thanks. > > > -- Fergal Byrne, Brenter IT http://inbits.com - Better Living through Thoughtful Technology http://ie.linkedin.com/in/fergbyrne/ - https://github.com/fergalbyrne Founder of Clortex: HTM in Clojure - https://github.com/nupic-community/clortex Author, Real Machine Intelligence with Clortex and NuPIC Read for free or buy the book at https://leanpub.com/realsmartmachines Speaking on Clortex and HTM/CLA at euroClojure Krakow, June 2014: http://euroclojure.com/2014/ and at LambdaJam Chicago, July 2014: http://www.lambdajam.com e:[email protected] t:+353 83 4214179 Join the quest for Machine Intelligence at http://numenta.org Formerly of Adnet [email protected] http://www.adnet.ie
