Hi Matthew (Lohbihler), Yuwei, Chetan, I apologize for my lack of a prompt response. Thank you all for your responses!
@Matthew - I initially wrote about my interest in porting the existing implementation to Java in another thread in which Matthew (Taylor) suggested I have a look at Marek Otahal's project on github (listed below). >> If you're interested in porting to Java, you might have a look at Marek Otahal's "htm-cla" project on Github [1]. Marek is one of our main community contributors, and before we open-sourced NuPIC, he wrote up his implementation of the CLA White Paper algorithms in Java (that's how I found him!). >> [1] https://github.com/breznak/htm-cla If you're interested in the Java port, you might have a look at this too. I'm still building my understanding of the SP/TM/(and future TP) mechanisms, and would like to wait for the new TM mechanism that Chetan is developing and as well as the new TP implementation. I think I would like to understand the various mechanisms very thoroughly before "diving in" to code - but I'm still available for discussion in the meantime; we should keep in touch and thank you for your offer! In addition, I'm still reviewing the implementation of Marek's which will also help build an understanding. I will probably develop an additional implementation, though not as a comment or critique on Marek's efforts, but just so that I can "shore" up my own understanding and go beyond the core mechanisms into the encoders, classifiers, and other peripheral support modules with the Java port. @Yuwei, Chetan - thank you for your clarifications and sharing the progress on your current projects. I wanted to ask another question. 1. Outside of the CLA algorithm implementation there are the swarming mechanism, the encoders and classifiers. Are these considered to be the difference between the "core" algorithm and the Online Prediction Framework (OPF)? 2. Will the new TM implementation be encapsulated in more "biological-like" structures? I noticed a difference between the work Marek has done and the current CLA implementation in terms of the discrete biological modeling? Cheers, David On Mon, Jul 14, 2014 at 12:43 PM, Chetan Surpur <[email protected]> wrote: > David, > > I'd also like to mention that I'm beginning work on a simplified temporal > memory (what you called sequence memory) implementation, that's closer to > the white paper description. This work should be completed in the near > future. However, you can still definitely port the existing temporal memory > (currently called TP) implementation to Java if you don't want to wait for > the simplified one. > > - Chetan > > > On July 14, 2014 at 9:02:58 AM, Yuwei Cui ([email protected]) wrote: > > Hi David, > > Each layer will be implementing sequence memory (we now call it temporal > memory). The goal is to predict future input based on past inputs. Spatial > pooling and sequence memory will not be combined. If you have read the > white paper, the spatial pooling occurs on the proximal dendrite, which can > drive cells into "active states", and sequence memory relies on inputs on > distal dendrite, which will turn cells into "predicted states" > > Our current working hypothesis is temporal pooling occurs both between > layer 4 and layer 3, and across regions. The outcome of temporal pooling is > more stable representation higher in the hierarchy. There will be an > emphasis on the stability soon, we already have a working temporal pooling > algorithm and will release it in the near future. The inter-regional > feedback seems a little further down the road. > > Yuwei > > > On Sun, Jul 13, 2014 at 3:12 PM, cogmission1 . <[email protected] > > wrote: > >> Hey Matt, >> >> I just watched the "Fireside chat" about Jeff's next TP ideas, and not to >> be argumentative (just looking to be as clear as I can be while watching >> things happen from the outside), but it appears as if he's going to >> introduce sequence memory, and temporal pooling between each layer? I think >> definitely between within layers 3 and 4? Also, it appears as if the SP and >> the Sequence Memory will be combined? Additionally, it looks like there >> will be some "inter-regional" feedback/predictions introduced between a >> subsequent region's layer 6 back into layer 5 of the previous layer. It >> maybe looks like some drastic overall changes may be occurring - maybe due >> to an effort toward emphasizing concepts of stability and inter-regional >> feedback?. Any news as to when we could see these changes rolled out - I >> can hardly wait...? :-P >> >> >> >> >> On Sat, Jul 12, 2014 at 12:08 PM, Matthew Taylor <[email protected]> >> wrote: >> >>> You can definitely dive in now. The new temporal memory work isn't going >>> to disrupt the current architecture at all, as far as I know. >>> >>> Start here: https://github.com/numenta/nupic/wiki/Learning-NuPIC >>> >>> --------- >>> Matt Taylor >>> OS Community Flag-Bearer >>> Numenta >>> >>> >>> On Sat, Jul 12, 2014 at 9:42 AM, cogmission1 . < >>> [email protected]> wrote: >>> >>>> Hi Everyone, >>>> >>>> I'm at the point now where I would begin to delve into the NuPIC code >>>> more deeply (I want to port it to Java as a way to exercise my >>>> understanding too), but I was wondering if there is any point to it prior >>>> to the new TP/Sequence Memory implementation? Should I maybe wait? >>>> >>>> Thanks >>>> >>>> David >>>> >>>> _______________________________________________ >>>> nupic mailing list >>>> [email protected] >>>> http://lists.numenta.org/mailman/listinfo/nupic_lists.numenta.org >>>> >>>> >>> >>> _______________________________________________ >>> nupic mailing list >>> [email protected] >>> http://lists.numenta.org/mailman/listinfo/nupic_lists.numenta.org >>> >>> >> >> _______________________________________________ >> nupic mailing list >> [email protected] >> http://lists.numenta.org/mailman/listinfo/nupic_lists.numenta.org >> >> > > > -- > -- > Yuwei Cui > > Algorithm Internship, Numenta Inc. > > PhD Candidate, Neuroscience and Cognitive Science > > University of Maryland, College Park, MD, 20742 > > Homepage: http://terpconnect.umd.edu/~ywcui/ > _______________________________________________ > nupic mailing list > [email protected] > http://lists.numenta.org/mailman/listinfo/nupic_lists.numenta.org > > > _______________________________________________ > nupic mailing list > [email protected] > http://lists.numenta.org/mailman/listinfo/nupic_lists.numenta.org > >
_______________________________________________ nupic mailing list [email protected] http://lists.numenta.org/mailman/listinfo/nupic_lists.numenta.org
