Aseem, Yes, the CLA can learn many different sequences and many overlapped sequences. The NuPIC implementation does this. I didn't quite follow your comment about "predict something 2 steps further". Perhaps this will address that question.
Say you train the CLA on two sequences "A-B-C-D-E" and "X-B-C-D-Y". If you then feed the system "A-B-C-D" it will predict "E". If however you feed the system "B-C-D" it will predict both "E" and "Y". In Grok, the CLA is almost always making multiple predictions at the same time. If you feed a continuous stream into the CLA it will not know when to stop assuming that the data is one long sequence. For example, if you turn the learning rate up so that transitions are learned in one shot, then the system will learn one very long high order sequence. In a brain there are various reasons this wouldn't happen. In our implementation of the CLA we implemented a simple albeit non-biological way to avoid this. One thing is we have a way to force a sequence restart. Another is we limited to number of steps that the CLA will concatenate to an sequence in one pass. So if you have a sequence that is 25 steps long and the max length of learning is 5, it would take five passes through the sequence to learn the entire thing. Jeff -----Original Message----- From: nupic [mailto:[email protected]] On Behalf Of Aseem Hegshetye Sent: Monday, February 03, 2014 9:27 PM To: [email protected] Subject: [nupic-discuss] CLA for 2 sequences Hi, I have been working on CLA for all my time. I have built my own customized version which learns a sequence and recalls it based on the inputs provided. So its possible to recall a sequence from beginning or middle or end depending on the inputs. But I am having tough time making it learn more than one sequence. Does the Nupic CLA learn more than one sequence at a time? So that if i want to predict something 2 steps further, It would have two different predictive states depending on which sequence I am referring to. thanks Aseem Hegshetye _______________________________________________ nupic mailing list [email protected] http://lists.numenta.org/mailman/listinfo/nupic_lists.numenta.org _______________________________________________ nupic mailing list [email protected] http://lists.numenta.org/mailman/listinfo/nupic_lists.numenta.org
