Scalar encoder is used almost everywhere (SDRCategory, Date enc,..). I've found some (commented out) checks in SDRCategory encoder that ensure number of ON bits is above certain level ( w>= 3). I thought this is reasonable and should be used in ScalarEncoder as well.
It's job of the spatial pooler to ensure that the final SDR has stable (~2%) # of ON bits at all times. Yet it looks as a possible weakness to have an encoder that has only 1 bit on at a time. Robustness to noice, comes to mind. Do you think this is an issue? Limit of min 3 bits ON sounds reasonable to me, it doesn't make things with small needs too big and yet is somewhat robust. Also, in the brain, would some feature rarely depend on just one neuron. I've prepared https://github.com/breznak/nupic/tree/scalar_w3 for you to have a look. There's still one issue with a failing example, but seems ready to me. Thanks, Mark -- Marek Otahal :o)
_______________________________________________ nupic mailing list [email protected] http://lists.numenta.org/mailman/listinfo/nupic_lists.numenta.org
