There was a paper indicating 4 to 16 demultiplexing occurring in the brain.
That is also a sort of step function (4 binary inputs light up one of 16
outputs.) If I do 1 to 2 demultiplexing in single layer nets I get great
generalization ability but rather slow training. If I do 4 to 16
demultiplexing I get less good generalization but much faster training.
Obviously there are trade offs, and perhaps evolution picked one for us?
---
[Visit Topic](https://discourse.numenta.org/t/step-activation-functions/2295/2)
or reply to this email to respond.
You are receiving this because you enabled mailing list mode.
To unsubscribe from these emails, [click
here](https://discourse.numenta.org/email/unsubscribe/165f364be9e7004bf6480cc03a60530964ff70b723dedd13d300b4a840c30ff5).
