It allows it to consider/ recognize very very long unseen context by using
something like word2vec to find context matches that aren't exact and by
focusing on important words that are more rare, and then to stretch even longer
and become more accurate as well it boosts candidate predictions using
remaining energy from prior activations. More recent words boost the
predictions the most, they have not lost energy as much.
------------------------------------------
Artificial General Intelligence List: AGI
Permalink:
https://agi.topicbox.com/groups/agi/T1f56a0e2e53cf50a-M49829f27da55befa8741b6d0
Delivery options: https://agi.topicbox.com/groups/agi/subscription
