On Sun, May 15, 2022 at 2:32 AM <[email protected]> wrote: > Hi YKY :) > > May I ask, how Transformers may deal with logical operators? >
I guess it would handle logic operators syntactically just like natural-language words, such as "and", "but", "implies", ... and even phrases like "on the other hand", etc. Currently the Transformer sometimes fails to answer logical questions correctly, and I guess this is a place where we can try to design better variations of Transformers. What exactly goes on inside the Transformer is a complicated question. There is a paper about "Transformer circuits" that gives an in-depth analysis of this... ------------------------------------------ Artificial General Intelligence List: AGI Permalink: https://agi.topicbox.com/groups/agi/Tb1f6f9085be343b3-M6bbfbfd6933fe594ee9a4a64 Delivery options: https://agi.topicbox.com/groups/agi/subscription
