The integration that you're talking about is something that we've been working on for years. It's part of our neuro-symbolic architecture. Basically, if you can get something like GPT-2 to learn natural language, then you can project those lessons into the Atomspace and reason on them with the rest of OpenCog. But that's far from trivial, and it's not clear that GPT-2 is the best framework for that kind of integration. I'm not personally working on the integration myself, but I know that there are a lot of considerations beyond which machine learning approach seems to be performing the best right now. Deborah could tell you more.
On Sat, Feb 22, 2020 at 2:30 AM Tom Harrison <[email protected]> wrote: > The natural language understanding in OpenCog at the moment isn't very > good, and even though GPT-2 has problems with several things, perhaps it > could be integrated with other OpenCog modules that can handle those things. > > On Fri, 21 Feb 2020 at 17:09, Lake Watkins <[email protected]> wrote: > >> Hey Tom, >> >> Thanks for the post. I've been pushing for something like this for >> years, and I've been following AIDungeon since its release, but I don't >> think it's as sophisticated as you might think. >> >> Lacking procedural or episodic knowledge is a major flaw, and one that >> fundamentally prevents these sorts of systems from performing meaningful >> reasoning. You're right that OpenCog has methods for handling this, but >> really reasoning is the whole value-add of OpenCog to other cognitive >> systems. It's not so much that AIDungeon would lead to a breakthrough in >> OpenCog, it's that OpenCog's methods could lead to a breakthrough in new >> AIDungeons. >> >> My own startup is aiming to do just that, but we're still a long ways >> away from rivaling human dungeon masters. I do think OpenCog has that >> potential, but if I were designing an AIDungeon I would do it very >> differently. If you have thoughts on the matter I'd love to hear them. >> >> Regards, >> -Lake >> >> On Sat, Feb 22, 2020 at 12:53 AM Tom Harrison <[email protected]> wrote: >> >>> https://github.com/openai/gpt-2 >>> https://play.aidungeon.io/ >>> >>> These are links to an AI model called GPT-2, it has amazing natural >>> language understanding, AIDungeon is an implementation of this model, it >>> demonstrates an amazing ability to understand language, almost perfectly. >>> The only flaw in AIDungeon is remembering story elements and the >>> surrounding environment, though i believe Opencog already has methods for >>> handling this, i think this could lead to a breakthrough in OpenCog >>> development. >>> >>> -- >>> You received this message because you are subscribed to the Google >>> Groups "opencog" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to [email protected]. >>> To view this discussion on the web visit >>> https://groups.google.com/d/msgid/opencog/8b044da0-4f84-4550-b866-8b2734242d01%40googlegroups.com >>> <https://groups.google.com/d/msgid/opencog/8b044da0-4f84-4550-b866-8b2734242d01%40googlegroups.com?utm_medium=email&utm_source=footer> >>> . >>> >> -- >> You received this message because you are subscribed to the Google Groups >> "opencog" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to [email protected]. >> To view this discussion on the web visit >> https://groups.google.com/d/msgid/opencog/CAKyoboDTVwB4w0Y0GfenT2HoFe%3DmnHt%3DvO%3Dpmp%3DiMv_LMYJq_A%40mail.gmail.com >> <https://groups.google.com/d/msgid/opencog/CAKyoboDTVwB4w0Y0GfenT2HoFe%3DmnHt%3DvO%3Dpmp%3DiMv_LMYJq_A%40mail.gmail.com?utm_medium=email&utm_source=footer> >> . >> > -- > You received this message because you are subscribed to the Google Groups > "opencog" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To view this discussion on the web visit > https://groups.google.com/d/msgid/opencog/CAFYQi%3DsWW9Gd7PyujWteb8Lcr1otYm%2B-5ys9j6f8FnzQhorNRA%40mail.gmail.com > <https://groups.google.com/d/msgid/opencog/CAFYQi%3DsWW9Gd7PyujWteb8Lcr1otYm%2B-5ys9j6f8FnzQhorNRA%40mail.gmail.com?utm_medium=email&utm_source=footer> > . > -- You received this message because you are subscribed to the Google Groups "opencog" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/opencog/CAKyoboCAE8sKHkdz4AnB4nTfxfa9bSXAW5ScJMTWHpqaoVfaPQ%40mail.gmail.com.
