Linas, I thought a bit about how to use a modified version of the word2vec idea in our language learning pipeline...
I'm thinking about the Skip-gram model of word2vec, as summarized informally e.g. here http://mccormickml.com/2016/04/19/word2vec-tutorial-the-skip-gram-model/ Following up the suggestion you made in Addis in our chat with Masresha, I'm thinking to replace the "adjacent word-pairs" used in word2vec with "word-pairs that are adjacent in the parse tree" (where e.g. the parse tree may be the max-weight spanning tree in our language learning algorithm).... This would still produce a vector just like word2vec does, via the hidden layer of the NN ... but the vector would likely be more meaningful than a typical word2vec vector... What would the purpose of this be, in the context of our language learning algorithm? The purpose would be that clustering should work better on the word2vec vectors than on the raw-er data regarding "word co-occurrence in parse trees." At least, that seems plausible, since clustering on word2vec vectors generally works better than on co-occurrence vectors This would be something that Masresha or someone else in Addis could work on, I think... We can discuss at the office this week... ben -- Ben Goertzel, PhD http://goertzel.org “Our first mothers and fathers … were endowed with intelligence; they saw and instantly they could see far … they succeeded in knowing all that there is in the world. When they looked, instantly they saw all around them, and they contemplated in turn the arch of heaven and the round face of the earth. … Great was their wisdom …. They were able to know all.... But the Creator and the Maker did not hear this with pleasure. … ‘Are they not by nature simple creatures of our making? Must they also be gods? … What if they do not reproduce and multiply?’ Then the Heart of Heaven blew mist into their eyes, which clouded their sight as when a mirror is breathed upon. Their eyes were covered and they could see only what was close, only that was clear to them.” — Popol Vuh (holy book of the ancient Mayas) -- You received this message because you are subscribed to the Google Groups "opencog" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at https://groups.google.com/group/opencog. To view this discussion on the web visit https://groups.google.com/d/msgid/opencog/CACYTDBc3RLChVKehr4DMxbXVbpyMJkyszsKVju-7cy7GpZzBrQ%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
