On Thu, Dec 19, 2019 at 8:46 PM <[email protected]> wrote:
> So, you want BERT to generate data, then hear itself talk to itself in the > head, then generate the next wave of data? It can have a line to > humans/internet and skip the real body for now. What are you doing to make > it not generate silly data? > BERT trains by predicting missing / masked tokens in text corpora. That forces it to attain common-sense knowledge. ------------------------------------------ Artificial General Intelligence List: AGI Permalink: https://agi.topicbox.com/groups/agi/Tcfe7cc93841eec23-Mb2ca001967050357a48cd461 Delivery options: https://agi.topicbox.com/groups/agi/subscription
