You talking about the modern day AI models. I think AI in the future won't need the training set. Same as AlphaGo.
Are humans need to read the whole StackOverflow to understand how to create programs? No. Are humans limited to "training set" they used to learn? No. There are no inherent requirement that Smart Being is limited by "training set". Modern day AI models - sure. As for future - who nows, but I think no such limitation.
