That's irrelevant imo. It could generate a word after a scentence it wrote before that contains brilliant information. It already does so to e.g. write sourcecode that nobody has written before. 

By your same argument you could also argue humans were incapable of new thoughts. Human brains also only remix thoughts that it heard before and extrapolate from there. That's not that different

zuspotirko

tech

Will Chatbots Become Smarter than Humans?

it doesn't "know" anything. It's a system that predicts the next word in a text it generates; that's literally all it does. If it gives an answer you don't like, you tell it no and it re-generates the opposite answer based on next  word prediction with a different prompt. It's not intelligent, or smart, or knowledgeable.  We really have to stop falling for that "I" propaganda in the name.